Jobs via Dice ยท 1 day ago
Data Engineer
Chicago, IL
Contract
Onsite
Mid LevelRobert Half is a specialized talent solutions firm that connects highly qualified job seekers to opportunities. They are seeking a skilled Data Engineer to contribute to the development and optimization of data systems, focusing on building efficient data pipelines and managing large datasets.
Computer Software
Responsibilities
Develop, implement, and maintain scalable data pipelines using tools such as Apache Spark and Hadoop
Optimize ETL processes to ensure efficient extraction, transformation, and loading of data
Collaborate with cross-functional teams to understand data needs and design solutions that align with business goals
Manage large-scale datasets, ensuring data integrity and accuracy
Integrate data from various sources using Apache Kafka and other relevant technologies
Monitor and troubleshoot data systems to identify and resolve performance issues
Create documentation and provide training on data processes to support team operations
Conduct regular reviews of data architecture to enhance system functionality
Ensure compliance with data governance and security standards
Work closely with stakeholders to deliver actionable insights and reporting based on data analytics
Qualification
Required
Proficiency in Apache Spark and Hadoop for data processing and management
Strong programming skills in Python for data manipulation and automation
Experience with Apache Kafka for real-time data streaming
Solid understanding of ETL processes and tools
Ability to work with large datasets and ensure data accuracy
Familiarity with data governance and security best practices
Excellent problem-solving and troubleshooting skills
Strong communication skills to collaborate with technical and non-technical teams
Benefits
Medical
Vision
Dental
Life and disability insurance
401(k)
Company
Jobs via Dice
Welcome to Jobs via Dice, the go-to destination for discovering the tech jobs you want.
0-1 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase