Jobs via Dice ยท 2 days ago
Senior Data Engineer
United States
Full-time
Remote
Mid, Senior Level
4+ years expDice is the leading career destination for tech experts at every stage of their careers. Our client, Concert, is seeking a skilled Senior Data Engineer to join their team, where the role will focus on designing, developing, and maintaining data infrastructure and pipelines to support data-driven insights in healthcare. The position involves collaboration with data scientists and analysts to ensure robust and scalable data solutions.
Computer Software
Responsibilities
Design, develop, and maintain scalable and efficient data pipelines using AWS services such as Redshift, S3, Lambda, ECS, Step Functions, and Kinesis Data Streams
Implement and manage data warehousing solutions, primarily with Redshift, and optimize existing data models for performance and scalability
Utilize DBT (data build tool) for data transformation and modeling, ensuring data quality and consistency
Develop and maintain ETL/ELT processes to ingest, process, and store large datasets from various sources
Work with SageMaker for machine learning data preparation and integration
Ensure data security, privacy, and compliance with industry regulations
Collaborate with data scientists and analysts to understand data requirements and deliver solutions that meet their needs
Monitor and troubleshoot data pipelines, identifying and resolving issues promptly
Implement best practices for data engineering, including code reviews, testing, and automation
Mentor junior data engineers and share knowledge on data engineering best practices
Stay up-to-date with the latest advancements in data engineering, AWS services, and related technologies
Qualification
Required
Minimum of 4 years experience working as a data engineer
Bachelor's degree in software or data engineering or comparable technical certification / experience
Proven experience in designing and implementing data solutions on AWS, including Redshift, S3, Lambda, ECS, and Step Functions
Strong understanding of data warehousing principles and best practices
Experience with DBT for data transformation and modeling
Proficiency in SQL and at least one programming language (e.g., Python, Scala)
Ability to effectively communicate complex technical concepts to both technical and non-technical audiences
Preferred
Familiarity or experience with BI tools such as Metabase
Familiarity or experience with healthcare claims data, security requirements, and HIPAA compliance
Familiarity or experience with Kimball's dimensional modeling techniques
Familiarity or experience with ZeroETL and Kinesis data streams
Company
Jobs via Dice
Welcome to Jobs via Dice, the go-to destination for discovering the tech jobs you want.
0-1 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase