Cotiviti · 7 hours ago
Senior Data Engineer
United States
Full-time
Remote
Senior Level
5+ years expCotiviti is seeking an experienced Senior Data Engineer, focusing on large-scale data processing and analytics solutions using modern big data technologies. The role involves designing and developing scalable data processing pipelines, optimizing Spark applications, and collaborating with data scientists to implement machine learning pipelines.
Information Technology & Services
Responsibilities
Design and develop scalable data processing pipelines using Python, Spark, and Hadoop ecosystems
Build and maintain ETL workflows on AWS EMR clusters for processing terabytes of data
Optimize Spark applications for performance, cost-efficiency, and reliability
Develop data visualization and exploration tools using Hue and other analytics platforms
Collaborate with data scientists and analysts to implement production-ready machine learning pipelines
Monitor and troubleshoot distributed computing environments
Qualification
Required
5+ years of software development experience
Proficiency in programming languages like Python & SQL
Knowledge of database modeling and familiarity with ETL tools
Experience with big data technologies and cloud platforms (AWS)
Strong expertise in Apache Spark (PySpark, Spark SQL) and Hadoop ecosystem (HDFS, YARN, MapReduce)
Proven experience with AWS EMR cluster management and optimization
Proficiency with data exploration and workflow management
Experience with distributed systems and performance tuning
Experience with real-time data streaming (Kafka, Kinesis)
Data governance & security experience
Machine learning concepts knowledge
Preferred
AWS certifications (Solutions Architect, Big Data Specialty)
Experience with additional AWS services (S3, Glue, Redshift, Athena)
Familiarity with containerization (Docker, Kubernetes)
Experience with CI/CD pipelines and infrastructure as code
Company
Cotiviti
Cotiviti enables healthcare organizations to deliver better care at lower cost through advanced technology and data analytics that improve the quality and sustainability of healthcare in the United States.
5001-10000 employees
H1B Sponsorship
Cotiviti has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (165)
2024 (118)
2023 (90)
2022 (102)
2021 (72)
2020 (67)
Funding
Current Stage
Late StageLeadership Team
Adam Gilbert
Director, Interoperability Operations and Partnerships
Chris McIntyre
Sr. Program Manager, RQNC Operations
Recent News
2024-04-07
Company data provided by crunchbase