eTeam · 12 hours ago
Senior Databricks Data Engineer (Spark, Python)
eTeam is a company seeking a Senior Databricks Data Engineer with extensive experience in data engineering. The role involves designing, developing, and maintaining scalable data pipelines on Databricks, optimizing existing pipelines, and ensuring data quality and compliance.
Information Technology
Responsibilities
Design, develop, and maintain scalable and robust data pipelines on Databricks
Optimize and troubleshoot existing data pipelines for performance and reliability
Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks
Ensure data quality and integrity across various data sources
Implement data security and compliance best practices
Monitor data pipeline performance and conduct necessary maintenance and updates
Document data pipeline processes and technical specifications
Qualification
Required
8-10 years of experience
7+ years of experience in data engineering
Design, develop, and maintain scalable and robust data pipelines on Databricks
Optimize and troubleshoot existing data pipelines for performance and reliability
Proficiency with Databricks and Spark
Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks
Strong SQL skills and experience with relational databases
Experience with big data technologies
Ensure data quality and integrity across various data sources
Implement data security and compliance best practices
Monitor data pipeline performance and conduct necessary maintenance and updates
Document data pipeline processes and technical specifications
Preferred
Hadoop
Hive
Company
eTeam
eTeam is a staffing agency that also provides payrolling services.
H1B Sponsorship
eTeam has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (36)
2024 (205)
2023 (11)
2022 (7)
2021 (24)
2020 (25)
Funding
Current Stage
Late StageTotal Funding
unknown2023-12-04Acquired
Recent News
2025-11-19
2025-08-21
Company data provided by crunchbase