SIGN IN
Senior Databricks Data Engineer (Spark, Python) jobs in United States
info-icon
This job has closed.
company-logo

eTeam · 15 hours ago

Senior Databricks Data Engineer (Spark, Python)

eTeam is a company seeking a Senior Databricks Data Engineer with extensive experience in data engineering. The role involves designing, developing, and maintaining scalable data pipelines on Databricks, optimizing existing pipelines, and ensuring data quality and compliance.
Information Technology
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Design, develop, and maintain scalable and robust data pipelines on Databricks
Optimize and troubleshoot existing data pipelines for performance and reliability
Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks
Ensure data quality and integrity across various data sources
Implement data security and compliance best practices
Monitor data pipeline performance and conduct necessary maintenance and updates
Document data pipeline processes and technical specifications

Qualification

DatabricksSparkPythonSQLBig Data TechnologiesHadoopHive

Required

8-10 years of experience
7+ years of experience in data engineering
Design, develop, and maintain scalable and robust data pipelines on Databricks
Optimize and troubleshoot existing data pipelines for performance and reliability
Proficiency with Databricks and Spark
Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks
Strong SQL skills and experience with relational databases
Experience with big data technologies
Ensure data quality and integrity across various data sources
Implement data security and compliance best practices
Monitor data pipeline performance and conduct necessary maintenance and updates
Document data pipeline processes and technical specifications

Preferred

Hadoop
Hive

Company

eTeam is a staffing agency that also provides payrolling services.

H1B Sponsorship

eTeam has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (36)
2024 (205)
2023 (11)
2022 (7)
2021 (24)
2020 (25)

Funding

Current Stage
Late Stage
Total Funding
unknown
2023-12-04Acquired

Leadership Team

leader-logo
Swetta Bhatt
CEO APAC & India
linkedin
leader-logo
Aanchal Thakur
Chief Customer Officer
linkedin
Company data provided by crunchbase