Senior Databricks Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Largeton Group ยท 6 hours ago

Senior Databricks Engineer

Largeton Group is seeking a Senior Databricks Engineer to design, develop, and maintain large-scale data solutions. The role involves implementing data integration frameworks, managing automation tools, and collaborating with teams to drive data strategy.

ConsultingInformation TechnologyTraining
check
H1B Sponsor Likelynote

Responsibilities

Design, develop, and maintain large-scale data pipelines and ETL solutions in Azure Databricks using PySpark and Delta Lake
Implement data integration frameworks and API-based ingestion with tools such as Apigee or Kong
Architect and deliver scalable, performant, and governed enterprise data solutions
Develop and manage automation tools and CI/CD pipelines using Jenkins, Ansible, or Terraform
Troubleshoot and resolve production data pipeline failures and performance bottlenecks (partitioning, caching, shuffle, cluster sizing, Z-ordering)
Manage Unity Catalog for data governance, enforce data security policies (row/column-level access), and maintain data lineage
Administer Databricks clusters, jobs, and SQL warehouses, optimizing costs and resources (auto-stop, job clusters, Photon)
Collaborate with cross-functional teams to drive data strategy and standards across the organization
Create and maintain detailed architectural diagrams, interface specifications, and data flow documentation
Mentor and guide junior engineers on Databricks, Spark optimization, and Azure data best practices

Qualification

Azure DatabricksPySparkDelta LakeCI/CD pipelinesData governanceData strategyMentoring

Required

5+ years as a Data Engineer
deep expertise in Azure Databricks and PySpark
strong knowledge of Delta Lake
Z-ordering
partitioning
OPTIMIZE
ACID transactions

Company

Largeton Group

twittertwittertwitter
company-logo
At Largeton Group, we're passionate about empowering businesses to reach new heights through innovative staffing solutions and cutting-edge technology.

H1B Sponsorship

Largeton Group has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (5)
2024 (10)
2023 (8)
2022 (6)
2021 (7)
2020 (11)

Funding

Current Stage
Growth Stage

Leadership Team

leader-logo
Ashutosh Tripathi
Managing Partner
linkedin
leader-logo
Saurabh Prakash
Client Partnership Manager.
linkedin
Company data provided by crunchbase