Largeton Group ยท 6 hours ago
Senior Databricks Engineer
Largeton Group is seeking a Senior Databricks Engineer to design, develop, and maintain large-scale data solutions. The role involves implementing data integration frameworks, managing automation tools, and collaborating with teams to drive data strategy.
ConsultingInformation TechnologyTraining
Responsibilities
Design, develop, and maintain large-scale data pipelines and ETL solutions in Azure Databricks using PySpark and Delta Lake
Implement data integration frameworks and API-based ingestion with tools such as Apigee or Kong
Architect and deliver scalable, performant, and governed enterprise data solutions
Develop and manage automation tools and CI/CD pipelines using Jenkins, Ansible, or Terraform
Troubleshoot and resolve production data pipeline failures and performance bottlenecks (partitioning, caching, shuffle, cluster sizing, Z-ordering)
Manage Unity Catalog for data governance, enforce data security policies (row/column-level access), and maintain data lineage
Administer Databricks clusters, jobs, and SQL warehouses, optimizing costs and resources (auto-stop, job clusters, Photon)
Collaborate with cross-functional teams to drive data strategy and standards across the organization
Create and maintain detailed architectural diagrams, interface specifications, and data flow documentation
Mentor and guide junior engineers on Databricks, Spark optimization, and Azure data best practices
Qualification
Required
5+ years as a Data Engineer
deep expertise in Azure Databricks and PySpark
strong knowledge of Delta Lake
Z-ordering
partitioning
OPTIMIZE
ACID transactions
Company
Largeton Group
At Largeton Group, we're passionate about empowering businesses to reach new heights through innovative staffing solutions and cutting-edge technology.
H1B Sponsorship
Largeton Group has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (5)
2024 (10)
2023 (8)
2022 (6)
2021 (7)
2020 (11)
Funding
Current Stage
Growth StageCompany data provided by crunchbase