eTeam · 10 hours ago
Lead Azure Databricks & Integration Engineer
Pittsburgh, PA
Full-time
Hybrid
Lead/Staff
10+ years expeTeam is seeking a Lead Azure Databricks & Integration Engineer. The role requires extensive experience in Azure Databricks and Azure administration, focusing on managing large-scale data processing environments and optimizing data pipelines.
Information Technology
Responsibilities
Hands-on experience administering Azure Databricks or Azure ADF, including workspace provisioning, cluster configuration, job management, and access control
Experience with Identity and Access Management (IAM), Unity Catalog, secret scopes, audit logging, and network/security configuration within Databricks
Experience managing large-scale data processing environments, optimizing compute usage, and supporting mission-critical data pipelines
Qualification
Required
10+ years of experience in IT, data or digital roles, with 5+ years focused on Databricks and Azure administration
Hands-on experience administering Azure Databricks or Azure ADF, including workspace provisioning, cluster configuration, job management, and access control
Experience with Identity and Access Management (IAM), Unity Catalog, secret scopes, audit logging, and network/security configuration within Databricks
Experience managing large-scale data processing environments, optimizing compute usage, and supporting mission-critical data pipelines
Preferred
Strong understanding of Spark, Delta Lake, and Databricks workspace architecture
Experience with CI/CD for Databricks, including tools such as Azure DevOps, GitHub Actions, or Jenkins
Working knowledge of cloud platforms (Azure/AWS/GCP), including networking concepts like VNETs, private endpoints, and firewalls
Ability to troubleshoot performance, cluster stability, and job execution issues within Databricks
Company
eTeam
eTeam is a staffing agency that also provides payrolling services.
501-1000 employees
H1B Sponsorship
eTeam has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (36)
2024 (205)
2023 (11)
2022 (7)
2021 (24)
2020 (25)
Funding
Current Stage
Late StageTotal Funding
unknown2023-12-04Acquired
Leadership Team
Swetta Bhatt
CEO APAC & India
Aanchal Thakur
Chief Customer Officer
Recent News
2025-11-19
2025-08-21
Company data provided by crunchbase