GDH · 22 hours ago
Azure Databricks Engineer
United States
Full-time
Remote
Mid, Senior Level
$70/hr - $75/hrGDH is seeking an experienced Azure/Databricks Engineer and Data Operations Engineer for a remote-based role. The candidate will be responsible for designing, implementing, and managing enterprise data lake environments on Azure, focusing on automation, data pipeline development, and security compliance.
ConsultingHuman ResourcesEmploymentStaffing Agency
Responsibilities
Design, develop, and maintain scalable data pipelines for ETL/ELT processes using Azure Databricks, Data Factory, and Synapse
Build and optimize data ingestion solutions utilizing Azure Event Hub, Kafka, or similar streaming services
Manage enterprise data lake environments on Azure, ensuring data security, governance, and compliance using Unity Catalog, Collibra, and Azure IAM/RBAC
Implement Infrastructure-as-Code (IaC) using Terraform and Bicep to automate environment provisioning and configurations
Develop and deploy data workflows using PySpark, SQL, and Python, with version control through Git repositories
Automate deployment processes and maintain CI/CD pipelines leveraging Azure DevOps or GitHub Actions
Oversee data security processes, including network isolation with Private Link and VNet configurations
Collaborate on Data Ops processes to improve automation, efficiency, and data quality across the organization
Enable AI/ML solutions by integrating MLflow and managing feature stores for model tracking and deployment
Ensure data environments meet regulatory standards and adhere to FinOps, audit, and compliance requirements
Qualification
Required
Proven experience designing and managing data engineering solutions on Azure, including Databricks, Data Factory, Synapse, and ADLS Gen2
Strong programming skills in PySpark, SQL, and Python for building data pipelines
Hands-on experience with Infrastructure-as-Code (IaC), particularly Terraform and Bicep
Familiarity with DevOps practices, CI/CD pipeline automation, and version control systems like Git
Knowledge of data governance, security practices, and cloud compliance standards, especially in regulated industries such as healthcare or finance
Experience with real-time data streaming and event ingestion platforms like Kafka or Event Hub
Ability to work independently in a remote environment while collaborating effectively with cross-functional teams
Strong understanding of data modeling, security, and scalable data architecture principles
Excellent problem-solving skills and attention to detail, with an emphasis on automation and efficiency
Availability to work full-time with flexible schedules aligning with project needs
Company
GDH
GDH is consulting staffing firm that specializes in providing IT engineering-based candidates to commercial and government sectors.
Founded in 2001
501-1000 employees
H1B Sponsorship
GDH has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2023 (4)
2022 (2)
2021 (2)
2020 (1)
Funding
Current Stage
Late StageLeadership Team
Blaine Caples
Chief Revenue Officer (CRO)
Recent News
Bangkok Post
2025-10-22
2025-04-09
Company data provided by crunchbase