QData Inc · 2 hours ago
Azure Databricks Architect ....
United States
Contract
Remote
Senior LevelQData Inc is seeking an experienced Azure Databricks Architect with strong hands-on expertise in Azure Data Factory to design and deliver scalable, enterprise-grade data platforms on Microsoft Azure. The role focuses on building end-to-end data ingestion, transformation, and analytics pipelines using ADF and Databricks, supporting analytics, BI, and AI/ML use cases.
Cyber SecurityData ManagementInformation TechnologyMobile AppsStaffing Agency
Responsibilities
Architect and implement end-to-end data solutions using Azure Databricks and Azure Data Factory
Design ADF pipelines for batch and incremental data ingestion from on-prem and cloud sources
Build and optimize Databricks Spark pipelines using Python and Spark SQL
Implement Delta Lake and medallion architecture (Bronze, Silver, Gold)
Orchestrate Databricks jobs using ADF triggers, scheduling, and dependency management
Integrate Databricks with ADLS Gen2, Azure Synapse, and Power BI
Establish data governance and security using Unity Catalog, RBAC, managed identities, and Azure Key Vault
Optimize performance, scalability, and cost across ADF and Databricks workloads
Implement CI/CD pipelines for ADF and Databricks using Azure DevOps or GitHub Actions
Provide architecture guidance and best practices to data engineering teams
Qualification
Required
Strong hands-on experience with Azure Databricks and Apache Spark
Extensive experience designing ADF pipelines, datasets, linked services, and triggers
Expertise in Python, Spark SQL, and ETL/ELT design patterns
Experience with Azure Data Lake Storage (ADLS Gen2)
Solid understanding of data security, governance, and compliance in Azure
Experience integrating ADF with Databricks notebooks and jobs
Company
QData Inc
Q Data Incorporation is one of the most progressive organizations in the country providing Information Technology (IT) services in staffing and consulting through out the USA.
Founded in 2008
11-50 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase