Connect Tech+Talent ยท 3 hours ago
Databricks Architect
Texas, United States
Contract
Onsite
Senior Level, Lead/Staff
8+ years expConnect Tech+Talent is seeking a Databricks Architect to lead the design and implementation of data solutions. The role involves working with cross-functional teams to develop and maintain ETL/ELT workflows, ensuring data quality and security, and leveraging Azure cloud services.
Information TechnologySoftware
Hiring Manager
Laks K
Responsibilities
Implement ETL/ELT workflows for both structured and unstructured data
Automate deployments using CI/CD tools
Collaborate with cross-functional teams including data scientists, analysts, and stakeholders
Design and maintain data models, schemas, and database structures to support analytical and operational use cases
Evaluate and implement appropriate data storage solutions, including data lakes (Azure Data Lake Storage) and data warehouses
Implement data validation and quality checks to ensure accuracy and consistency
Contribute to data governance initiatives, including metadata management, data lineage, and data cataloging
Implement data security measures, including encryption, access controls, and auditing; ensure compliance with regulations and best practices
Proficiency in Python and R programming languages
Strong SQL querying and data manipulation skills
Experience with Azure cloud platform
Experience with DevOps, CI/CD pipelines, and version control systems
Working in agile, multicultural environments
Strong troubleshooting and debugging capabilities
Design and develop scalable data pipelines using Apache Spark on Databricks
Optimize Spark jobs for performance and cost-efficiency
Integrate Databricks solutions with cloud services (Azure Data Factory)
Ensure data quality, governance, and security using Unity Catalog or Delta Lake
Deep understanding of Apache Spark architecture, RDDs, DataFrames, and Spark SQL
Hands-on experience with Databricks notebooks, clusters, jobs, and Delta Lake
Qualification
Required
8 Years - Implement ETL/ELT workflows for both structured and unstructured data
8 Years - Automate deployments using CI/CD tools
8 Years - Collaborate with cross-functional teams including data scientists, analysts, and stakeholders
8 Years - Design and maintain data models, schemas, and database structures to support analytical and operational use cases
8 Years - Evaluate and implement appropriate data storage solutions, including data lakes (Azure Data Lake Storage) and data warehouses
8 Years - Implement data validation and quality checks to ensure accuracy and consistency
8 Years - Contribute to data governance initiatives, including metadata management, data lineage, and data cataloging
8 Years - Implement data security measures, including encryption, access controls, and auditing; ensure compliance with regulations and best practices
8 Years - Proficiency in Python and R programming languages
8 Years - Strong SQL querying and data manipulation skills
8 Years - Experience with Azure cloud platform
8 Years - Experience with DevOps, CI/CD pipelines, and version control systems
8 Years - Working in agile, multicultural environments
8 Years - Strong troubleshooting and debugging capabilities
5 Years - Design and develop scalable data pipelines using Apache Spark on Databricks
5 Years - Optimize Spark jobs for performance and cost-efficiency
5 Years - Integrate Databricks solutions with cloud services (Azure Data Factory)
5 Years - Ensure data quality, governance, and security using Unity Catalog or Delta Lake
5 Years - Deep understanding of Apache Spark architecture, RDDs, DataFrames, and Spark SQL
5 Years - Hands-on experience with Databricks notebooks, clusters, jobs, and Delta Lake
Preferred
1 Year - Knowledge of ML libraries (MLflow, Scikit-learn, TensorFlow)
1 Year - Databricks Certified Associate Developer for Apache Spark
1 Year - Azure Data Engineer Associate
Company
Connect Tech+Talent
Connect Tech+Talent brings together highly qualified technology professionals with great companies.
11-50 employees
H1B Sponsorship
Connect Tech+Talent has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2)
2023 (2)
2020 (1)
Funding
Current Stage
Early StageCompany data provided by crunchbase