STAFFWORXS · 1 day ago
Azure Databricks Engineer/ Architect
Nashville, TN
Contract
Onsite
Senior Level, Lead/Staff
$60/hr - $65/hr
9+ years expSTAFFWORXS is seeking a highly experienced Azure Databricks Data Architect / Consultant to support manufacturing data platforms. The role involves designing scalable lakehouse architectures, implementing robust data pipelines, enforcing governance with Unity Catalog, and collaborating with stakeholders to translate business requirements into high-quality data solutions.
AppsConsultingInformation TechnologyProject Management
Hiring Manager
VENKAT R.
Responsibilities
Ability to conduct client meetings and stakeholder interviews
Experience creating structured questionnaires for client discovery sessions
Strong capability in gathering user requirements and producing data architecture and design documents for manufacturing applications on Azure and Databricks
Basic project management skills to plan, track, and manage data engineering initiatives
Excellent communication skills, with the ability to collaborate effectively with both client teams and internal delivery teams
Qualification
Required
Advanced Apache Spark with strong hands-on expertise in PySpark and/or Scala, including performance tuning using Spark UI, partitioning strategies, joins, caching, and shuffle optimization
Deep Azure Databricks platform expertise, including notebooks, jobs/workflows, cluster configuration, Databricks SQL, and implementation of Medallion Architecture (Bronze/Silver/Gold)
Strong experience with Delta Lake, including ACID transactions, schema enforcement and evolution, MERGE operations, time travel, and performance-optimized Delta table design
Unity Catalog and data governance experience: catalogs, schemas, tables, permission models, secure access patterns, and data lineage across workspaces
Advanced SQL skills for data modeling, complex transformations, aggregations, and BI-ready lakehouse structures
Solid Azure platform experience, including Azure Data Lake Storage (ADLS), Azure Data Factory or Synapse Pipelines, Event Hubs / IoT integrations, Networking, identity and access management, Azure Key Vault and monitoring
Data modeling and warehousing expertise, including dimensional modeling, star/snowflake schemas, and analytics-focused performance design
CI/CD and DevOps for data engineering, using Git-based workflows with Azure DevOps or GitHub Actions for Databricks pipelines and artifacts
Ability to conduct client meetings and stakeholder interviews
Experience creating structured questionnaires for client discovery sessions
Strong capability in gathering user requirements and producing data architecture and design documents for manufacturing applications on Azure and Databricks
Basic project management skills to plan, track, and manage data engineering initiatives
Excellent communication skills, with the ability to collaborate effectively with both client teams and internal delivery teams
Company
STAFFWORXS
StaffWorxs is an IT consulting and services firm that provides application development, project management, and data services.
51-200 employees
H1B Sponsorship
STAFFWORXS has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (25)
2024 (17)
2023 (12)
2022 (8)
2021 (8)
2020 (1)
Funding
Current Stage
Growth StageCompany data provided by crunchbase