Coda Search│Staffing · 1 week ago
Databricks Data Architect
United States
Full-time
Remote
Senior LevelCoda Search is a global consulting firm seeking a senior Data Architect with deep Databricks expertise. The role involves leading the design, modernization, and implementation of enterprise-scale data platforms while mentoring engineering teams and collaborating with stakeholders.
ConsultingRecruitingStaffing Agency
No H1B
Responsibilities
Define and evolve enterprise data architecture using Databricks Lakehouse patterns, including Medallion architecture (Bronze/Silver/Gold)
Design conceptual, logical, and physical data models that support analytics, reporting, and machine learning use cases
Lead migration of legacy data platforms and pipelines to modern Databricks frameworks, ensuring scalability, performance, and cost efficiency
Establish reference architectures, standards, and best practices for ingestion, transformation, orchestration, and governance
Design, build, and maintain reusable data products using Databricks, Delta Live Tables (DLT), PySpark, and SQL
Develop and optimize batch and streaming data pipelines, including file compaction and performance tuning strategies
Contribute directly to implementation while guiding data engineers through design decisions, code reviews, and delivery
Troubleshoot and resolve complex data platform and pipeline issues
Design and implement Databricks Unity Catalog–enabled architectures, including workspace migrations
Create and manage group-based ACLs, compute policies, and governance controls within Unity Catalog
Ensure adherence to data security, privacy, and compliance requirements (RBAC, encryption, lineage, auditing)
Define and enforce CI/CD and DevOps practices for data engineering, including version control, automated testing, and infrastructure-as-code deployments
Partner with stakeholders (Data Product Owners, Analytics, Security, Infrastructure) to translate business requirements into technical solutions
Provide architectural guidance from discovery through implementation, including roadmap creation and delivery planning
Stay current on emerging data engineering and Databricks platform capabilities and recommend adoption when appropriate
Qualification
Required
Proven experience as a Data Architect or Senior Data Engineer with strong architectural ownership
Deep hands-on expertise with Databricks, including Delta Lake, Delta Live Tables, and Unity Catalog
Strong proficiency in PySpark and SQL for large-scale data processing
Experience designing dimensional models and Medallion-based lakehouse architectures
Demonstrated success migrating Databricks workspaces and data models to Unity Catalog-enabled environments
Strong experience managing ACLs, governance policies, and compute controls in Databricks
Hands-on experience with data orchestration and pipeline tools such as Azure Data Factory or AWS Glue
Experience working with cloud data lakes (Azure Storage and/or AWS S3)
Strong understanding of batch and streaming data processing patterns
Experience applying DevOps and CI/CD principles (Git, Azure DevOps, CI/CD pipelines, IaC)
Preferred
Experience designing enterprise-grade data lake and lakehouse architectures
Exposure to broader cloud services (Azure messaging, serverless compute, networking, storage)
Experience supporting analytics and BI platforms such as Power BI or Tableau
Familiarity with streaming platforms (Kafka, Event Hubs) and CDC patterns
Databricks certifications (Data Engineer or Architect)
Company
Coda Search│Staffing
At Coda, we believe the best way to serve our clients is through an inclusive and personalized approach. We’re not order-takers, we’re consultants.
Founded in 2011
51-200 employees
Funding
Current Stage
Growth StageLeadership Team
Linh Nguyen
Chief Operating Officer
Recent News
2025-08-13
Company data provided by crunchbase