tms · 8 hours ago
Databricks Architect - 15 years exp.
United States
Contract
Remote
Senior Level, Lead/Staff
14+ years expTMS LLC is seeking a Databricks Architect to design and lead modern Lakehouse data platforms using Databricks. The role focuses on building scalable, high-performance data pipelines and enabling analytics and AI use cases on cloud-native data platforms.
AdvertisingBusiness DevelopmentMarket ResearchMarketing
Responsibilities
Architect and implement Databricks Lakehouse solutions for large-scale data platforms
Design and optimize batch & streaming data pipelines using Apache Spark (PySpark/SQL)
Implement Delta Lake best practices (ACID, schema enforcement, time travel, performance tuning)
Build and manage Databricks jobs, workflows, notebooks, and clusters
Enable data governance using Unity Catalog (access control, lineage)
Integrate Databricks with cloud data services (ADLS / S3, ADF, Synapse, etc.)
Support analytics, BI, and AI/ML workloads (MLflow exposure is a plus)
Lead solution design discussions and mentor data engineering teams
Qualification
Required
Minimum exp.- 14-15 yrs
10+ years in data engineering / data architecture
5+ years of strong hands-on experience with Databricks
Expert in Apache Spark, PySpark, SQL
Strong experience with Delta Lake & Lakehouse architecture
Cloud experience on Azure Databricks / AWS Databricks
Proven experience in designing high-volume, scalable data pipelines
Preferred
Unity Catalog, MLflow, Databricks Workflows
Streaming experience (Kafka / Event Hubs)
CI/CD for Databricks (Azure DevOps / GitHub)
Company
tms
tms unites technology and marketing and sourcing to drive transformational change for the world’s leading brands.
1001-5000 employees
H1B Sponsorship
tms has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2024 (2)
Funding
Current Stage
Late StageLeadership Team
Chuck McDonough
Chief Financial Officer
James Eby
Sr. Vice President, Chief Creative Officer
Company data provided by crunchbase