TMS, LLC · 16 hours ago
Databricks Architect - 15 years exp.
TMS, LLC is seeking a Databricks Architect to design and lead modern Lakehouse data platforms using Databricks. The role focuses on building scalable, high-performance data pipelines and enabling analytics and AI use cases on cloud-native data platforms.
AutomotiveSoftwareStaffing Agency
Responsibilities
Architect and implement Databricks Lakehouse solutions for large-scale data platforms
Design and optimize batch & streaming data pipelines using Apache Spark (PySpark/SQL)
Implement Delta Lake best practices (ACID, schema enforcement, time travel, performance tuning)
Build and manage Databricks jobs, workflows, notebooks, and clusters
Enable data governance using Unity Catalog (access control, lineage)
Integrate Databricks with cloud data services (ADLS / S3, ADF, Synapse, etc.)
Support analytics, BI, and AI/ML workloads (MLflow exposure is a plus)
Lead solution design discussions and mentor data engineering teams
Qualification
Required
Minimum exp.- 14-15 yrs
10+ years in data engineering / data architecture
5+ years of strong hands-on experience with Databricks
Expert in Apache Spark, PySpark, SQL
Strong experience with Delta Lake & Lakehouse architecture
Cloud experience on Azure Databricks / AWS Databricks
Proven experience in designing high-volume, scalable data pipelines
Preferred
Unity Catalog, MLflow, Databricks Workflows
Streaming experience (Kafka / Event Hubs)
CI/CD for Databricks (Azure DevOps / GitHub)
Company
TMS, LLC
Technology Management Solutions (TMS, LLC), headquartered in Parsippany, New Jersey, is a premier IT company specializing in digital product engineering and innovative technology solutions.
H1B Sponsorship
TMS, LLC has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2)
2024 (4)
2023 (1)
Funding
Current Stage
Growth StageCompany data provided by crunchbase