Euclid Innovations · 7 hours ago
Databricks Architect – DBU Optimization
New Jersey, United States
Contract
Hybrid
Senior Level, Lead/Staff
$85/hr - $85/hr
15+ years expEuclid Innovations is seeking a Databricks Architect to design and optimize enterprise-scale Databricks platforms. The role focuses on DBU cost optimization, performance tuning, and scalable Lakehouse architecture.
ConsultingCryptocurrencyDevOpsInformation TechnologyRisk ManagementSoftware
Hiring Manager
Rahul Yalamanchili
Responsibilities
Architect Databricks solutions for batch, streaming, and analytics workloads
Drive DBU optimization through cluster strategy, autoscaling, auto-termination, and Photon adoption
Design and optimize Delta Lake tables and Spark workloads
Define best practices for job clusters, cluster policies, and workspace governance
Implement Unity Catalog for security and data governance
Partner with cloud and data teams to optimize performance and cost
Qualification
Required
15+ years overall experience
6+ years on Databricks
Design end-to-end Databricks architectures for batch, streaming, and analytics workloads
Define best practices for cluster strategy, workspace design, and multi-environment setups (Dev/Test/Prod)
Strong experience with Databricks (AWS/Azure/GCP)
Deep knowledge of Spark, Delta Lake, and DBU consumption models
Hands-on expertise in PySpark/Scala and SQL
Analyze Databricks usage patterns and identify DBU cost optimization opportunities
Define and enforce cluster policies to control DBU consumption
Optimize job vs all-purpose clusters
Optimize autoscaling and auto-termination
Experience with cloud data platforms and object storage
Ability to lead architecture decisions and guide engineering teams
Preferred
Databricks certifications
Experience with large-scale enterprise data platforms
Company
Euclid Innovations
Euclid Innovations specializes in product development, application development, risk management, computational solutions, and DevOps.
501-1000 employees
H1B Sponsorship
Euclid Innovations has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (32)
2024 (14)
2023 (35)
2022 (34)
2021 (36)
2020 (66)
Funding
Current Stage
Late StageCompany data provided by crunchbase