OP ยท 10 hours ago
Databricks SME/Lead
Plano, TX
Contract
Onsite
Senior Level, Lead/Staff
$60/hr - $70/hr
8+ years expOP is a technology consulting and solutions company that helps clients harness the power of technology for maximum impact. They are seeking an experienced Databricks SME/Lead to guide architecture, design, and implementation across their cloud data engineering initiatives, serving as a trusted technical advisor and coordinating with senior leadership on high-impact architectural decisions.
EnterpriseInformation ServicesInformation Technology
Responsibilities
Serve as the Databricks platform SME and trusted technical advisor for engineering teams
Create Architecture patterns to leverage Databricks features for Batch, real-time, Streaming & Operational analytics
Drive solutions with Databricks to accelerate data engineering productivity, ensure data protection & security, improve performance of jobs & queries
Review architecture diagrams, data workflows, pipelines, notebooks, and solution designs for accuracy and best practices
Provide corrective guidance, optimization suggestions, and technical leadership on Databricks implementations
Function as the bridge between engineering teams and leadership, escalating high-impact decisions when necessary
Enforce enterprise standards for architecture, governance, security, and performance across Databricks solutions
Mentor teams on Databricks, Spark, Delta Lake, and Lakehouse architectural patterns
Collaborate with architects, data engineers, and platform teams on pipeline design, orchestration, cluster strategy, and data optimization
Contribute to technical roadmaps, reusable patterns, and long-term platform strategy
Participate in OP monthly team meetings and participate in team-building efforts
Contribute to OP technical discussions, peer reviews, etc
Contribute content and collaborate via the OP-Wiki/Knowledge Base
Provide status reports to OP Account Management as requested
Qualification
Required
8+ years in data engineering or architecture roles, with deep Databricks platform expertise
Strong proficiency in PySpark, Spark SQL, Delta Lake, Lakehouse architecture, and Databricks Jobs/Workflows
Proven ability to review and validate architectural diagrams, solution designs, and platform components
Hands-on experience designing, optimizing, and troubleshooting Databricks pipelines and production workloads
Strong understanding of data governance, Unity Catalog, cluster management, CI/CD for Databricks, and performance tuning
Excellent communication and documentation skills, with the ability to mentor teams and act as a senior escalation point
Highly detail-oriented with strong analytical and technical evaluation skills
Preferred
Experience in hybrid roles combining technical execution with architectural governance
Cloud expertise (Azure, AWS, or GCP) in relation to Databricks deployments
Relevant certifications (Databricks, Spark, AWS/Azure/GCP)
Benefits
401(k)
Dental Insurance
Health insurance
Vision insurance
Company
OP
OP is one of the fastest-growing technology consulting and solutions companies in the U.S.
201-500 employees
H1B Sponsorship
OP has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (8)
2024 (5)
2023 (1)
2022 (8)
2021 (6)
2020 (11)
Funding
Current Stage
Growth StageLeadership Team
Raghav Putrevu
Founder & CEO
Company data provided by crunchbase