Chelsoft Solutions Co. ยท 2 months ago
Databricks Platform Lead Engineer_W2_Newport Beach, CA / Columbus, Ohio
Newport Beach, CA
Contract
Onsite
Senior Level
5+ years expChelsoft Solutions Co. is seeking a Databricks Platform Lead Engineer to transform their data science environment into a resilient, enterprise-grade platform. This role involves leading the modernization of platform operations, automating processes, integrating services, and establishing best practices for Databricks administration and platform engineering.
Information Technology & Services
Responsibilities
Guide engineering and data science teams through Databricks best practices
Deliver comprehensive knowledge transfer (KT) to internal platform engineers
Enable self-service capabilities for Data Science teams
Automate service principal management and security access workflows
Establish alerting mechanisms for system failures and anomalies
Optimize and clean up the existing Databricks environment for scalability and maintainability
Connect Databricks with other tools (Azure, H2O, Snowflake) to ensure seamless interoperability
Standardize configuration workflows and governance policies to improve reliability
Troubleshoot and resolve failures in Databricks and Azure pipelines
Implement updates across Data Science-owned accounts and services
Collaborate with MLEs (e.g., Roxxanne and Chris) and platform engineers (e.g., Koda)
Provide hands-on support and mentorship to team members unfamiliar with Databricks
Qualification
Required
Azure cloud expert
Databricks expert
Cluster management
Security (roles and permissions)
Experience with security / networking assessments and reports
Machine learning experience
Medallion architecture
Snowflake experience w/ Databricks
Terraform with Azure Databricks
Cluster/query optimization
Azure Storage
5+ years of experience in platform engineering, cloud administration, or ML engineering
Deep expertise in Databricks administration, architecture, and optimization
Strong experience with Azure, Snowflake, and H2O.ai integrations
Proven ability to automate infrastructure and security workflows
Excellent communication and documentation skills
Self-starter with a proactive mindset and strong problem-solving abilities
Preferred
Experience in enterprise data platform transformation
Familiarity with CI/CD pipelines and DevOps practices
Prior experience in coaching or mentoring technical teams
Company
Chelsoft Solutions Co.
Inc. 5000 Fastest Growing Pvt. Companies in USA 5 yr Honoree; Ingrams 4yr Honoree; 2014 MBE Award Winner in State of KS
51-200 employees
H1B Sponsorship
Chelsoft Solutions Co. has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (15)
2024 (12)
2023 (21)
2022 (26)
2021 (18)
2020 (70)
Funding
Current Stage
Growth StageCompany data provided by crunchbase