Principal Architect, Databricks jobs in United States
cer-icon
Apply on Employer Site
company-logo

The Friedkin Group · 20 hours ago

Principal Architect, Databricks

The Friedkin Group is a company dedicated to fostering a culture of excellence and innovation. They are seeking a Principal Architect for the Databricks platform to lead architectural vision and implementation, develop reusable patterns, and mentor engineering teams in building scalable data solutions.

Executive Office
check
Growth Opportunities
badNo H1Bnote

Responsibilities

Develop and Implement Reference Architectures: Design, build, and maintain a library of production-quality reference architectures and reusable patterns that showcase best practices and accelerate development for engineering teams
Architect and Prototype Solutions: Architect and build proofs-of-concept for end-to-end solutions on the Databricks Lakehouse Platform, actively demonstrating feasibility and validating complex designs through hands-on implementation
Advise Through Doing: Serve as the primary consultant for engineering teams on all aspects of Databricks, providing expert guidance that extends beyond diagrams to include code, best practices, and hands-on support
Lead Platform Training: Create training sessions and train engineers, leading the adoption and implementation of new features such as Unity Catalog, Delta Live Tables, and advanced MLOps capabilities
Establish and Govern Best Practices: Define, document, and evangelize standards for Databricks development, including data modeling, performance tuning, security, and cost management
Mentor and Coach: Mentor engineers and other technical staff through code reviews, paired programming, and design sessions, elevating the overall technical proficiency of the organization within the Databricks ecosystem

Qualification

Databricks MasteryCloud ArchitectureSoftware EngineeringCI/CD & AutomationAutomationObservabilityCommunicationStrategic MindsetCritical Thinking

Required

Bachelor's Degree Computer Science or related field
10+ years' Experience in software engineering, including significant experience in architecting systems
Proven experience acting as a hands-on technical architect and advisor on large-scale data projects
Databricks Mastery: Deep, expert-level knowledge of the Databricks Platform, including: Unity Catalog: Designing and implementing data governance and security. Delta Lake & Delta Live Tables: Architecting and building reliable, scalable data pipelines. Performance & Cost Optimization: Expertise in tuning Spark jobs, optimizing cluster usage, and managing platform costs. MLOps: Strong, practical understanding of the machine learning lifecycle on Databricks using tools like MLflow. Databricks SQL: Knowledge of designing and optimizing analytical workloads. Mosaic AI: Knowledge of designing and optimizing AI Agents
Cloud & Infrastructure: Deep knowledge of cloud architecture and services on AWS. Strong command of Infrastructure as Code (Terraform, YAML)
Software Engineering & Programming: Strong background in software engineering and building large fault-tolerant systems
CI/CD & Automation: Experience with designing and implementing CI/CD pipelines (preferably with GitHub Actions) for data and ML workloads
Observability: Familiarity with implementing monitoring, logging, and alerting for data platforms
Automation: The platform is ephemeral, and all changes are implemented using Terraform and Python. Expertise in Terraform and Python is a must
Excellent communication and interpersonal skills, with the ability to influence and guide technical teams and stakeholders effectively
A strategic mindset with a passion for solving complex data challenges and driving business outcomes through technology
The ability to think critically, challenge assumptions, and make clear, well-reasoned architectural decisions

Benefits

Medical, dental, and vision insurance
Wellness programs
Retirement plans
Generous paid leave

Company

The Friedkin Group

twittertwitter
company-logo
The Friedkin Group is a private consortium investing in automotive, hospitality, entertainment, sports, and adventure sectors.

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Scott Davidson
Vice President, Chief Legal Officer
linkedin
leader-logo
Adriana Estrada
Executive Assistant to CIO
linkedin
Company data provided by crunchbase