Beacon Hill · 1 day ago
Databricks Engineer
United States
Contract
Remote
Senior Level
5+ years expBeacon Hill is seeking experienced Databricks Engineers to join a high-impact, growing team focused on improving patient outcomes. The role involves building and optimizing Databricks data pipelines and workflows, conducting code reviews, and collaborating with a small team to adopt best practices.
Staffing Agency
Hiring Manager
Charles Peiffer
Responsibilities
Build, optimize, and maintain scalable Databricks data pipelines and workflows
Perform hands-on engineering (80–100% coding / development focus) – migrating legacy SQL/stored procedure logic to Databricks native code
Conduct code reviews, pair programming, and provide real-time coaching to help the existing team adopt best practices in Databricks & Python
Collaborate with a small, tight-knit team (current manager + 3 senior engineers) to replatform out-of-the-box quality features into Databricks
Document processes, pipelines, and architectural decisions
Participate in lift-and-shift migration efforts while transitioning to modern Databricks-native implementations
Work closely with a newly formed platform team to ensure successful adoption
Qualification
Required
Strong hands-on experience with Databricks (Delta Lake, notebooks, workflows, Unity Catalog preferred)
Proven track record writing and optimizing Python code in a Databricks environment
Solid background in SQL and stored procedures (legacy systems migration experience is highly valued)
Comfortable performing code reviews, pair programming, and mentoring junior/mid-level engineers on Databricks best practices
Experience with Git/GitHub or Bitbucket for version control
5+ years of relevant data engineering experience (open to strong candidates with less if Databricks depth is exceptional)
Preferred
Databricks certification (Databricks Certified Data Engineer Associate or Professional)
Prior healthcare, payer, or CMS-related experience (Stars quality, HEDIS, Medicare Advantage, etc.)
Exposure to modern data platform migrations (lift-and-shift → native refactoring)
Company
Beacon Hill
Beacon Hill was founded to set a new standard in search, career placement and flexible staffing.
1001-5000 employees
H1B Sponsorship
Beacon Hill has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (38)
2024 (94)
2023 (76)
2022 (60)
2021 (77)
2020 (86)
Funding
Current Stage
Late StageLeadership Team
Amber Leslie
Executive Assistant to CEO
Amy Van Sicklin
Chief Culture Officer
Recent News
Company data provided by crunchbase