UST HealthProof · 1 day ago
Databricks Architect (Databricks, Apache Spark Specialist)
United States
Full-time
Remote
Senior Level, Lead/Staff
$161K/yr - $242K/yr
10+ years expUST HealthProof is a mission-driven company that transforms lives through technology. They are seeking a highly skilled Azure Databricks Architect to architect end-to-end data solutions using Azure Databricks and the broader Azure data platform, ensuring optimal storage, processing, governance, and performance.
Hospital & Health Care
Responsibilities
Engage with stakeholders to define scopes, goals, and deliverables aligned with business objectives
Architect end-to-end data solutions using Azure Databricks and the broader Azure data platform
Design and maintain data lakehouse architectures on Azure, ensuring optimal storage, processing, governance, and performance
Build and present high-quality technical presentations, solution architectures, and case studies
Lead design reviews, code reviews, and enforce best practices for data engineering on Azure
Stay current with Azure technology advancements, Databricks features, and trends in data engineering, AI, and machine learning
Oversee and support the development of scalable ETL/ELT pipelines using Azure Databricks, Apache Spark, and Azure-native tools across multiple clients and projects
Qualification
Required
Bachelor s degree in Computer Science, Engineering, or a related field
10+ years of experience in data engineering, with a strong focus on Azure Databricks and Apache Spark
Proven experience implementing solutions within the Azure ecosystem including ADLS Gen2, Azure Synapse, ADF/ADF Mapping Data Flows, Azure Key Vault, and Azure DevOps
Experience with ETL/ELT pipeline development at scale
Proficiency in PySpark, SQL, and Python
Good understanding of AI and ML fundamentals; exposure to Azure Machine Learning is a plus
Strong foundation in data warehousing, Lakehouse architecture, and modern data patterns on Azure
Excellent communication skills with the ability to articulate complex technical concepts
Experience preparing detailed architecture documents, decks, and stakeholder-facing presentations
Ability and willingness to travel as required for project engagements
Preferred
Azure Databricks or Databricks certifications (Associate or Professional)
Microsoft Azure certifications (e.g., DP-203, AZ-900, DP-900, AZ-305) are strongly preferred
Experience with Azure DevOps, CI/CD, Terraform or ARM/Bicep templates for deployment automation
Exposure to AWS or GCP cloud platforms is good to have
Prior technical leadership or architecture experience in multi-project data engineering environments
Benefits
10 days of paid vacation per year
6 days of paid sick leave each year (pro-rated for new hires throughout the year)
10 paid holidays
Paid bereavement leave
Jury duty
401(k) Retirement Plan with employer matching
Medical, dental, and vision insurance
Basic life insurance
Accidental death and disability insurance
Short- and long-term disability benefits
Additional voluntary short-term disability benefits
Health Savings Account (HSA)
Flexible Spending Account (FSA) for healthcare, dependent child care, and/or commuting expenses
Company
UST HealthProof
UST HealthProof offers risk adjustment, quality programs, and healthcare payer technology services. It is a sub-organization of UST.
501-1000 employees
H1B Sponsorship
UST HealthProof has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (71)
2024 (43)
2023 (31)
2022 (3)
Funding
Current Stage
Late StageTotal Funding
unknown2025-09-04Acquired
Leadership Team
Kevin Adams
Chief Executive Officer
Beth Maxwell
VP Product Delivery and Partnerships
Recent News
2025-12-06
Precedence Research
2025-11-21
2025-11-07
Company data provided by crunchbase