UST HealthProof · 1 month ago
Senior/Lead Data Engineer
Alpharetta
Full-time
Onsite
Senior Level, Lead/Staff
$82K/yr - $123K/yr
8+ years expUST HealthProof is a company that transforms lives through technology, seeking a Senior/Lead Data Engineer to design and deliver scalable data solutions on the Azure ecosystem. The role involves architecting data platforms, optimizing data workflows, and mentoring junior engineers while ensuring high-quality data pipelines.
Hospital & Health Care
Responsibilities
Architect, design, and implement scalable data platforms and pipelines on Azure and Databricks
Build and optimize data ingestion, transformation, and processing workflows across batch and real-time data streams
Work extensively with ADLS, Delta Lake, and Spark (Python) for large-scale data engineering
Lead the development of complex ETL/ELT pipelines, ensuring high quality, reliability, and performance
Design and implement data models, including conceptual, logical, and physical models for analytics and operational workloads
Work with relational and lakehouse systems including PostgreSQL and Delta Lake
Define and enforce best practices in data governance, data quality, security, and architecture
Collaborate with architects, data scientists, analysts, and business teams to translate requirements into technical solutions
Troubleshoot production issues, optimize performance, and support continuous improvement of the data platform
Mentor junior engineers and contribute to building engineering standards and reusable components
Qualification
Required
8+ years of hands-on data engineering experience in enterprise environments
Strong expertise in Azure services, especially Azure Databricks, Functions, and Azure Data Factory
Advanced proficiency in Apache Spark with Python (PySpark)
Strong command over SQL, query optimization, and performance tuning
Deep understanding of ETL/ELT methodologies, data pipelines, and scheduling/orchestration
Hands-on experience with Delta Lake (ACID transactions, optimization, schema evolution)
Strong experience in data modelling (normalized, dimensional, lakehouse modelling)
Experience in both batch processing and real-time/streaming data (Kafka, Event Hub, or similar)
Solid understanding of data architecture principles, distributed systems, and cloud-native design patterns
Ability to design end-to-end solutions, evaluate trade-offs, and recommend best-fit architectures
Strong analytical, problem-solving, and communication skills
Ability to collaborate with cross-functional teams and lead technical discussions
Preferred
Experience with CI/CD tools such as Azure DevOps and Git
Familiarity with IaC tools (Terraform, ARM)
Exposure to data governance and cataloging tools (Azure Purview)
Experience supporting machine learning or BI workloads on Databricks
Benefits
Full-time, regular employees accrue a minimum of 10 days of paid vacation per year
Receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year)
10 paid holidays
Eligible for paid bereavement leave and jury duty
Eligible to participate in the Company’s 401(k) Retirement Plan with employer matching
Eligible for medical, dental, and vision insurance
Basic life insurance
Accidental death and disability insurance
Short- and long-term disability benefits
Purchase additional voluntary short-term disability benefits
Participate in a Health Savings Account (HSA)
Flexible Spending Account (FSA) for healthcare, dependent child care, and/or commuting expenses as allowable under IRS guidelines
Company
UST HealthProof
UST HealthProof offers risk adjustment, quality programs, and healthcare payer technology services. It is a sub-organization of UST.
501-1000 employees
H1B Sponsorship
UST HealthProof has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (71)
2024 (43)
2023 (31)
2022 (3)
Funding
Current Stage
Late StageTotal Funding
unknown2025-09-04Acquired
Leadership Team
Kevin Adams
Chief Executive Officer
Beth Maxwell
VP Product Delivery and Partnerships
Recent News
2025-12-06
Precedence Research
2025-11-21
2025-11-07
Company data provided by crunchbase