UST HealthProof · 11 hours ago
AWS Databricks Architect (AWS, Databricks, Apache Spark Specialist)
UST HealthProof is a mission-driven company that transforms lives through technology. They are seeking a highly skilled Databricks Architect with deep AWS expertise to architect and implement end-to-end Databricks solutions on AWS, manage lakehouse architectures, and provide technical leadership across multiple projects.
Hospital & Health Care
Responsibilities
Engage with business and technology stakeholders to define project scope, goals, and architectural direction
Architect and implement end-to-end Databricks solutions on AWS, leveraging services such as S3, Glue, Lambda, Kinesis, EMR, Redshift, IAM, and Step Functions
Design and manage lakehouse architectures optimized for scalability, performance, governance, and cost-efficiency
Oversee the design and development of scalable ETL/ELT pipelines using Databricks and Apache Spark
Lead solution design sessions, conduct code reviews, and ensure adherence to data engineering best practices
Create and deliver technical presentations, architecture documents, and case studies for internal and external stakeholders
Stay updated on Databricks platform enhancements, AWS data services, and emerging trends in data engineering, AI, and ML
Provide technical leadership and mentorship to engineering teams across multiple projects and client engagements
Qualification
Required
Bachelor s degree in Computer Science, Engineering, or a related field
10+ years of experience in data engineering, with significant hands-on expertise in Databricks and Apache Spark
Strong end-to-end experience with the AWS data ecosystem, including S3, Glue, Kinesis, Lambda, Redshift, DynamoDB, IAM, and Step Functions
Extensive experience building and managing ETL/ELT pipelines at scale
Proficiency in PySpark, SQL, and Python
Solid understanding of data warehousing, data lakes, and lakehouse architectures
Strong communication skills, with the ability to simplify and present complex technical topics
Proven ability to create detailed architecture documents and technical presentations
Willingness to travel based on project or client needs
Preferred
Databricks certifications (Associate Data Engineer, Professional Data Engineer, etc.)
AWS certifications are highly preferred (e.g., AWS Solutions Architect, AWS Data Analytics Specialty)
Exposure to Azure and GCP cloud platforms is good to have
Experience with CI/CD (e.g., AWS CodePipeline, GitHub Actions), infrastructure-as-code (Terraform or CloudFormation), and DevOps practices
Previous technical leadership or data architecture experience in consulting or multi-client environments
Benefits
10 days of paid vacation per year
6 days of paid sick leave each year
10 paid holidays
Paid bereavement leave
Jury duty
401(k) Retirement Plan with employer matching
Medical, dental, and vision insurance
Basic life insurance
Accidental death and disability insurance
Short- and long-term disability benefits
Voluntary short-term disability benefits
Health Savings Account (HSA)
Flexible Spending Account (FSA)
Company
UST HealthProof
UST HealthProof offers risk adjustment, quality programs, and healthcare payer technology services. It is a sub-organization of UST.
H1B Sponsorship
UST HealthProof has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (71)
2024 (43)
2023 (31)
2022 (3)
Funding
Current Stage
Late StageTotal Funding
unknown2025-09-04Acquired
Recent News
2025-12-06
Precedence Research
2025-11-21
2025-11-07
Company data provided by crunchbase