AWS Databricks Architect (AWS, Databricks, Apache Spark Specialist) jobs in United States
cer-icon
Apply on Employer Site
company-logo

UST HealthProof · 11 hours ago

AWS Databricks Architect (AWS, Databricks, Apache Spark Specialist)

UST HealthProof is a mission-driven company that transforms lives through technology. They are seeking a highly skilled Databricks Architect with deep AWS expertise to architect and implement end-to-end Databricks solutions on AWS, manage lakehouse architectures, and provide technical leadership across multiple projects.

Hospital & Health Care
check
H1B Sponsor Likelynote

Responsibilities

Engage with business and technology stakeholders to define project scope, goals, and architectural direction
Architect and implement end-to-end Databricks solutions on AWS, leveraging services such as S3, Glue, Lambda, Kinesis, EMR, Redshift, IAM, and Step Functions
Design and manage lakehouse architectures optimized for scalability, performance, governance, and cost-efficiency
Oversee the design and development of scalable ETL/ELT pipelines using Databricks and Apache Spark
Lead solution design sessions, conduct code reviews, and ensure adherence to data engineering best practices
Create and deliver technical presentations, architecture documents, and case studies for internal and external stakeholders
Stay updated on Databricks platform enhancements, AWS data services, and emerging trends in data engineering, AI, and ML
Provide technical leadership and mentorship to engineering teams across multiple projects and client engagements

Qualification

AWSDatabricksApache SparkRedshiftPySparkSQLData architectureCommunication skillsTechnical leadership

Required

Bachelor s degree in Computer Science, Engineering, or a related field
10+ years of experience in data engineering, with significant hands-on expertise in Databricks and Apache Spark
Strong end-to-end experience with the AWS data ecosystem, including S3, Glue, Kinesis, Lambda, Redshift, DynamoDB, IAM, and Step Functions
Extensive experience building and managing ETL/ELT pipelines at scale
Proficiency in PySpark, SQL, and Python
Solid understanding of data warehousing, data lakes, and lakehouse architectures
Strong communication skills, with the ability to simplify and present complex technical topics
Proven ability to create detailed architecture documents and technical presentations
Willingness to travel based on project or client needs

Preferred

Databricks certifications (Associate Data Engineer, Professional Data Engineer, etc.)
AWS certifications are highly preferred (e.g., AWS Solutions Architect, AWS Data Analytics Specialty)
Exposure to Azure and GCP cloud platforms is good to have
Experience with CI/CD (e.g., AWS CodePipeline, GitHub Actions), infrastructure-as-code (Terraform or CloudFormation), and DevOps practices
Previous technical leadership or data architecture experience in consulting or multi-client environments

Benefits

10 days of paid vacation per year
6 days of paid sick leave each year
10 paid holidays
Paid bereavement leave
Jury duty
401(k) Retirement Plan with employer matching
Medical, dental, and vision insurance
Basic life insurance
Accidental death and disability insurance
Short- and long-term disability benefits
Voluntary short-term disability benefits
Health Savings Account (HSA)
Flexible Spending Account (FSA)

Company

UST HealthProof

twittertwitter
company-logo
UST HealthProof offers risk adjustment, quality programs, and healthcare payer technology services. It is a sub-organization of UST.

H1B Sponsorship

UST HealthProof has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (71)
2024 (43)
2023 (31)
2022 (3)

Funding

Current Stage
Late Stage
Total Funding
unknown
2025-09-04Acquired

Leadership Team

leader-logo
Kevin Adams
Chief Executive Officer
linkedin
leader-logo
Beth Maxwell
VP Product Delivery and Partnerships
linkedin
Company data provided by crunchbase