UST · 2 weeks ago
Senior Data Engineer (Azure Databricks)
Alpharetta, GA
Full-time
Onsite
Mid, Senior Level
$76K/yr - $112K/yr
5+ years expUST is a mission-driven company that transforms lives through technology. They are seeking a Senior Data Engineer (Azure Databricks) to lead the development of data pipelines and ensure high-quality standards in data processing.
ConsultingInformation ServicesInformation Technology
Responsibilities
Python packaging, code quality, testing (pytest, chispa), code reviews
Documentation and stakeholder communication
Software engineering practices CI/CD for Databricks (Repos, asset bundles/wheels), artifact versioning
Large-scale data processing
Governance, security, and compliance
Qualification
Required
5+ years building batch and/or streaming pipelines with Spark
Python packaging, code quality, testing (pytest, chispa), code reviews
Documentation and stakeholder communication
Software engineering practices CI/CD for Databricks (Repos, asset bundles/wheels), artifact versioning
Large-scale data processing
Governance, security, and compliance
Preferred
Lakehouse design trade-offs and table constraints cluster sizing, autoscaling, and cost optimization (spot, pools)
Observability: Spark UI, metrics, event logs, Delta logs
Handling TB-scale datasets, throughput vs. latency trade-offs
Privilege model in Unity Catalog; table, row, and column-level security patterns
PII handling, masking/anonymization, auditability, lineage
Scala, dbt, Kafka/Event Hubs, ADF/Airflow, Terraform, Power BI, data mesh concepts, SCD Pattern
Benefits
Full-time, regular employees accrue a minimum of 10 days of paid vacation per year
Receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year)
10 paid holidays
Eligible for paid bereavement leave and jury duty
Eligible to participate in the Company’s 401(k) Retirement Plan with employer matching
Eligible for medical, dental, and vision insurance
Company-paid Employee Only benefits: basic life insurance, accidental death and disability insurance, and short- and long-term disability benefits
May purchase additional voluntary short-term disability benefits
Participate in a Health Savings Account (HSA)
Flexible Spending Account (FSA) for healthcare, dependent child care, and/or commuting expenses as allowable under IRS guidelines
Company
UST
UST is a Digital Transformations Solutions Provider.
10001+ employees
H1B Sponsorship
UST has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (870)
2024 (800)
2023 (647)
2022 (634)
2021 (612)
2020 (984)
Funding
Current Stage
Late StageTotal Funding
$250MKey Investors
Temasek Holdings
2018-06-27Private Equity· $250M
Leadership Team
Krishna Sudheendra
CEO
Alexander Varghese
Chief Administrative Officer & COO
Recent News
2026-01-05
Techcircle
2025-12-31
Hindu Business Line
2025-12-18
Company data provided by crunchbase