UST · 14 hours ago
Senior Data Engineer
UST is a mission-driven company that transforms lives through technology by creating innovative and human-centered solutions. They are seeking a Senior Data Engineer to design, develop, and maintain scalable data pipelines and architectures using tools like Spark, Kafka, and cloud services to support analytics and machine learning.
ConsultingInformation ServicesInformation Technology
Responsibilities
Design, develop, and maintain ETL/ELT data pipelines for batch and real-time data ingestion, transformation, and loading using Spark (PySpark/Scala) and streaming technologies (Kafka, Flink)
Build and optimize scalable data architectures, including data lakes, data warehouses (BigQuery), and streaming platforms
Performance Tuning: Optimize Spark jobs, SQL queries, and data processing workflows for speed, efficiency, and cost-effectiveness
Data Quality: Implement data quality checks, monitoring, and ing systems to ensure data accuracy and consistency
Qualification
Required
Strong proficiency in Python, SQL, and potentially Scala/Java
Expertise in Apache Spark (Spark SQL, DataFrames, Streaming)
Experience with messaging queues like Apache Kafka, or Pub/Sub
Familiarity with GCP, Azure data services
Knowledge of data warehousing (Snowflake, Redshift) and NoSQL databases
Minimum 8 years of total IT experience
4+ years of recent GCP experience
Design, develop, and maintain ETL/ELT data pipelines for batch and real-time data ingestion, transformation, and loading using Spark (PySpark/Scala) and streaming technologies (Kafka, Flink)
Build and optimize scalable data architectures, including data lakes, data warehouses (BigQuery), and streaming platforms
Optimize Spark jobs, SQL queries, and data processing workflows for speed, efficiency, and cost-effectiveness
Implement data quality checks, monitoring, and ing systems to ensure data accuracy and consistency
Preferred
Experience with Airflow, Databricks, Docker, Kubernetes is a plus
Benefits
10 days of paid vacation per year
6 days of paid sick leave each year
10 paid holidays
Paid bereavement leave
Jury duty
401(k) Retirement Plan with employer matching
Medical, dental, and vision insurance
Basic life insurance
Accidental death and disability insurance
Short- and long-term disability benefits
Voluntary short-term disability benefits
Health Savings Account (HSA)
Flexible Spending Account (FSA)
Company
UST
UST is a Digital Transformations Solutions Provider.
H1B Sponsorship
UST has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (870)
2024 (800)
2023 (647)
2022 (634)
2021 (612)
2020 (984)
Funding
Current Stage
Late StageTotal Funding
$250MKey Investors
Temasek Holdings
2018-06-27Private Equity· $250M
Recent News
Orange County Business Journal
2026-01-24
2026-01-20
Company data provided by crunchbase