Randstad Digital Americas · 19 hours ago
Senior Analytics Engineer (Starburst & Airflow)
Randstad Digital Americas is seeking a Senior Analytics Engineer to design and implement SQL queries, develop data pipelines, and optimize performance for Starburst and Airflow environments. The role involves building and maintaining data workflows, ensuring data quality, and integrating cloud services while adhering to governance frameworks.
Information Technology & Services
Responsibilities
Design and implement Starburst SQL queries , catalogs, schemas, and connectors
Develop data pipelines and federated query solutions across diverse sources (S3, RDBMS etc.)
Tune and optimize Starburst clusters, catalogs, and worker configurations for performance
Design, develop, test, and deploy Airflow DAGs for complex data workflows
Implement best practices for Airflow, including task retries, SLAs, scheduling, and monitoring
Build custom Airflow operators, hooks, and plugins using Python
Build and maintain data ingestion and transformation pipelines using SQL, Python, and/or Airflow
Implement Starburst-integrated ETL/ELT workflows with distributed compute
Ensure pipelines are scalable, fault-tolerant, and performance-optimized
Implement data quality checks, validation, and lineage tracking
Work with cloud platforms to integrate Airflow with services such as Netapp S3
Deploy and manage Airflow environments like Kubernetes
Implement security policies, row/column-level security, and data masking
Ensure compliance with enterprise governance frameworks
Document data lineage, metadata, and catalog configurations
Develop and manage ThoughtSpot worksheets, Liveboards, Answers, and SpotIQ insights
Build intuitive, user-friendly search experiences enabling self-service analytics
Configure data models, relationships, and joins to ensure high-quality analytical results
Implement row-level and column-level security policies
Qualification
Required
3+ years of hand on Experience with Starburst Enterprise Platform
Familiarity with Kubernetes deployments
Knowledge of cost governance & workload isolation in distributed environments
3+ years of experience working with Apache Airflow (core, providers, DAG authoring)
Strong proficiency in Python
Solid understanding of data modeling concepts (star schema, relational modeling)
Experience integrating BI tools with ELT/ETL pipelines
Hands-on experience with cloud-based Airflow deployments
Experience with SQL and relational databases
Experience with Git and CI/CD frameworks
Preferred
Experience with BI tools (Tableau, Power BI, Oracle OAS/OAC) using Starburst as a source
Develop and manage ThoughtSpot worksheets, Liveboards, Answers, and SpotIQ insights
Build intuitive, user-friendly search experiences enabling self-service analytics
Configure data models, relationships, and joins to ensure high-quality analytical results
Implement row-level and column-level security policies
Benefits
Medical
Prescription
Dental
Vision
AD&D
Life insurance offerings
Short-term disability
401K plan
Company
Randstad Digital Americas
Randstad Digital is a trusted digital enablement partner that facilitates accelerated transformation for businesses by providing global talent, capacity, and solutions across specialized domains.