Apply on Employer Site

Gigster · 2 days ago

Senior Data Engineer, Operations(USA)

United States

Full-time

Remote

Senior Level

7+ years exp

Virtasant is a global technology services company specializing in cloud architecture and optimization. They are seeking a Senior Data Engineer - Operations to support their data platform by ensuring the health, reliability, and correctness of data ingestion pipelines and analytics workflows.

AnalyticsAppsSaaSSoftware

Diversity & Inclusion

No H1B

Responsibilities

Build and maintain automation, scripts, and lightweight tooling to support operational workflows, including pipeline triage, data validation, backfills, reprocessing, and quality checks

Own operational support for ingestion and transformation pipelines built on Airflow, Spark, dbt, Kafka, Snowflake (or similar). Triaging failed jobs, diagnosing data issues, performing backfills, and coordinating fixes across ingestion, transformation, and analytics layers

Monitor pipeline health, data freshness, and quality metrics across medallion layers. Investigate data anomalies, schema drift, and transformation failures, and drive incidents to resolution through root-cause analysis and corrective actions

Act as the primary interface between Data Platform, Analytics Engineering, and downstream consumers during operational issues. Communicate impact, coordinate fixes, and ensure timely resolution of data incidents

Qualification

Data EngineeringPythonSQLAirflowSnowflakeDebuggingCI/CDIncident ResponseCommunication

Required

7+ years of experience in data engineering, analytics engineering, or software development, with significant experience operating and supporting production data pipelines

Strong programming skills in Python & SQL on at least one major data platform (Snowflake, BigQuery, Redshift, or similar)

Experience supporting schema evolution, data contracts, and downstream consumers in production environments

Strong experience triaging, debugging, and maintaining dbt models, including understanding dependencies across medallion layers (bronze/silver/gold)

Experience with streaming, distributed compute, or S3-based table formats (Spark, Kafka, Iceberg/Delta/Hudi)

Experience with schema governance, metadata systems, and data quality frameworks

Hands-on experience operating and debugging orchestration workflows (Airflow, Dagster, Prefect), including retries, backfills, and dependency management

Solid grasp of CI/CD, Docker, and 2 years of experience in AWS