Gigster · 2 weeks ago
Senior Data Engineer, Operations (USA)
Virtasant is a global technology services company specializing in cloud architecture and optimization. They are seeking a Senior Data Engineer - Operations to support their data platform, focusing on maintaining the health and reliability of production data pipelines and collaborating with other engineers to resolve data issues.
AnalyticsAppsSaaSSoftware
Responsibilities
Build and maintain automation, scripts, and lightweight tooling to support operational workflows, including pipeline triage, data validation, backfills, reprocessing, and quality checks
Own operational support for ingestion and transformation pipelines built on Airflow, Spark, dbt, Kafka, Snowflake (or similar)
Triaging failed jobs, diagnosing data issues, performing backfills, and coordinating fixes across ingestion, transformation, and analytics layers
Monitor pipeline health, data freshness, and quality metrics across medallion layers
Investigate data anomalies, schema drift, and transformation failures, and drive incidents to resolution through root-cause analysis and corrective actions
Act as the primary interface between Data Platform, Analytics Engineering, and downstream consumers during operational issues
Communicate impact, coordinate fixes, and ensure timely resolution of data incidents
Triaging failed pipelines across ingestion → transformation → analytics
Debugging Spark jobs & dbt models
Owning schema alerts and downstream impact
Performing backfills and reprocessing jobs
Building automation to reduce manual operational work
Acting as the calm technical interface during incidents
Escalating with clarity when deeper fixes are needed
Qualification
Required
7+ years of experience in data engineering, analytics engineering, or software development, with significant experience operating and supporting production data pipelines
Strong programming skills in Python & SQL on at least one major data platform (Snowflake, BigQuery, Redshift, or similar)
Experience supporting schema evolution, data contracts, and downstream consumers in production environments
Strong experience triaging, debugging, and maintaining dbt models, including understanding dependencies across medallion layers (bronze/silver/gold)
Experience with streaming, distributed compute, or S3-based table formats (Spark, Kafka, Iceberg/Delta/Hudi)
Experience with schema governance, metadata systems, and data quality frameworks
Hands-on experience operating and debugging orchestration workflows (Airflow, Dagster, Prefect), including retries, backfills, and dependency management
Solid grasp of CI/CD, Docker, and 2 years of experience in AWS
Clear communicator — can explain complex failures simply
Comfortable saying: 'Here's what's broken, here's the impact, here's what we're doing.'
Thrives in fast-paced, high-pressure environments
Strong ownership mindset — doesn't wait to be told
Pragmatic, not precious about code
Must live in the contiguous United States and have all the necessary documentation to work under an independent contractor agreement. We cannot offer sponsorships or sponsorship transfers, so unfortunately, we CANNOT consider candidates on H1B, OPT, EAD, or CPT visas
Preferred
Experience participating in on-call rotations, incident response, or data operations teams
Experience with data observability, data catalog, or metadata management tools
Experience working with healthcare data (X12, FHIR)
Understanding of authentication/authorization (OAuth2, JWT, SSO)
Benefits
Totally remote within the contiguous United States, full-time (40h/week)
Stable, long-term independent contract agreement
Work hours - US Eastern time office hours
Company
Gigster
Gigster is the first team intelligence engine, enabling software development teams to achieve 30% higher efficiency.
Funding
Current Stage
Growth StageTotal Funding
$32.62MKey Investors
RedpointAndreessen Horowitz
2024-03-26Acquired
2017-08-29Series B· $20M
2015-12-07Series A· $10M
Recent News
Research and Markets
2025-04-23
2025-02-09
2024-04-11
Company data provided by crunchbase