SnapCode Inc · 2 days ago
Senior Data Engineer (Snowflake & Observability Implementation)
United States
Full-time
Remote
Senior Level
$25/hr - $30/hrSnapCode Inc is seeking a highly skilled Senior Data Engineer with strong experience in Data Observability. The role focuses on implementing end-to-end observability across various tools to ensure proactive detection and resolution of data quality issues across critical data assets.
Information Technology & Services
Responsibilities
Standardize and automate dbt metadata capture across all model runs
Build and maintain a hardened dbt-to-Snowflake logging pipeline to persist run_results.json and manifest.json into an Observability schema
Implement automated cleanup and retention policies to manage storage efficiently
Apply data observability rules at scale by pushing dbt checks into Snowflake DMFs
Implement and manage observability rules across key dimensions: Validity (data types, formats), Freshness (timeliness, latency), Volume (record count reconciliation), Schema & Values (structural and value changes), Distribution (anomaly detection, trend deviations)
Ensure data quality monitoring for high-priority and Tier-1 tables
Design and implement targeted Snowflake DMFs instead of blanket monitoring
Define dynamic thresholds (e.g., standard deviation-based) to reduce alert fatigue
Analyze and optimize DMF credit consumption, keeping monitoring costs within 5–10% of total compute
Build a single pane of glass for data observability using Splunk
Create high-performance alerts correlating dbt job failures with DMF violations
Ensure alerts include contextual payloads such as: Failing dbt model or code link, Table owner, Downstream BI impact
Integrate Splunk alerts with OpsGenie for actionable incident management
Configure: Priority-based alert routing (Warning vs Critical), Auto-resolution of alerts when issues self-heal, SLA tracking for MTTD (Mean Time to Detect) and MTTR (Mean Time to Resolve)
Build a Data Reliability Executive Dashboard (Splunk or Snowflake/Streamlit) to provide: Overall Data Health Score, Volume and Freshness trends, Top offending models/tables, Month-over-month MTTD and MTTR improvements
Create detailed Runbooks / SOPs for on-call engineers
Implement Monitoring-as-Code using version control (Terraform, dbt project files)
Maintain a weekly Observability Health Dashboard to identify noisy or unstable models
Qualification
Required
Strong hands-on experience with Snowflake, especially Data Metric Functions (DMFs)
Advanced experience with dbt (metadata, testing, orchestration)
Proven experience integrating observability tools like Splunk
Experience with incident management platforms (OpsGenie preferred)
Strong SQL and data modeling skills
Experience building scalable, production-grade data pipelines
Familiarity with cost optimization and performance tuning in Snowflake
Preferred
Experience with Streamlit dashboards
Infrastructure-as-Code (Terraform)
Background in data governance or data reliability engineering
Experience supporting on-call or production data platforms
Company
SnapCode Inc
Introduction Snapcode Inc., a US-based IT staffing firm, provides specialized technology professionals to businesses seeking their expertise.
11-50 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase