Resource Metrix ยท 1 day ago
CONTINGENT - Data Engineer UAPI
Resource Metrix is a consulting company that specializes in management and technology consulting services for federal agency clients. They are seeking a Data Engineer to design and operate ETL/ELT pipelines for the IRS UAPI, focusing on data ingestion, mapping, and ensuring data quality and governance.
Information TechnologyManagement ConsultingSoftware Engineering
Responsibilities
Build batch and streaming pipelines (Spark/PySpark, Airflow, dbt) to support API data flows
Implement data validation, reconciliation, and quality checks; publish validation logs
Manage lakehouse storage (Delta Lake on S3/Azure) and warehouse models (Snowflake/Redshift)
Operate Kafka/Flink for real-time events; design schema evolution and governance
Deliver lineage/audit artifacts; contribute to monthly spec/mapping approvals
Optimize cost/performance; automate CI/CD for data workflows
Qualification
Required
3+ years data engineering with Python/SQL and Spark/PySpark
Hands-on with Airflow, dbt, Databricks; Kafka/Flink streaming
Experience with Delta Lake, Snowflake/Redshift, and lakehouse patterns
Data governance, lineage, audit logging, and schema evolution
Preferred
IRS legacy data familiarity (MeF/CFOL/IDRS) and federal environments
Benefits
Bonus based on performance
Competitive salary
Paid time off