Apply on Employer Site

DCI Solutions · 3 weeks ago

Data Pipeline Reliability Engineer

Washington, DC

Full-time

Onsite

Senior Level

$160K/yr - $200K/yr

5+ years exp

DCI Solutions is seeking a Data Pipeline Reliability Engineer to support their customers' missions with accurate data. The role involves building and maintaining data pipelines, troubleshooting technical issues, and collaborating with teams to enhance data reliability.

ConsultingCyber SecuritySoftware Engineering

Comp. & Benefits

No H1B

Security Clearance Required

U.S. Citizen Only

Responsibilities

Serve as a Data Pipeline Reliability Engineer (DPRE) on a cross-functional team

Help to ensure our customers’ missions are supported with updated and accurate data

Build, optimize, and maintain data pipelines to improve their efficiency and resilience

Serve as a first responder

Triaging, troubleshooting, and coordinating the resolution of technical issues

Diagnose, resolve, and prevent issues encountered in the field

Implement/maintain automated monitoring to detect data quality issues

Embed with business teams to minimize risks associated with product deployments

Collaborate with customer-facing teams to increase reliability of data pipelines

Improve performance/stability of production data pipelines by:

Installing data health metrics and automated alerts

Document strategies for responding to incidents

Qualification

Data Pipeline toolsCloud toolsProgramming languagesData warehousingData governanceData LakesIaC toolsNetworking conceptsRoot cause analysisSoft skills

Required

Strong engineering background

Proficiency with programming languages such as Java, C++, Python, or JavaScript

Basic parallel data processing experience

Basics understanding of optimizing Spark jobs

Experience performing root cause analysis and documentation of findings

Understanding/experience with data concepts such as: Data warehousing, Data Lakes, Data governance, Data Lineage

Understanding of networking concepts (DNS, VPNs, Load Balancing)

Experience with the following tools: Observability tools (Ex. Grafana), Data Pipeline tools (Ex. Airflow), Cloud tools (Ex: AWS, Azure, Google Cloud), IaC tools (Ex. Terraform)

Active TS/SCI Security Clearance

Top Secret Security Clearance