Selby Jennings · 2 days ago
Senior Workflow Orchestration Engineer
Chicago, IL
Full-time
Hybrid
Senior Level
$250K/yr - $350K/yr
5+ years expSelby Jennings is a top hedgefund seeking a Senior Airflow Engineer experienced in designing, optimizing, and maintaining scalable workflow orchestration systems. The role involves handling complex Airflow challenges, improving reliability, and enhancing data operations within a high-scale environment.
BankingEmploymentRecruiting
Hiring Manager
Quentin Shor Perrier
Responsibilities
Design, build, and maintain scalable data pipelines orchestrated through Apache Airflow
Investigate and resolve complex Airflow issues, including configuration challenges, DAG failures, and performance bottlenecks
Improve system observability through monitoring, alerting, and logging enhancements
Work cross‑functionally with data, platform, and software engineering teams to architect robust ETL and ELT frameworks
Optimize Airflow deployments, scheduling strategies, and resource utilization
Contribute to infrastructure improvements across Kubernetes, containerization, and distributed systems
Participate in automation, tooling improvements, and internal standards development
Qualification
Required
At least 5 years of experience in data engineering, platform engineering, or related areas
Strong hands‑on experience with Apache Airflow, including DAG development and debugging
Proficiency in Python for workflow development and automation
Experience with Kubernetes, Docker, and cloud environments (AWS, GCP, or Azure)
Understanding of CI/CD processes and DevOps principles
Strong analytical and problem‑solving skills, with the ability to own complex issues end to end
Preferred
Background in diagnosing advanced Airflow bugs or unique orchestration challenges
Experience supporting high‑availability or mission‑critical pipelines
Prior contributions to Airflow tooling or open‑source initiatives
Company
Selby Jennings
Global recruitment firm specialising in Banking
1001-5000 employees
Funding
Current Stage
Late StageRecent News
Business Insider
2025-09-30
2025-07-10
Seattle TechFlash
2025-05-03
Company data provided by crunchbase