Selby Jennings · 3 weeks ago
Lead Data Engineer/ Data Architect
Chicago, IL
Full-time
Onsite
Senior Level, Lead/Staff
5+ years expSelby Jennings is a top-tier trading firm seeking an experienced Data Engineer to strengthen its data stack for the Chicago research group. The role involves building and maintaining ETL/ELT pipelines, converting research prototypes into production workflows, and mentoring junior engineers while shaping the local data strategy.
BankingEmploymentRecruiting
Hiring Manager
Abbey Milligan
Responsibilities
Build and maintain reliable ETL/ELT pipelines using Spark, Structured Streaming, Databricks, and internal high‑performance tooling
Convert research prototypes into durable, high‑performance production workflows
Create reusable templates, patterns, and documentation for power users
Define and champion data engineering best practices
Mentor junior engineers and promote strong DataOps habits
Qualification
Required
5+ years of experience delivering scalable data pipelines
Expert in Python, Spark, and Databricks
Familiar with Delta Lake, streaming platforms like Kafka, and distributed compute
Comfortable with cloud-native data design (preferably AWS) and cost-aware architectures
Proficient with relational databases and modern orchestration tools
Strong communicator who leads projects independently and mentors others
Bachelor's or Master's in Computer Science, Engineering, or a related field
Preferred
Bonus: experience in C++ or Rust, and familiarity with MLOps or MLflow
Benefits
Direct influence on data systems that drive elite research and real-time trading
A central role in shaping U.S. Lakehouse engineering and contributing to global architecture
Ownership over complex workflows and cross-team templates
Close collaboration with quants and traders to unlock data-driven insights
Partnership with exceptional engineers across Chicago, Amsterdam, and Sydney
Company
Selby Jennings
Global recruitment firm specialising in Banking
1001-5000 employees
Funding
Current Stage
Late StageRecent News
Business Insider
2025-09-30
2025-07-10
Seattle TechFlash
2025-05-03
Company data provided by crunchbase