Lead Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

hackajob · 9 hours ago

Lead Data Engineer

hackajob is collaborating with J.P. Morgan to connect them with exceptional tech professionals for this role. As a Lead Data Engineer at 55ip, you will build high-performance cloud-based data solutions to support quantitative research capabilities and oversee various data processes.

Artificial Intelligence (AI)Generative AIHuman ResourcesRecruitingSoftware

Responsibilities

Build high-performance cloud-based data solutions to support quantitative research capabilities: back testing, simulations, machine learning, and other advanced analytics & algorithms
Implement, schedule, and oversee ETL, ELT, and monitoring processes
Oversee the loading of data from vendor and internal data sources
Implement and support automation solutions to improve platform scalability
Monitor the system performance by performing regular tests, troubleshooting, and integrating new features
Provide L2 support for data systems to stakeholder teams
Collaborate with technical teams to design and implement data solutions
Recommend solutions to improve new and existing data systems

Qualification

SQLPythonAWS Cloud servicesETL processesDatabase technologiesAgile ScrumData LakesCI/CD toolsCommunication skillsAttention to detailTeam player

Required

Bachelor's degree in information systems, information technology, computer science, or similar
Expertise in Structured Query Language (SQL); experience with PostgreSQL specifically is a plus
Expertise in Python, Pandas/Polars, and Numpy
Clear understanding of OOP and software design constructs within a Python context
Expertise with AWS Cloud services/technologies, such as RDS, S3, Lambda, Secrets Manager
Expertise in all aspects of software development lifecycle, especially Agile Scrum
Strong Experience implementing and monitoring ETL processes
Strong Experience with database technologies, architecture, performance tuning, and scaling
Strong Experience in database design and modeling
Experience with Airflow or similar orchestration tools
Experience working with and CI/CD tools for application and database development
Excellent communication (written and oral) and presentation skills
Ability to work with quant researchers & developers to understand requirements
Strong attention to detail, pride in delivering high quality work and willingness to learn
Agility: Able to shift gears and react quickly to timely requests

Preferred

Experience working with Data Lakes (Iceberg/DeltaTable)
Experience working with DuckDB, Spark, and EMR
Experience supporting development of AI/ML models
Exposure to financial capital markets data and trading applications, working with investment data
AWS certifications are a plus
Experience with project workflow tools such as Jira in an Agile-Scrum environment
Knowledge of Linux

Benefits

Comprehensive health care coverage
On-site health and wellness centers
A retirement savings plan
Backup childcare
Tuition reimbursement
Mental health support
Financial coaching

Company

hackajob

twittertwittertwitter
company-logo
The AI-native tech hiring platform trusted by enterprises, scale-ups, and 1M+ tech professionals worldwide.

Funding

Current Stage
Growth Stage
Total Funding
$33M
Key Investors
Volition CapitalDowning VenturesTechstars
2023-05-03Series B· $25M
2018-10-25Series A· $6.7M
2017-03-31Seed· $0.58M

Leadership Team

leader-logo
Mark Chaffey
CEO
linkedin
leader-logo
Phil Kell
VP - Marketplace
linkedin
Company data provided by crunchbase