SIGN IN
Lead Software Engineer - Python / PySpark / AWS jobs in United States
cer-icon
Apply on Employer Site
company-logo

Chase · 16 hours ago

Lead Software Engineer - Python / PySpark / AWS

JPMorgan Chase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers and businesses. As a Lead Software Engineer, you will design and deliver technology products within the Commercial & Investment Bank, executing software solutions and maintaining high-quality production code to support the firm's business objectives.
FinanceBankingFinancial Services

Responsibilities

Executes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
Creates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systems
Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development
Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems
Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture
Contributes to software engineering communities of practice and events that explore new and emerging technologies
Adds to team culture of diversity, equity, inclusion, and respect

Qualification

PythonPySparkAWSETL/ELT pipelinesSQL optimizationApache IcebergData lakesPerlNoSQL databasesLeadershipMentoring

Required

Formal training or certification on software engineering concepts and 5+ years applied experience
Expert-level Python programming with strong software engineering fundamentals (OOP, design patterns, testing)
Advanced PySpark development including performance tuning, memory management, and optimization techniques
Deep hands-on experience building production ETL/ELT pipelines processing terabytes to petabytes of data
Proven expertise with AWS Glue (Spark and Python Shell jobs), Glue Data Catalog, crawlers, and workflows
Strong experience architecting and implementing data lakes on AWS S3 with multi-zone design (raw/curated/analytics)
Production experience with Apache Iceberg including schema evolution, partitioning strategies, compaction, and maintenance
Solid understanding of open table formats (Iceberg) and their trade-offs
Proficiency with AWS services: S3, IAM, Lake Formation, Athena, EMR, Kinesis, Lambda, Step Functions, CloudWatch
Experience with SQL optimization, query engines (Trino, Presto, Athena, Spark SQL), and data modeling
Demonstrated ability to lead and mentor engineering teams, conducting effective code reviews and technical guidance
Knowledge of Perl

Preferred

Knowledge of the financial products (e.g. Fixed Income Securities, Structured products, Derivatives etc.)
Understanding of NoSQL databases

Benefits

Comprehensive health care coverage
On-site health and wellness centers
A retirement savings plan
Backup childcare
Tuition reimbursement
Mental health support
Financial coaching

Company

Chase provides broad range of financial services. It is a sub-organization of JP Morgan Chase.

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Mike McDonnell
Managing Director, Head of Chase Travel Platform Product
linkedin
leader-logo
Nicole Sanchez
Managing Director, Consumer Bank, GM and Product Executive, Growth Financial Products
linkedin
Company data provided by crunchbase