Lead Software Engineer – Databricks / PySpark / AWS jobs in United States
cer-icon
Apply on Employer Site
company-logo

Chase · 4 months ago

Lead Software Engineer – Databricks / PySpark / AWS

Chase is seeking a Lead Software Engineer within their Corporate Technology team. In this role, you will enhance and deliver technology products while implementing critical solutions across various domains, focusing on data pipelines and cloud technologies.

BankingFinancial Services

Responsibilities

Design solutions at the appropriate level of detail and drive consensus among peers as needed
Champion software engineering best practices within the team
Collaborate with software engineers and cross-functional teams to design and implement deployment strategies using AWS Cloud and Databricks pipelines
Lead the design, development, testing, and implementation of application solutions
Partner with technical experts, stakeholders, and team members to resolve complex technical challenges
Proactively address issues to support leadership objectives and prevent customer impact
Design, develop, and maintain robust data pipelines for ingesting, processing, and storing large volumes of data from diverse sources
Implement ETL (Extract, Transform, Load) processes to ensure data quality and integrity using tools such as Apache Spark and PySpark
Monitor and optimize the performance of data systems and pipelines
Apply best practices for data storage, retrieval, and processing
Maintain comprehensive documentation for data systems, processes, and workflows

Qualification

AWS ServicesDatabricksPySparkPythonCI/CD toolsData pipelinesContainerizationOrchestration technologiesTroubleshooting Big Data

Required

Formal training or certification on software engineering concepts and 5+ years applied experience
Proficiency in programming languages such as Python and PySpark
Experience designing and implementing data pipelines in cloud environments
Strong background in design, architecture, and development using AWS Services, Databricks, Spark, Snowflake, and related technologies
Experience with CI/CD tools such as Jenkins, GitLab, or Terraform
Familiarity with containerization and orchestration technologies including ECS, Kubernetes, and Docker
Ability to troubleshoot issues related to Big Data and Cloud technologies

Preferred

5+ years of experience leading and developing data solutions in AWS Cloud
10+ years of experience building, implementing, and managing data pipelines using Databricks on Spark or similar cloud technologies

Company

Chase provides broad range of financial services. It is a sub-organization of JP Morgan Chase.

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Mike McDonnell
Managing Director, Head of Chase Travel Platform Product
linkedin
leader-logo
Nicole Sanchez
Managing Director, Consumer Bank, GM and Product Executive, Growth Financial Products
linkedin
Company data provided by crunchbase