Apply on Employer Site

Chase · 22 hours ago

Software Engineer III- ETL/ELT Pipelines / Python / Pyspark/ AWS

575 Washington Blvd, Jersey City, NJ, 07310, US

Full-time

Onsite

Mid Level

$133K/yr - $185K/yr

3+ years exp

JPMorgan Chase, one of the oldest financial institutions, offers innovative financial solutions. They are seeking a Software Engineer III to design and implement ETL/ELT pipelines using Python and AWS, ensuring scalable and efficient data solutions that align with business objectives.

BankingFinancial Services

Responsibilities

Design and implement scalable data solutions that align with business objectives and technology strategies and technical troubleshooting with ability to think beyond routine or conventional approaches to build and support solutions or break down technical problems

Design, develop, and optimize robust ETL/ELT pipelines using SQL, Python, and PySpark for large-scale, complex data environments

Develop and support secure high-quality production code, and review and debug code written by others

Support data migration and modernization initiatives, transitioning legacy systems to cloud-based data warehouses

Identify opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems

Collaborate with cross-functional teams to understand data requirements and translate them into technical specifications

Monitor and tune ETL processes for efficiency, resilience and scalability, including alerting for data quality issues

Work closely with stakeholders to identify opportunities for data-driven improvements and efficiencies

Document data flows, logic, and transformation rules to maintain transparency and facilitate knowledge sharing across teams

Stay current on emerging ETL and data engineering technologies with industry trends to drive innovation

Qualification

PythonETL/ELT pipelinesAWSPySparkSQLData validationProblem-solvingCommunicationCollaboration

Required

Formal training or certification in software engineering with 3+ years of applied experience

Proficient in coding in one or more languages including Python

Strong hands-on coding proficiency in Python, PySpark, Apache Spark, SQL, and with AWS cloud services such as AWS EMR, S3, Athena, Redshift

Hands-on experience with AWS cloud and data lake platforms, Snowflake, Databricks etc

Proven experience in ETL/ELT pipeline development and with large-scale data processing with SQL

Practical experience implementing data validation, cleansing, transformation, and reconciliation processes to ensure high-quality, trustworthy datasets

Experience with cloud-based data warehouse migration and modernization

Proficiency in automation and continuous delivery methods and understanding of agile methodologies such as CI/CD, Application Resiliency, and Security

Excellent problem-solving and troubleshooting skills, with ability to optimize performance and troubleshoot complex data pipelines

Strong communication and documentation abilities

Ability to collaborate effectively with business and technical stakeholders