Apply on Employer Site

New York Life Insurance Company · 2 weeks ago

Senior Associate - Data Engineer

New York, NY

Full-time

Hybrid

Senior Level, Lead/Staff

$95K/yr - $162K/yr

8+ years exp

New York Life Insurance Company is seeking a Senior Data Engineer to design and execute their modern data management strategy. This role involves collaborating with various teams to build and maintain data engineering solutions on cloud platforms, ensuring the quality and performance of data pipelines.

FinanceFinancial ServicesInsurance

H1B Sponsor Likely

Responsibilities

Engages in collaborative relationships across architecture, product management, data and product delivery teams to design, implement solutions based on defined business challenges and outcomes

Participate on scrum teams working in short sprints and ensure on time delivery with high quality

Build and maintain Data engineering solutions on cloud platforms using AWS or Azure services

Design, develop, and implement scalable data transformations and ETL/ELT processes using Python, PySpark, and or Data Integration tools IDMC, DBT

Collaborate with Data Architects and Data analysts to understand data requirements and translate them into scalable, high performant data integration and pipeline solutions

Develop and maintain data models and schemas to support data integration and analysis

Monitor and troubleshoot data pipeline performance, identifying and resolving bottlenecks and issues

Optimize and tune data integration pipelines for performance, reliability, and scalability

Implement data quality and validation checks to ensure accuracy and integrity of data through testing

Build the infrastructure required for optimal ETL/ELT of data from a wide variety of data sources using SQL and AWS big data technologies

Develop and debug code in PySpark/Spark/Python. Strong SQL and query optimization techniques

Maintaining high degree of knowledge and expertise in cloud-based technologies contributing to go forward best practices, standards and patterns

Active participant in relevant communities of practice to exchange ideas and knowledge

Qualification

AWS Cloud technologiesData Engineering solutionsETL/ELT processesPythonPySparkData modelingSQLData integration toolsAgile methodologiesCollaborationProblem-solvingCommunication

Required

Eight or more years of experience in enterprise-level delivery of Data Engineering solutions

Deep understanding of modern data architecture, including experience with data lakes, data warehouses, data marts, relational and dimensional modeling, data quality, and master data management

Strong background in Operational Data Stores, Dimensional Modeling, and supporting application data architecture. Experience with Redshift, Snowflake, Databricks SQL, Oracle, Postgres, MySQL, and understanding of best practice architectural concepts for relational data models

8 + Years of design and implementation of ETL/ELT framework for complex warehouses/data marts

Proven experience in ETL/ELT tools IDMC, DBT, AWS Glue

Proficiency with languages such as Python, PySpark

Strong knowledge on AWS Cloud technologies

Strong, demonstratable hands-on experience with data engineering and data pipelines

Proficient in cloud architecture and best practices, particularly with AWS Cloud tools such as Amazon RDS, Redshift, AWS DMS, AWS Glue, Amazon S3, AWS Lambda, and more

Hands-on development mentality, with a willingness to troubleshoot and solve complex problems

Identify, recommend, and implement ELT processes and architecture improvements

Assist and verify design of solution and production of all design phase deliverables

Bachelor's or Master's degree in computer science or an Engineering discipline

Preferred

Certification in data management (structure and unstructured), and/or cloud architecture or engineering a plus

Certification in delivery methodologies such as Scaled Agile a plus

Benefits

Leave programs

Adoption assistance

Student loan repayment programs

Company

New York Life Insurance Company

For over 180 years, we’ve helped turn your biggest dreams into milestones that last a lifetime.

Founded in 1845

New York, New York, USA

10001+ employees

https://www.newyorklife.com/

H1B Sponsorship

New York Life Insurance Company has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (149)

2024 (99)

2023 (85)

2022 (77)

2021 (48)

2020 (65)