Data Engineer II (AWS, Databricks, PySpark) jobs in United States
cer-icon
Apply on Employer Site
company-logo

Travelers · 8 hours ago

Data Engineer II (AWS, Databricks, PySpark)

Travelers is a leading property casualty insurer with a commitment to innovation and collaboration. They are seeking a Data Engineer II to design, build, and maintain data pipelines, supporting the analytics landscape and enabling AI and ML initiatives within the company.

Auto InsuranceInsuranceProperty Insurance
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Design, develop, and maintain scalable batch and streaming data pipelines using Databricks and cloud-native services
Build and optimize ETL/ELT workflows using Python, SQL, and Spark
Work with structured and semi-structured data stored in cloud object storage (e.g., Amazon S3)
Collaborate with analytics, BI, and application teams to deliver high-quality, trusted datasets
Apply FinOps best practices by monitoring resource usage, optimizing job performance, and identifying cost-saving opportunities
Support AI/ML use cases by preparing and curating high-quality datasets for model training and inference
Assist with feature engineering pipelines and data validation for ML workflows
Implement data quality checks, monitoring, and performance tuning
Follow best practices for data security, governance, and access controls
Support production workloads, troubleshoot issues, and participate in operational support as needed
Contribute to documentation, standards, and reusable data engineering patterns

Qualification

DatabricksAWSPythonSQLApache SparkETL/ELTData modelingCloud data platformsCommunication skillsProblem solvingTeam collaboration

Required

Bachelor's Degree in STEM related field or equivalent
Eight years of related experience
Hands-on experience with Databricks and Apache Spark
Strong experience with AWS (e.g., S3, IAM, EC2, Lambda, Glue, or related services)
Proficiency in Python and SQL
Experience working with cloud data platforms and distributed data processing systems
Solid understanding of data modeling, ETL/ELT concepts, and performance optimization
Strong communication skills and ability to work in a collaborative team environment
Highly proficient use of tools, techniques, and manipulation including Cloud platforms, programming languages, and a full understanding of modern software engineering practices
The ability to deliver work at a steady, predictable pace to achieve commitments, deliver complete solutions but release them in small batches, and identify and negotiate important tradeoffs
Demonstrated track record of domain expertise including understanding technical concepts necessary and industry trends, and possess in-depth knowledge of immediate systems worked on and some knowledge of adjacent systems
Strong problem solver who ensures systems are built with longevity and creates innovate ways to resolve issues
Strong written and verbal communication skills with the ability to work collaborate well with team members and business partners
Ability to lead team members and help create a safe environment for others to learn and grow as engineers. and a proven track record of self-motivation in identifying opportunities and tracking team efforts
Bachelor's degree in computer science, related STEM field, or its equivalent in education and/or work experience
4 additional years of data engineering experience

Benefits

Health Insurance: Employees and their eligible family members – including spouses, domestic partners, and children – are eligible for coverage from the first day of employment.
Retirement: Travelers matches your 401(k) contributions dollar-for-dollar up to your first 5% of eligible pay, subject to an annual maximum. If you have student loan debt, you can enroll in the Paying it Forward Savings Program. When you make a payment toward your student loan, Travelers will make an annual contribution into your 401(k) account. You are also eligible for a Pension Plan that is 100% funded by Travelers.
Paid Time Off: Start your career at Travelers with a minimum of 20 days Paid Time Off annually, plus nine paid company Holidays.
Wellness Program: The Travelers wellness program is comprised of tools, discounts and resources that empower you to achieve your wellness goals and caregiving needs. In addition, our mental health program provides access to free professional counseling services, health coaching and other resources to support your daily life needs.
Volunteer Encouragement: We have a deep commitment to the communities we serve and encourage our employees to get involved. Travelers has a Matching Gift and Volunteer Rewards program that enables you to give back to the charity of your choice.

Company

Travelers

company-logo
Travelers provides insurance coverage to protect the things that are important to you – your home, your car, your valuables and your business.

H1B Sponsorship

Travelers has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (75)
2024 (47)
2023 (60)
2022 (42)
2021 (27)
2020 (20)

Funding

Current Stage
Public Company
Total Funding
unknown
2002-03-22IPO

Leadership Team

leader-logo
Dan Frey
Executive Vice President and Chief Financial Officer
linkedin
leader-logo
Beth Maerz
SVP, Customer, Strategy and Innovation
linkedin
Company data provided by crunchbase