Guardian Life · 5 hours ago
Lead Data Engineer
New York
Full-time
Hybrid
Senior Level, Lead/Staff
$99K/yr - $163K/yr
8+ years expGuardian Life is seeking a highly skilled and motivated Lead Data Engineer to join their FPRS&CSWM Data Engineering team. In this role, you will design, build, and maintain data pipelines that power operational reporting and machine learning use cases, while mentoring junior engineers and collaborating with cross-functional teams.
DentalFinancial ServicesHardwareInsuranceLife Insurance
No H1B
Responsibilities
Lead technical design and implementation of data engineering solutions, ensuring best practices and high-quality deliverables
Mentor and guide junior engineers, conducting code reviews and technical sessions to foster team growth
Perform detailed analysis of raw data sources by applying business context and collaborate with cross-functional teams to transform raw data into data products
Create scalable and trusted data pipelines which generate curated data assets in centralized data lake/data warehouse ecosystems
Monitor and troubleshoot data pipeline performance, identifying and resolving bottlenecks and issues
Construct meaningful data assets sourced from structured, semi structured, and unstructured data
Develop real-time data solutions by creating new API endpoints or streaming frameworks
Develop, test, and maintain robust tools, frameworks, and libraries that standardize and streamline the data lifecycle
Collaborate with cross-functional teams of Data Science, Data Engineering, business units, and other IT teams
Create and maintain effective documentation for projects and practices, ensuring transparency and effective team communication
Provide technical leadership and mentorship on continuous improvement in building reusable and scalable solutions
Contribute to enhancing strategy for advanced data engineering practices and lead execution of key initiatives
Stay up-to-date with the latest trends in modern data engineering, machine learning & AI
Qualification
Required
Bachelor's or Master's degree with 8+ years of experience in Computer Science, Engineering, or a related field
5+ years of experience working with Python, SQL, PySpark, and bash scripts. Proficient in software development lifecycle and software engineering practices
4+ years of experience developing and maintaining robust data pipelines for both structured and unstructured data for advanced analytical and reporting use cases
3+ years of experience working with Cloud Data Warehousing (Redshift, Snowflake, Databricks SQL or equivalent) platforms and distributed frameworks like Spark
2+ years of experience leading a team of engineers and a track record of delivering robust and scalable data solutions with highest quality
Solid understanding of data modeling and warehousing techniques. Experience working in a data warehouse is a plus
Proficiency in understanding REST APIs, experience using different types of APIs to extract data or perform functionalities
Hands-on experience building and maintaining tools and libraries used by multiple teams across the organization (e.g., Data Engineering utility libraries, DQ Libraries)
Proficient in understanding and incorporating software engineering principles in design & development process
Hands-on experience with CI/CD tools (e.g., Jenkins or equivalent), version control (Github, Bitbucket), orchestration (Airflow, Prefect or equivalent)
Excellent communication skills and ability to work and collaborate with cross-functional teams across technology and business
Benefits
Skill-building
Leadership development
Philanthropic opportunities
Supportive, flexible, and inclusive benefits and resources
Company
Guardian Life
Guardian Life Insurance Company of America (Guardian) is one of the country’s leading mutual insurers.
5001-10000 employees
Funding
Current Stage
Late StageTotal Funding
unknown2016-08-23Non Equity Assistance
Leadership Team
Andrew McMahon
Chairman and CEO
Karunakaran Azhisur
Country Head & CIO, Guardian India
Recent News
2025-12-11
Company data provided by crunchbase