Lead Data Engineer (Hybrid) jobs in United States
cer-icon
Apply on Employer Site
company-logo

American Family Insurance ยท 8 hours ago

Lead Data Engineer (Hybrid)

American Family Insurance is looking for an experienced and driven Lead Data Engineer to guide their Data Platform team. In this role, you will oversee a team of engineers and create tools and infrastructure that empower various teams within the company.

Angel InvestmentFinanceVenture Capital
badNo H1Bnote

Responsibilities

Partner with stakeholders to refine undefined use cases into clear requirements, translate those into technical specs, and implement working solutions
Design and build platform capabilities that multiple teams consume, including feature stores, observability tooling, evaluation pipelines, and deployment patterns
Define and implement reusable patterns and infrastructure: shared LLM serving, evaluation frameworks, CI/CD templates, internal SDKs
Assess existing AI applications and establish standards for code quality, testing, deployment, and observability
Mentor data scientist and data engineers, conduct meaningful code reviews, and provide architectural guidance across the platform
Facilitate communication across project teams, architects, and business partners
Document critical workflows, standards, and operational support aspects of the platform

Qualification

AI/ML systemsSystem designPython programmingGCP expertiseKubernetesAPI designInfrastructure-as-codeCode reviewsMentoringDocumentation

Required

Demonstrated experience building AI/ML systems that run in production at scale - not notebooks or prototypes, but real software serving real users
Proven ability to take ambiguous, undefined problems and deliver shipped products
Strong system design skills with an emphasis on scalability, failure modes, and long-term maintainability
Deep software engineering fundamentals: experience with large codebases, design patterns, testability, and enterprise SDLC
Hands-on experience with LLMs in production: RAG, agents, evaluation, prompt engineering, or fine-tuning
Expert-level Python programming in a software engineering context, not just scripting or pipelines
Experience designing and building APIs for internal or external consumption
Deep experience with GCP, specifically Vertex AI, Pub/Sub, BigQuery, and NoSQL databases (e.g., Firestore, Bigtable)
Applied knowledge of Kubernetes for container orchestration and workload management
Experience with infrastructure-as-code tools (e.g., Terraform, Docker) and CI/CD pipelines

Benefits

Comprehensive medical, dental, vision and wellbeing benefits
Competitive 401(k) contribution
Pension plan
Annual incentive
9 paid holidays
Paid time off program (23 days accrued annually for full-time employees)
Student loan repayment program
Paid-family leave

Company

American Family Insurance

company-logo
For more than 90 years, American Family Insurance has built its reputation on sound principles.

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Dan Reed
Founder. President, and MD
Company data provided by crunchbase