AI Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Ethos · 15 hours ago

AI Engineer

Ethos is a company focused on making life insurance accessible and efficient through technology and data science. They are seeking an AI Engineer to develop LLM-powered copilots that enhance various workflows, ensuring accuracy, speed, and compliance.

FinanceFinancial ServicesFinTechInsuranceInsurTechLife Insurance
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Production RAG: indexing, retrieval, hybrid search, reranking, query rewriting, grounding, citations
Context Graph: entity resolution + linking + provenance; graph + vector retrieval; supports multi-hop context
LLM orchestration: tool/function calling, structured outputs, routing across model tiers, failure modes
GPU/inference cost optimization: batching, caching/KV reuse, quantization, autoscaling; optimize $/session + latency
Safety + compliance: PII/PHI handling, redaction, audit logs, deterministic replay, hallucination mitigation
LLMOps: eval harness (golden sets, regression, adversarial), monitoring for quality/cost/drift
Design/ship the end-to-end pipeline: retrieve → assemble context → generate → cite → log/monitor
Improve quality and trust via evaluation, feedback loops, and clear evidence-backed outputs
Partner with product, security, and domain teams; write crisp design docs; raise engineering bar
Ship RAG v1 with citations + measurable quality metrics
Deliver Context Graph v1 that improves retrieval on real copilot tasks
Reduce cost/latency with a concrete inference optimization plan shipped to prod

Qualification

LLMs/RAG experienceProduction systemsGPU inference optimizationBackend/distributed systemsKnowledge graph systemsRegulated domain experienceCommunicationTeam collaboration

Required

5+ years building production systems; 2+ years hands-on LLMs/RAG
Proven RAG experience (embeddings, vector DBs, hybrid search, reranking, eval)
Strong backend/distributed systems + observability
Track record shipping in high-stakes environments with auditability/correctness
Knowledge graph / entity resolution / provenance systems
GPU inference optimization (vLLM/TGI/TensorRT-LLM, quantization AWQ/GPTQ, batching)
Regulated domain experience (insurance/fintech/healthcare)

Company

Ethos makes getting life insurance instant and easy.

H1B Sponsorship

Ethos has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9)
2024 (11)
2023 (8)
2022 (27)
2021 (17)
2020 (9)

Funding

Current Stage
Late Stage
Total Funding
$413.96M
Key Investors
SoftBank Vision FundGeneral CatalystGoogle Ventures
2022-01-24Series D· $7.46M
2021-07-21Series D· $100M
2021-05-11Series D· $200M

Leadership Team

leader-logo
Peter Colis
CEO and Co-founder
linkedin
leader-logo
Vipul Sharma
Chief Technology Officer
linkedin
Company data provided by crunchbase