CVS Health · 16 hours ago
Principal Software Engineer - Applied AI
United States
Full-time
Remote
Senior Level, Lead/Staff
$144K/yr - $288K/yr
10+ years expCVS Health is a leading health solutions company dedicated to transforming healthcare. They are seeking a Principal Software Engineer to lead the design and delivery of enterprise-scale Generative AI solutions, guiding multiple teams in building secure and scalable AI platforms across AWS and Google Cloud.
Health CareMedicalPharmaceuticalRetailSales
Responsibilities
Lead end-to-end platform delivery of highly scalable, secure AI services and applications leveraging AWS Bedrock (Foundation Models, Knowledge Bases, Agents, Guardrails) and Google Cloud Vertex AI (Gemini via Vertex AI API, Agent Builder, Vector Search, Search & Grounding)
Architect and implement Retrieval-Augmented Generation (RAG) solutions, integrating proprietary data from sources like Amazon S3 and Google Cloud Storage/BigQuery, and using Bedrock Knowledge Bases and/or Vertex AI Search & Grounding with Vector Search to improve relevance and accuracy
Design solutions that use function/tool calling and multimodal input processing across both platforms (e.g., Bedrock Converse API and Vertex AI API), and integrate with enterprise systems via secure, well-governed service interfaces
Define reference architectures, golden paths, and guardrails for multi-cloud AI development; drive adoption through design reviews, Architecture Decision Records (ADRs), and clear SLOs for latency, resiliency, safety, and cost
Champion Responsible AI: implement safety filters, policy-enforced guardrails, data minimization, and red-teaming playbooks using capabilities such as Bedrock Guardrails and Vertex AI Safety
Partner with Security, Privacy, and Legal to ensure compliance with HIPAA/PHI, encryption, access control, and continuous auditability
Build evaluation and observability frameworks (groundedness, hallucination rates, relevance, toxicity, drift, cost attribution, A/B testing) and drive FinOps practices (prompt optimization, caching, batching, model selection) across clouds
Mentor Staff/Senior Engineers, elevate coding and design standards, and foster a culture of learning (design clinics, brown bags, communities of practice)
Monitor the rapidly evolving AI landscape (LLMs, agent frameworks, platform features) and translate advances into actionable platform strategy and roadmaps
Qualification
Required
10+ years of progressive, hands-on IT experience spanning systems analysis, application design, application development, and leading engineering teams
7+ years designing and developing modern microservices architectures and cost-effective APIs for enterprise-scale solutions
7+ years managing stakeholder requirements and translating them into robust, secure, and scalable technical solutions
5+ years building or leading large-scale, mission-critical applications with a focus on performance, resiliency, and security
5+ years of hands-on delivery for enterprise cloud initiatives on public cloud platforms (AWS and/or Google Cloud), including architecture, deployment, and optimization
5+ years implementing DevOps and CI/CD automation, including containerization and orchestration (Kubernetes, Docker)
3+ years of software development with a strong emphasis on Generative AI and Large Language Models (LLMs); familiarity with AI/ML frameworks and libraries (e.g., TensorFlow, PyTorch, Scikit-learn) and productionizing AI systems
Demonstrated ability to influence architecture decisions, lead cross-functional teams, and deliver complex solutions in compliance-conscious environments
Preferred
Hands-on experience with AWS Bedrock (Converse API, Agents, Knowledge Bases, Guardrails) and/or Google Cloud Vertex AI (Vertex AI API for Gemini, Agent Builder, Vector Search, Search & Grounding, Model Garden)
Expertise in RAG architectures, including embeddings, chunking, retrieval/reranking, vector databases, and caching strategies—implemented on Bedrock and/or Vertex AI
Proven track record implementing Responsible AI: safety guardrails, bias/fairness testing, red-teaming, human-in-the-loop workflows, and policy compliance
Strong background in observability and evaluation for AI systems: tracing/telemetry, token/inference cost attribution, A/B testing and offline/online evals (groundedness, hallucination), and drift monitoring
Experience with FinOps for AI workloads (prompt optimization, caching/batching, model selection, distillation/quantization strategies, streaming)
Familiarity with infrastructure as code and platform engineering (e.g., Terraform, CDK, GitOps) and event-driven architectures
Background in regulated industries (e.g., healthcare) and working knowledge of HIPAA/PHI, data governance, encryption, and access control
Multi-cloud awareness (e.g., Azure OpenAI) and vendor/model evaluation frameworks
Relevant certifications such as AWS Solutions Architect – Professional, AWS Machine Learning – Specialty, AWS Certified AI Practitioner, Google Cloud Professional Cloud Architect, or Google Cloud ML Engineer
Benefits
Affordable medical plan options
401(k) plan (including matching company contributions)
Employee stock purchase plan
No-cost programs for all colleagues including wellness screenings, tobacco cessation and weight management programs, confidential counseling and financial coaching
Benefit solutions that address the different needs and preferences of our colleagues including paid time off, flexible work schedules, family leave, dependent care resources, colleague assistance programs, tuition assistance, retiree medical access and many other benefits depending on eligibility.
Company
CVS Health
CVS Health is a health solutions company that provides an integrated healthcare services to its members.
10001+ employees
H1B Sponsorship
CVS Health has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2022 (1)
Funding
Current Stage
Public CompanyTotal Funding
$4BKey Investors
Michigan Economic Development CorporationStarboard Value
2025-08-15Post Ipo Debt· $4B
2025-07-17Grant· $1.5M
2019-11-25Post Ipo Equity
Leadership Team
David Joyner
President and Chief Executive Officer, CVS Health
Chandra McMahon
SVP & CISO
Recent News
Hartford Business Journal
2026-01-11
Digital Commerce 360
2026-01-07
2026-01-07
Company data provided by crunchbase