CoreWeave · 1 day ago
Senior Production Engineer, Tooling & Frameworks
Sunnyvale, CA
Full-time
Hybrid
Senior Level
$139K/yr - $204K/yr
5+ years expCoreWeave is The Essential Cloud for AI™, delivering a platform of technology and tools for innovators. As a Production Engineer on Herd, you will design and build systems that enable scalable AI operations and ensure the reliability and performance of CoreWeave's cloud infrastructure.
Artificial Intelligence (AI)Cloud ComputingCloud InfrastructureInformation TechnologyMachine Learning
No H1B
U.S. Citizen Only
Responsibilities
Architect and build large-scale distributed systems that power AI SRE Platforms
Design data infrastructure for AI reasoning (embedding generation, context retrieval, vector stores) optimized for real-time operational queries
Build agent orchestration and lifecycle components so agents can communicate, delegate, and reason collectively across CoreWeave systems
Integrate AI SRE Platform with a large number of internal systems (Kubernetes, observability platforms, etc.) to enable end-to-end automation and insights
Lead architectural design discussions and set technical direction for AI-driven reliability systems
Partner across Production Engineering, Data Engineering, ML Infrastructure, and Platform to operate AI SRE as a high-availability platform embedded in critical reliability workflows
Develop services that interpret telemetry, detect anomalies, and generate RCA (root cause analysis) and PIR (post-incident review) artifacts; trigger automated mitigations where appropriate
Codify operational best practices into services, APIs, and Kubernetes-native components
Participate in an on-call rotation supporting the systems you build
Qualification
Required
5+ years in software or infrastructure engineering building and operating distributed systems at scale
Proficiency in Python (or similar), with experience delivering production microservices and data pipelines
Expertise in Kubernetes, container orchestration, and cloud-native architectures
Strong understanding of data systems (streaming, indexing, caching, ETL)
Demonstrated experience designing for scalability, fault tolerance, and performance
Preferred
Experience building RAG systems or embedding-based search
Familiarity with vector databases and text/signal retrieval systems
Experience developing or deploying agentic AI systems (LLM-based automation, AI observability)
Strong distributed-systems background (consensus, message buses, job orchestration, eventual consistency)
Experience designing data schemas and APIs for knowledge representation and operational reasoning
Familiarity with ChatOps frameworks or workflow orchestration (Temporal, Argo, Airflow)
Background in MLOps, AI infrastructure, or platform reliability engineering
Experience with observability frameworks (Prometheus, Grafana, OpenTelemetry) and using telemetry for automated reasoning or remediation
Benefits
Medical, dental, and vision insurance - 100% paid for by CoreWeave
Company-paid Life Insurance
Voluntary supplemental life insurance
Short and long-term disability insurance
Flexible Spending Account
Health Savings Account
Tuition Reimbursement
Ability to Participate in Employee Stock Purchase Program (ESPP)
Mental Wellness Benefits through Spring Health
Family-Forming support provided by Carrot
Paid Parental Leave
Flexible, full-service childcare support with Kinside
401(k) with a generous employer match
Flexible PTO
Catered lunch each day in our office and data center locations
A casual work environment
A work culture focused on innovative disruption
Company
CoreWeave
CoreWeave is a cloud-based AI infrastructure company offering GPU cloud services to simplify AI and machine learning workloads.
1001-5000 employees
Funding
Current Stage
Public CompanyTotal Funding
$23.37BKey Investors
Jane Street CapitalStack CapitalCoatue
2025-12-08Post Ipo Debt· $2.54B
2025-11-12Post Ipo Debt· $1B
2025-08-20Post Ipo Secondary
Leadership Team
Michael Intrator
Chief Executive Officer
Nitin Agrawal
Chief Financial Officer
Recent News
2026-01-07
2026-01-06
Company data provided by crunchbase