TrueFoundry · 7 months ago
Staff Engineer – Core Engineering
San Francisco, CA (Hybrid)
Full-time
Hybrid
Senior Level, Lead/Staff
8+ years expTrueFoundry is an enterprise platform that helps enterprise teams build, deploy, and manage large language model applications at scale. We are seeking a Staff Engineer to join our Core Engineering team, focusing on scaling deep learning workloads and optimizing multi-GPU training while driving system design and architecture for complex products.
Artificial Intelligence (AI)DevOpsMachine Learning
Responsibilities
Solve some of the most complex Engineering problems and drive it alongside a team of engineers & ML researchers
Build a deep, holistic understanding of the TrueFoundry platform across all components and shape the product vision and implementation
Act as the technical face of engineering for customer-related discussions and escalations
Guide and unblock engineers across projects in the US region
Partner closely with our CTO and India-based engineering team to drive system design, architecture, and implementation of complex products
Lead technical design, critical customer problem-solving, and platform scalability initiatives end-to-end
Develop deep expertise across TrueFoundry’s platform stack — infrastructure, deployment systems, LLM/ML orchestration, observability, cost optimization, and more
Drive the system architecture and design for complex, distributed, cloud-native systems
Act as the technical point-of-contact for enterprise customer engineering needs and escalations
Lead and participate in design reviews, code reviews, and critical incident responses
Collaborate closely with the CTO on architectural decisions, scaling strategies, and technical roadmap prioritization
Guide and mentor US-based engineers across multiple initiatives, helping them deliver high-quality, scalable systems
Identify and drive technical debt cleanup, performance improvements, and resilience upgrades across the platform
Bring a product engineering mindset, ensuring that customer needs and feedback translate into scalable engineering solutions
Qualification
Required
8+ years of strong backend / systems engineering experience at top technology companies or startups
Deep expertise in distributed systems, cloud-native architectures, and scalable system design
Strong working knowledge of Kubernetes, containerized workloads, and infrastructure engineering
Practical experience building or deploying ML/GenAI applications (or closely working with ML/DS teams)
Skilled in programming languages such as Python, Go, or typescript
Solid understanding of system observability, resiliency design, and SRE practices
Strong technical leadership and communication skills — able to work with both customers and engineering teams
Ability to think strategically while also executing hands-on when required
Preferred
Experience supporting enterprise deployments of AI/ML infrastructure, model training, or inference systems
Benefits
Flexible hours
Learning credits
Company
TrueFoundry
TrueFoundry is a unified platform with an enterprise-grade AI Gateway - combining LLM, MCP, and Agent Gateway.
11-50 employees
H1B Sponsorship
TrueFoundry has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (3)
2024 (1)
2021 (1)
Funding
Current Stage
Early StageTotal Funding
$21.3MKey Investors
Intel Capital
2025-02-06Series A· $19M
2022-09-19Seed· $2.3M
Leadership Team
Nikunj Bajaj
Co-Founder & CEO
Abhishek Choudhary
Co-Founder
Recent News
2025-12-10
Metrovacesa lanza el agente virtual conversacional MiA basado en IA generativa | CIO
2025-09-25
Company data provided by crunchbase