TrueFoundry · 1 month ago
Staff Software Engineer
United States
Full-time
Remote
Lead/Staff
8+ years expTrueFoundry is a company focused on building foundational infrastructure for production AI systems. They are seeking a Staff Engineer – Core Engineering to lead complex engineering problems, collaborate with engineers and researchers, and shape the product vision and implementation.
Artificial Intelligence (AI)Cloud ComputingAgentic AIAI InfrastructureDevOpsMachine Learning
Hiring Manager
Parth Kathuria
Responsibilities
Solve some of the most complex Engineering problems and drive it alongside a team of engineers & ML researchers
Build a deep, holistic understanding of the TrueFoundry platform across all components and shape the product vision and implementation
Act as the technical face of engineering for customer-related discussions and escalations
Guide and unblock engineers across projects in the US region
Partner closely with our CTO and India-based engineering team to drive system design, architecture, and implementation of complex products
Lead technical design, critical customer problem-solving, and platform scalability initiatives end-to-end
Develop deep expertise across TrueFoundry’s platform stack — infrastructure, deployment systems, LLM/ML orchestration, observability, cost optimization, and more
Drive the system architecture and design for complex, distributed, cloud-native systems
Act as the technical point-of-contact for enterprise customer engineering needs and escalations
Lead and participate in design reviews, code reviews, and critical incident responses
Collaborate closely with the CTO on architectural decisions, scaling strategies, and technical roadmap prioritization
Guide and mentor US-based engineers across multiple initiatives, helping them deliver high-quality, scalable systems
Identify and drive technical debt cleanup, performance improvements, and resilience upgrades across the platform
Bring a product engineering mindset, ensuring that customer needs and feedback translate into scalable engineering solutions
Qualification
Required
8+ years of strong backend / systems engineering experience at top technology companies or startups
Deep expertise in distributed systems, cloud-native architectures, and scalable system design
Strong working knowledge of Kubernetes, containerized workloads, and infrastructure engineering
Practical experience building or deploying ML/GenAI applications (or closely working with ML/DS teams)
Skilled in programming languages such as Python, Go, or typescript
Solid understanding of system observability, resiliency design, and SRE practices
Strong technical leadership and communication skills — able to work with both customers and engineering teams
Ability to think strategically while also executing hands-on when required
Preferred
Experience supporting enterprise deployments of AI/ML infrastructure, model training, or inference systems
Benefits
Flexible hours
Learning credits
The opportunity to work shoulder-to-shoulder with the co-founders (Abhishek & Nikunj)
Company
TrueFoundry
TrueFoundry provides an enterprise-grade AI Gateway that encompasses an LLM Gateway, MCP Gateway, and Agent Gateway.
11-50 employees
H1B Sponsorship
TrueFoundry has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
80%
Represents job field similar to this job
Engineering and Development
Management and Executive
Trends of Total Sponsorships
*2025 (3)
2024 (1)
2021 (1)
Funding
Current Stage
Early StageTotal Funding
$21.3MKey Investors
Intel CapitalPeak XV Partners,Surge
2025-02-06Series A· $19M
2022-09-19Seed· $2.3M
Leadership Team
Nikunj Bajaj
Co-Founder & CEO
Abhishek Choudhary
Co-Founder
Recent News
Pulse 2.0
2026-06-28
2026-06-25
Company data provided by crunchbase