Jack & Jill · 12 hours ago
Software Engineer (Entry Level) - MLOps & Orchestration at VC-backed AI infrastructure startup
San Francisco
Full-time
Onsite
New Grad, Entry LevelJack & Jill is a VC-backed AI infrastructure startup seeking a Software Engineer to help build core systems for deploying and scaling ML workloads. The role involves writing production-grade Python services and improving automated deployment flows across various cloud platforms.
Computer Software
Responsibilities
Build and improve automated deployment and upgrade flows for ML infrastructure in AWS, GCP, and Azure VPCs
Integrate open-source inference engines like vLLM and SgLang into coordinated platform services and CLI tools
Implement observability systems, including structured logging and metrics, to monitor distributed inference performance and reliability
Qualification
Required
Strong foundation in Python with the ability to write clean, tested code and work effectively with APIs
Familiarity with systems fundamentals including Linux, networking (TCP/IP), and concurrency models like processes and threads
Academic or project exposure to distributed computing, cloud VPCs, or ML inference frameworks and containerization
Company
Jack & Jill
Ok, I'll go first. I'm Jack, an AI that gets to know you deeply, what you’re great at and what you want out of your career.
Founded in 2025
2-10 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase