Microsoft · 2 days ago
Machine Learning Operations (MLOps) Engineer
Mountain View, CA
Full-time
Onsite
Mid, Senior Level
$120K/yr - $235K/yr
4+ years expMicrosoft Copilot focuses on building AI powered products and is seeking a Machine Learning Operations (MLOps) Engineer to architect and build the necessary infrastructure for continuous model improvement. The role involves creating robust training and deployment systems, optimizing model serving architecture, and collaborating with cross-functional teams to enhance product quality.
Agentic AIApplication Performance ManagementArtificial Intelligence (AI)Business DevelopmentDevOpsInformation ServicesInformation TechnologyManagement Information SystemsNetwork SecuritySoftware
Responsibilities
Training pipelines that scale elegantly - Design and implement robust training infrastructure that handles everything from data ingestion to model versioning, making it trivial for ML engineers to experiment and deploy with confidence
The data flywheel - Build the infrastructure and product features that capture user interactions, ground truth labels, and edge cases, then automatically route them back into training loops. Turn every production interaction into a training example
Inference systems that deliver - Dive deep into model serving architecture—optimize latency, manage costs, implement intelligent caching, and build the observability needed to maintain reliability at scale
Deployment pipelines with guardrails - Create deployment systems that balance velocity with safety: automated testing, gradual rollouts, performance monitoring, and quick rollback mechanisms
Cross-functional infrastructure - Partner closely with ML engineers, platform engineers, and data scientists to build APIs and tools that enable tight, rapid feedback loops from production back to model development
Qualification
Required
Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Preferred
Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Familiarity with LLM deployment patterns, vector databases, prompt management, and the unique challenges of serving foundation models
Experience working with RAG, fine-tuning pipelines, or evaluation frameworks
The ability to see beyond individual components to design holistic systems where data flows naturally from production through improvement cycles and back
Desire and preference to work at the intersection of teams, translating between ML researchers who want flexibility and engineers who need reliability
Company
Microsoft
Microsoft is a software corporation that develops, manufactures, licenses, supports, and sells a range of software products and services.
10001+ employees
H1B Sponsorship
Microsoft has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9192)
2024 (9343)
2023 (7677)
2022 (11403)
2021 (7210)
2020 (7852)
Funding
Current Stage
Public CompanyTotal Funding
$1MKey Investors
Technology Venture Investors
2022-12-09Post Ipo Equity
1986-03-13IPO
1981-09-01Series Unknown· $1M
Leadership Team
Satya Nadella
Chairman and CEO
Vukani Mngxati
Chief Executive Officer - Microsft South Africa
Recent News
MarketScreener
2026-01-06
2026-01-06
Company data provided by crunchbase