Microsoft · 22 hours ago
Principal Product Manager- Fine-Tuning & Distillation (CoreAI)
United States, Massachusetts, Boston
Full-time
Hybrid
Senior Level, Lead/Staff
$140K/yr - $275K/yr
8+ years expMicrosoft is a leading technology company, and they are seeking a Principal Product Manager for Fine-Tuning and Distillation in their CoreAI organization. This role is responsible for shaping the strategy and execution of advanced model customization capabilities within Microsoft Foundry, partnering with internal teams to drive product vision and optimize model performance.
Agentic AIApplication Performance ManagementArtificial Intelligence (AI)Business DevelopmentDevOpsInformation ServicesInformation TechnologyManagement Information SystemsNetwork SecuritySoftware
Responsibilities
Define and drive the long-term vision and roadmap for fine-tuning and distillation capabilities within Microsoft Foundry
Partner closely with flagship internal teams (M365, GitHub, Microsoft AI, and others) to identify needs, validate solutions, and convert internal innovation into scalable platform features
Own the product experience for fine-tuning and distillation, spanning data preparation, training, evaluation, deployment, and lifecycle management
Enable techniques that improve model performance, cost efficiency, latency, and safety across diverse workloads and model families
Collaborate with research and applied science teams to operationalize cutting-edge techniques into reliable, supportable platform capabilities
Design intuitive APIs, tooling, and abstractions that make advanced model customization accessible to a broad developer audience
Drive alignment across engineering, infrastructure, security, compliance, and business stakeholders to deliver high-impact outcomes
Establish a customer-driven prioritization framework balancing near-term impact with long-term platform scalability
Define success metrics, feedback loops, and continuous improvement processes to ensure reliability and adoption at scale
Qualification
Required
Bachelor's Degree AND 8+ years experience in product/service/program management or software development OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
Preferred
3+ years of hands-on experience with Azure (or similar cloud) services, including resource provisioning, IAM, networking, and scripting (PowerShell or Azure CLI)
6+ years experience managing cross-functional and/or cross-team projects
Deep expertise in AI/ML data pipelines—pre-training, fine-tuning, evaluation, and deployment
Track record of leading cross-functional efforts at scale in high-stakes, fast-paced environments
Startup founder/early-stage experience or leadership roles at Meta, Google, Amazon, or similar AI-first companies
Proven experience in product management for large-scale data or AI platforms
Technical background in data lifecycle management, security, and compliance
Demonstrated ability to lead cross-functional teams and drive strategic initiatives
Entrepreneurial mindset; thrives in fast-paced, ambiguous environments
Company
Microsoft
Microsoft is a software corporation that develops, manufactures, licenses, supports, and sells a range of software products and services.
10001+ employees
H1B Sponsorship
Microsoft has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9192)
2024 (9343)
2023 (7677)
2022 (11403)
2021 (7210)
2020 (7852)
Funding
Current Stage
Public CompanyTotal Funding
$1MKey Investors
Technology Venture Investors
2022-12-09Post Ipo Equity
1986-03-13IPO
1981-09-01Series Unknown· $1M
Leadership Team
Satya Nadella
Chairman and CEO
Vukani Mngxati
Chief Executive Officer - Microsft South Africa
Recent News
2026-01-16
Morningstar.com
2026-01-16
Company data provided by crunchbase