Microsoft · 1 week ago
Principal Software Engineer, CoreAI
Redmond, WA
Full-time
Hybrid
Senior Level, Lead/Staff
$140K/yr - $275K/yr
6+ years expMicrosoft is seeking a Principal Software Engineer to join their AI Core team, focusing on building high performance runtime systems for OpenAI chat and multimodal AI models. The role involves systems level optimization for large scale LLM inferencing and requires deep expertise in C++ and cloud services.
Agentic AIApplication Performance ManagementArtificial Intelligence (AI)Business DevelopmentDevOpsInformation ServicesInformation TechnologyManagement Information SystemsNetwork SecuritySoftware
Responsibilities
Design and implement high performance microservices and runtime components in C++
Optimize AI inferencing systems for latency, throughput, cost, and reliability at large scale
Debug and resolve complex production issues related to performance, scaling, and service reliability
Collaborate with cross-functional partners to integrate model inference pipelines into scalable infrastructure
Contribute to state-of-the-art multimodal inferencing systems supporting text, speech, and vision workloads
Drive systems level innovations for realtime and batch inferencing efficiency
Participate in code reviews and provide technical mentorship to senior and peer engineers
Qualification
Required
6+ years of experience in systems programming with strong expertise in C++
Proven experience building, deploying, and operating scalable cloud services
Strong debugging skills and experience using performance profiling and diagnostic tools
Hands-on experience with distributed systems, Kubernetes, and containerized workloads
Experience with largescale LLM inferencing infrastructure, including CUDA
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
Preferred
Experience optimizing AI model inference distributed GPU/CPU stack
Exposure to Azure OpenAI or similar largescale AI serving platforms
Understanding of service reliability engineering (SRE) principles and operational excellence
Company
Microsoft
Microsoft is a software corporation that develops, manufactures, licenses, supports, and sells a range of software products and services.
10001+ employees
H1B Sponsorship
Microsoft has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9192)
2024 (9343)
2023 (7677)
2022 (11403)
2021 (7210)
2020 (7852)
Funding
Current Stage
Public CompanyTotal Funding
$1MKey Investors
Technology Venture Investors
2022-12-09Post Ipo Equity
1986-03-13IPO
1981-09-01Series Unknown· $1M
Leadership Team
Satya Nadella
Chairman and CEO
Vukani Mngxati
Chief Executive Officer - Microsft South Africa
Recent News
2026-01-16
Morningstar.com
2026-01-16
Company data provided by crunchbase