Microsoft · 2 days ago
Senior Software Engineer
Redmond, WA
Full-time
Onsite
Mid, Senior Level
$120K/yr - $235K/yr
4+ years expMicrosoft is a leading technology company focused on empowering individuals and organizations worldwide. The Senior Software Engineer will work on the AI Frameworks team, developing AI software and optimizing performance for large language models, collaborating with both internal and external partners.
Application Performance ManagementArtificial Intelligence (AI)Business DevelopmentData ManagementDevOpsInformation ServicesInformation TechnologyManagement Information SystemsNetwork SecuritySoftware
Responsibilities
Identify and drive improvements to end-to-end inference performance of OpenAI and other state of the art LLMs
Measure, benchmark performance on Nvidia/AMD GPU's and first party Microsoft silicon
Optimize and monitor performance of LLMs and build software tooling to enable insights into performance opportunities ranging from the model level to the systems and silicon level, help reduce the footprint of the computing fleet and achieve Azure AI capex goals
Enable fast time to market of LLMs/models and their deployments at scale by building software tools that afford velocity in porting models on new Nvidia, AMD GPUs and Maia silicon
Design, implement, and test functions or components for our AI/deep neural networks (DNN)/LLM frameworks and tools
Speeding up/reducing complexity of key components/pipelines to improve performance and/or efficiency of our systems
Communicate and collaborate with our partners both internal and external
Embody Microsoft's Culture and Values
Qualification
Required
Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
4+ years' practical experience working on high performance applications and performance debugging and optimization on CPU's/GPU's
Experience in DNN/LLM inference and experience in one or more DL frameworks such as PyTorch, Tensorflow, or ONNX Runtime and familiarity with CUDA, ROCm, Triton
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role
Preferred
Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Technical background and solid foundation in software engineering principles, computer architecture, GPU architecture, hardware neural net acceleration
Experience in end-to-end performance analysis and optimization of state of the art LLMs, HPC applications including proficiency using GPU profiling tools
Cross-team collaboration skills and the desire to collaborate in a team of researchers and developers
Ability to independently lead projects
Company
Microsoft
Microsoft is a software corporation that develops, manufactures, licenses, supports, and sells a range of software products and services.
10001+ employees
H1B Sponsorship
Microsoft has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9192)
2024 (9343)
2023 (7677)
2022 (11403)
2021 (7210)
2020 (7852)
Funding
Current Stage
Public CompanyTotal Funding
$1MKey Investors
Technology Venture Investors
2022-12-09Post Ipo Equity
1986-03-13IPO
1981-09-01Series Unknown· $1M
Leadership Team
Satya Nadella
Chairman and CEO
Vukani Mngxati
Chief Executive Officer - Microsft South Africa
Recent News
2026-01-05
2026-01-05
Company data provided by crunchbase