Be an early applicantLess than 25 applicants

Company

Microsoft · 10 hours ago

Senior Software Engineer- GPU

Mountain View, CA

Full-time

Remote

Mid, Senior Level

$117K/yr - $229K/yr

4+ years exp

Maximize your interview chances

Data ManagementDeveloper Tools

Growth Opportunities

H1B Sponsor Likely

Insider Connection @Microsoft

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Identify and drive improvements to end-to-end inference performance of OpenAI and other state-of-the-art LLMs

Measure, benchmark performance on Nvidia/AMD GPU's and first party Microsoft silicon

Optimize and monitor performance of LLMs and build SW tooling to enable insights into performance opportunities ranging from the model level to the systems and silicon level, help reduce the footprint of the computing fleet and achieve Azure AI capex goals

Enable fast time to market LLMs/models and their deployments at scale by building SW tools that afford velocity in porting models on new Nvidia, AMD GPUs and Maia silicon

Design, implement, and test functions or components for our AI/DNN/LLM frameworks and tools

Speeding up/reducing complexity of key components/pipelines to improve performance and/or efficiency of our systems

Communicate and collaborate with our partners both internal and external

Embody our Culture and Values

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

CC++PythonHigh Performance ApplicationsPerformance DebugOptimizationGPU ArchitectureComputer ArchitectureDeep LearningAI InfrastructureDNN/LLM InferencePyTorchTensorFlowONNX RuntimeCUDAROCmTritonGPU Profiling ToolsKubernetesService Fabric

Required

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to C, C++, or Python + OR equivalent experience.

2+ years’ practical experience working on High Performance Applications and Performance Debug and Optimization on CPU's/GPU's.

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.

Preferred

Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python + OR equivalent experience.

Technical background and solid foundation in software engineering principles, computer architecture, GPU architecture, HW neural net acceleration.

Experience in end-to-end performance analysis and optimization of state-of-the-art LLMs, HPC applications including proficiency using GPU profiling tools.

Experience in DNN/LLM inference and experience in one or more DL frameworks such as PyTorch, Tensorflow, or ONNX Runtime and familiarity with CUDA, ROCm, Triton.

Cross-team collaboration skills and the desire to collaborate in a team of researchers and developers.

Experience in working with orchestration platforms like K8 and Service Fabric.

2+ years of experience with Deep Learning, and AI Infrastructure including Diagnostic, Profiling and Performance Analysis Tools.

Company

Microsoft

Glassdoor

4.3

Microsoft is a software corporation that develops, manufactures, licenses, supports, and sells a range of software products and services.

Founded in 1975

Redmond, Washington, USA

10001+ employees

https://www.microsoft.com

H1B Sponsorship

Microsoft has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2023 (5862)

2022 (11005)

2021 (8174)

2020 (6856)