200+ applicants

Company

Microsoft · 15 hours ago

Software Engineer II

Redmond, WA

Full-time

Remote

Entry, Mid Level

$98K/yr - $193K/yr

2+ years exp

Maximize your interview chances

Data ManagementDeveloper Tools

Growth Opportunities

H1B Sponsor Likely

Insider Connection @Microsoft

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Engage directly with key partners to understand and implement complex routing, rate limiting and load balancing capabilities for state-of-the-art LLMs and Diffusion models to optimize for utilization, throughput and latency

Work with cutting edge hardware stacks and a fast-moving software stack to deliver best of class inference and optimal cost

Motivated to build constructive and effective relationships and solve problems collaboratively

Support production inference SLAs for core AI scenarios on one of the largest GPU fleets in the world

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Distributed ComputingObject-Oriented ProgrammingCC++C#JavaJavaScriptPythonMachine LearningPyTorchLarge Language ModelsGenerative AIGeo-distributed TeamworkCross-Functional Collaboration

Required

Bachelor’s degree in computer science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.

Experience in distributed computing and architecture

Experience with object-oriented languages like C#, Java

Experience working in a geo-distributed team

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.

Preferred

Ability to work cross functionally in a team environment.

Experience in Machine Learning algorithms and tools like pytorch, large language model, generative AI.

Company

Microsoft

Glassdoor

4.3

Microsoft is a software corporation that develops, manufactures, licenses, supports, and sells a range of software products and services.

Founded in 1975

Redmond, Washington, USA

10,001+ employees

https://www.microsoft.com

H1B Sponsorship

Microsoft has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2023 (5862)

2022 (11005)

2021 (8174)

2020 (6856)