Apply on Employer Site

Microsoft · 8 hours ago

Senior Research Engineer

Redmond, WA

Full-time

Onsite

Mid, Senior Level

$120K/yr - $235K/yr

4+ years exp

Microsoft is expanding its model choice across multiple providers and modalities to meet diverse customer needs and regulatory requirements. The Senior Research Engineer will build backend systems, APIs, and evaluation pipelines for Copilot and Copilot Studio, partnering with cross-functional teams to ensure quality and governance in model selection.

Application Performance ManagementArtificial Intelligence (AI)Business DevelopmentData ManagementDevOpsInformation ServicesInformation TechnologyManagement Information SystemsNetwork SecuritySoftware

Growth Opportunities

No H1B

U.S. Citizen Only

Responsibilities

Build multi provider model routing services with policy driven selection, traffic splitting, and observability

Develop evaluation pipelines for offline and online experiments; automate metrics like task success, groundedness, latency, and cost

Operationalize model comparisons through scorecards, dashboards, and A/B testing for rollout decisions

Harden backend infrastructure for scale, security, and compliance; implement caching, rate limiting, and safety filters

Instrument telemetry and monitoring using OpenTelemetry; enable RCA and performance insights

Collaborate cross functionally with PMs, scientists, and Responsible AI teams; document and evangelize best practices

Qualification

CC++C#JavaPythonJavaScriptBackend servicesAPIsLarge language modelsDistributed systemsCloud servicesOpenTelemetryBest practicesCollaborationDocumentation

Required

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role

Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Preferred

Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience

Experience building backend services or APIs in a production environment using at least one modern programming language (e.g., C#, Java, Python, or TypeScript)

Experience working with large language models (LLMs) or similar AI systems in any capacity (development, integration, or evaluation)

Experience deploying or operating distributed systems or cloud-based services (e.g., Azure, AWS, or GCP) in a production environment