Software Engineer II, AI Data Platform (CoreAI) jobs in United States
cer-icon
Apply on Employer Site
company-logo

Microsoft · 22 hours ago

Software Engineer II, AI Data Platform (CoreAI)

Microsoft is a leading technology company that empowers individuals and organizations to achieve more. As a Software Engineer II, you will work on the infrastructure and tools to support large scale model fine-tuning, evaluation, and inference for the GenAI Infrastructure and Solutions team.

Agentic AIApplication Performance ManagementArtificial Intelligence (AI)Business DevelopmentDevOpsInformation ServicesInformation TechnologyManagement Information SystemsNetwork SecuritySoftware
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Collaborate with senior engineers and researchers to build and optimize training infrastructure and tools for LLMs, SLMs, multimodal, and code-specific models
Design, build and improve the services with high scalability and reliability
Contribute to the deployment and monitoring of services in production environments
Participate in the efforts to deliver and improve engineering systems and practices to ensure service quality in complex cloud environments

Qualification

C#PythonC++DockerKubernetesDistributed systemsCloud-based infrastructureDevOps practicesJavaJavaScriptModel servingCachingBatchingMonitoringHigh quality software

Required

Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter

Preferred

2+ years of software development experience in C#, C++, Python, or similar languages
1+ year of experience with containerization tools (e.g., Docker, Kubernetes)
Familiarity with production ML systems and concepts like model serving, caching, batching, and monitoring
2+ years designing, developing, and shipping high quality software
1+ years of experience with distributed systems and cloud-based infrastructure
1+ year of experience with DevOps practices (CI/CD, automated testing, deployment, etc.)

Benefits

Certain roles may be eligible for benefits and other compensation.

Company

Microsoft

company-logo
Microsoft is a software corporation that develops, manufactures, licenses, supports, and sells a range of software products and services.

H1B Sponsorship

Microsoft has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9192)
2024 (9343)
2023 (7677)
2022 (11403)
2021 (7210)
2020 (7852)

Funding

Current Stage
Public Company
Total Funding
$1M
Key Investors
Technology Venture Investors
2022-12-09Post Ipo Equity
1986-03-13IPO
1981-09-01Series Unknown· $1M

Leadership Team

leader-logo
Satya Nadella
Chairman and CEO
linkedin
leader-logo
Vukani Mngxati
Chief Executive Officer - Microsft South Africa
linkedin
Company data provided by crunchbase