Software Engineer II, AI Data Platform (CoreAI) jobs in United States
cer-icon
Apply on Employer Site
company-logo

Microsoft · 1 day ago

Software Engineer II, AI Data Platform (CoreAI)

Microsoft is building large-scale GenAI training infrastructure and LLM-based solutions. As a Software Engineer II, you will develop infrastructure and tools to support large scale model fine-tuning, evaluation, and inference.

Agentic AIApplication Performance ManagementArtificial Intelligence (AI)Business DevelopmentDevOpsInformation ServicesInformation TechnologyManagement Information SystemsNetwork SecuritySoftware
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Collaborate with senior engineers and researchers to build and optimize training infrastructure and tools for LLMs, SLMs, multimodal, and code-specific models
Design, build and improve the services with high scalability and reliability
Contribute to the deployment and monitoring of services in production environments
Participate in the efforts to deliver and improve engineering systems and practices to ensure service quality in complex cloud environments

Qualification

C#PythonDistributed systemsDockerKubernetesDevOps practicesProduction ML systemsC++JavaJavaScript

Required

Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role

Preferred

2+ years of software development experience in C#, C++, Python, or similar languages
1+ year of experience with containerization tools (e.g., Docker, Kubernetes)
Familiarity with production ML systems and concepts like model serving, caching, batching, and monitoring
2+ years designing, developing, and shipping high quality software
1+ years of experience with distributed systems and cloud-based infrastructure
1+ year of experience with DevOps practices (CI/CD, automated testing, deployment, etc.)

Company

Microsoft

company-logo
Microsoft is a software corporation that develops, manufactures, licenses, supports, and sells a range of software products and services.

H1B Sponsorship

Microsoft has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9192)
2024 (9343)
2023 (7677)
2022 (11403)
2021 (7210)
2020 (7852)

Funding

Current Stage
Public Company
Total Funding
$1M
Key Investors
Technology Venture Investors
2022-12-09Post Ipo Equity
1986-03-13IPO
1981-09-01Series Unknown· $1M

Leadership Team

leader-logo
Satya Nadella
Chairman and CEO
linkedin
leader-logo
Vukani Mngxati
Chief Executive Officer - Microsft South Africa
linkedin
Company data provided by crunchbase