Software Engineer II jobs in United States
cer-icon
Apply on Employer Site
company-logo

Microsoft · 2 days ago

Software Engineer II

Microsoft is building foundational software layers for their custom AI accelerator, the MAIA chip. As a Software Engineer II, you will contribute to the development of high-performance runtime systems and dataflow mechanisms that coordinate execution across multiple MAIA accelerators.

Agentic AIApplication Performance ManagementArtificial Intelligence (AI)Business DevelopmentDevOpsInformation ServicesInformation TechnologyManagement Information SystemsNetwork SecuritySoftware
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Actively contribute to a culture of inclusivity by valuing diverse perspectives, mentoring peers, and promoting open communication. Support and uplift teammates to ensure everyone can contribute their best in a high-performing, collaborative environment
Design and implement core components of the MAIA runtime, including:
PCIe-based communication protocols
Data movement orchestration between host and device memory
Command encoding and dispatch mechanisms for AI workloads
Synchronization and stream control primitives across devices and execution units
Collaborate with hardware, firmware, and compiler teams to define and refine the runtime contract between layers
Optimize performance-critical code paths to minimize latency and maximize throughput, particularly around memory copies, kernel launch sequencing, and queue management
Contribute to tooling and test infrastructure that enables validation, tracing, and performance benchmarking of your components
Participate in code reviews, design reviews, and cross-team architecture discussions
Drive high-quality implementation practices: testing, documentation, and debugging support

Qualification

CC++PythonSystems programmingPCIe communicationMemory modelsConcurrencyInterprocess communicationPerformance optimizationCross-discipline collaborationExposure to observability toolsCollaboration skillsProblem-solving skillsCommunication skills

Required

Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role

Preferred

Master's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR equivalent experience
3+ years of experience in systems programming (C, C++, Rust, or similar), with a focus on low-level or performance-critical software
Solid understanding of memory models, concurrency, and interprocess communication
Ability to reason about performance tradeoffs, including latency vs. bandwidth, queuing models, and batching vs. streaming
Proven problem-solving skills with the ability to tackle complex technical challenges related to data flow efficiency and infrastructure optimization
A track record of working on high-impact projects, demonstrating a passion for building robust, high-performance systems
Excellent collaboration and communication skills, with a drive to work alongside top-tier engineers to push the boundaries of AI acceleration tooling
Experience working on infrastructure involving hardware interfaces or device communication (e.g., PCIe, DMA, RDMA, or similar)
Familiarity with GPU, TPU, or other accelerator architectures and their runtime systems
Experience implementing communication protocols or working with driver/kernel interfaces
Exposure to observability or profiling tools (e.g., eBPF, trace buffers, performance counters, telemetry hooks)
Strong cross-discipline collaboration skills—hardware/software codesign, or coordination with test and validation teams

Company

Microsoft

company-logo
Microsoft is a software corporation that develops, manufactures, licenses, supports, and sells a range of software products and services.

H1B Sponsorship

Microsoft has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9192)
2024 (9343)
2023 (7677)
2022 (11403)
2021 (7210)
2020 (7852)

Funding

Current Stage
Public Company
Total Funding
$1M
Key Investors
Technology Venture Investors
2022-12-09Post Ipo Equity
1986-03-13IPO
1981-09-01Series Unknown· $1M

Leadership Team

leader-logo
Satya Nadella
Chairman and CEO
linkedin
leader-logo
Vukani Mngxati
Chief Executive Officer - Microsft South Africa
linkedin
Company data provided by crunchbase