Microsoft · 1 day ago
Principal Hardware Architect
Microsoft is a leading technology company seeking a Principal Hardware Architect to join their Strategic Planning and Architecture team within Azure Hardware Systems & Infrastructure. The role involves analyzing and architecting hardware systems for AI workloads, driving the development of AI infrastructure, and collaborating on innovative hardware designs.
Agentic AIApplication Performance ManagementArtificial Intelligence (AI)Business DevelopmentDevOpsInformation ServicesInformation TechnologyManagement Information SystemsNetwork SecuritySoftware
Responsibilities
Analyze hardware architectures for AI workloads at system level and SoC level
Architect large scale systems which support breakthrough performance for AI workloads to shape Azure’s AI infrastructure roadmap
Benchmark GPUs and other AI hardware, with NN models and develop kernels for micro benchmarks
Develop / enhance the inference stack architecture for optimal deployment of novel HW architectures and lead prototyping efforts to demonstrate feasibility and performance
Understand business critical AI workloads/applications
Drive NN model/HW codesign
Qualification
Required
Master's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 7+ years technical engineering experience OR Bachelor's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 8+ years technical engineering experience OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter
Preferred
15+ years of experience developing/architecting high end AI Accelerators
Understanding of large language models, training and inference
Knowledge of commonly used AI and HPC workloads and how they are mapped onto large scale systems
Expertise in python programming and SW engineering
Collaborative mindset
Hands on experience with frameworks such as Pytorch/Tensorflow/TensorRT
Deep knowledge of CNN/transformer architecture and optimization strategies – quantization, sparsity, sharding, KV Cache, Flash Attention
Knowledge of inference stacks, like sglang
Knowledge in developing kernels for AI accelerators / GPUs
Programming skills in Python/C/C++
Company
Microsoft
Microsoft is a software corporation that develops, manufactures, licenses, supports, and sells a range of software products and services.
Funding
Current Stage
Public CompanyTotal Funding
$1MKey Investors
Technology Venture Investors
2022-12-09Post Ipo Equity
1986-03-13IPO
1981-09-01Series Unknown· $1M
Leadership Team
Recent News
2026-01-16
Morningstar.com
2026-01-16
Company data provided by crunchbase