Advanced Microdevices Pvt. Ltd. (India) ยท 3 weeks ago
Fellow Software Development Eng (MI-450 Fleet Management Engineer)
San Jose, CA
Full-time
Hybrid
Lead/StaffAdvanced Micro Devices, Inc. is dedicated to building innovative products that enhance next-generation computing experiences. They are seeking a Fellow in Infrastructure Management who will lead the technical vision and architectural direction of software managing GPU clusters for AI solutions, focusing on high-performance inference services and efficient resource management.
BiopharmaBiotechnologyIndustrialManufacturing
Responsibilities
Lead the technical vision, strategy, and architectural direction of our Infrastructure management software that manages our GPU clusters supporting large foundation model training, high-performance inference services, multi-tenant GPU sharing and scheduling
Architect and implement GPU node orchestration, failure detection, auto-remediation, auto-scaling of clusters
Design infrastructure software that can support different distributed training frameworks PyTorch, Megatron, JAX, Tensorflow and different distributed inference frameworks like SGLang, VLLM, Ray
Design and deliver software that can manage different scale-up and scale out transport protocols and deliver the best network performance
Architect telemetry, observability, and profiling systems (Prometheus/Thanos, Open Telemetry, Mimir) to measure GPU health and cluster efficiency
Architect monitoring systems that can investigate network congestion, latency spikes, scheduling inefficiencies, system bottlenecks
Architect our Infrastructure management software for scale, efficiency and deliver industry leading GPU cluster utilization that is highly reliable and self-healing
Deliver infrastructure services that reduce job latencies for Slurm and Kubernetes clusters, improve scheduling efficiencies, and reduce operational cost
Design and deliver AI Agents that can troubleshoot complex infrastructure problems without any human intervention and reduce OPEX cost and MTTR
Design and deliver AI Agents that can proactively identify nodes that are bound to fail before they fail
Define our long-term infrastructure management roadmap, drive cross-team initiatives, and deliver
Mentor Principal Engineers, Technical staff across teams
Work with external partners and vendors to develop and deliver the most comprehensive infrastructure solution for AMD
Qualification
Required
Passionate about software engineering, system design, infrastructure management
Possess leadership skills to drive sophisticated issues to resolution
Able to communicate effectively and work optimally with different teams across AMD
Lead the technical vision, strategy, and architectural direction of our Infrastructure management software
Architect and implement GPU node orchestration, failure detection, auto-remediation, auto-scaling of clusters
Design infrastructure software that can support different distributed training frameworks PyTorch, Megatron, JAX, Tensorflow
Design and deliver software that can manage different scale-up and scale out transport protocols
Architect telemetry, observability, and profiling systems (Prometheus/Thanos, Open Telemetry, Mimir)
Architect monitoring systems that can investigate network congestion, latency spikes, scheduling inefficiencies, system bottlenecks
Architect our Infrastructure management software for scale, efficiency and deliver industry leading GPU cluster utilization
Deliver infrastructure services that reduce job latencies for Slurm and Kubernetes clusters
Improve scheduling efficiencies, and reduce operational cost
Design and deliver AI Agents that can troubleshoot complex infrastructure problems without any human intervention
Design and deliver AI Agents that can proactively identify nodes that are bound to fail before they fail
Define our long-term infrastructure management roadmap, drive cross-team initiatives, and deliver
Mentor Principal Engineers, Technical staff across teams
Work with external partners and vendors to develop and deliver the most comprehensive infrastructure solution for AMD
Preferred
Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent
Benefits
AMD benefits at a glance.
Company
Advanced Microdevices Pvt. Ltd. (India)
Advanced Microdevices (mdi) is a leader in innovative membrane technologies.
Founded in 1976
501-1000 employees
Funding
Current Stage
Late StageLeadership Team
Nalini Kant Gupta
Founder & Managing Director
Recent News
2024-10-18
2024-10-16
Company data provided by crunchbase