Engineering Manager - Machine Learning Infrastructure jobs in United States
cer-icon
Apply on Employer Site
company-logo

Moveworks · 1 day ago

Engineering Manager - Machine Learning Infrastructure

Moveworks is an AI Assistant that helps employees find information and automate tasks. As the Engineering Manager for the Machine Learning Infrastructure team, you will lead a talented group of engineers to develop and optimize systems for the entire ML lifecycle, playing a crucial role in the scalability of Moveworks' AI products.

Artificial Intelligence (AI)Cloud ComputingInformation TechnologyTechnical Support
check
H1B Sponsor Likelynote

Responsibilities

Lead, Mentor, and Grow a world-class team of ML and Systems Engineers, fostering a culture of innovation, ownership, and operational excellence that aligns with Moveworks' core principles
Own the Technical Vision and roadmap for the end-to-end ML platform that powers the entire lifecycle—from data synthesis and distributed training to ultra-low-latency inference and serving—for hundreds of production models, including our proprietary MoveLM series
Drive the Strategy for model performance and efficiency, making critical architectural decisions to optimize our GPU infrastructure for latency, throughput, and cost at massive scale
Partner with Leaders across agentic platform, search platform, product engineering, and core infrastructure teams to define and deliver the foundational infrastructure that will power the next generation of agentic AI experiences
Champion a Product Mindset for your platform, building powerful abstractions and tools that accelerate the velocity of machine learning engineers and researchers across the organization

Qualification

Machine Learning SystemsPythonDeep Learning FrameworksDistributed Training FrameworksC++GoLangLLM InfrastructureCommunicationCollaboration SkillsStrategic Mindset

Required

A Master's or Ph.D. in Computer Science, Machine Learning, or a related field
5+ years of industry experience with a proven track record of leading or managing high-performing machine learning or infrastructure teams
Deep technical expertise in designing, building, and scaling end-to-end machine learning systems in production environments
Strong command of Python and experience with performant languages such as C++ or GoLang
Extensive experience with deep learning frameworks like PyTorch or Hugging Face
Hands-on experience with modern LLM infrastructure, including distributed training frameworks (e.g., Deepspeed) and inference/serving frameworks (e.g., vLLM, TensorRT-LLM, Kubernetes)
A strategic mindset with experience balancing the demands of operating robust, scalable infrastructure with the need for forward-looking research and development
Excellent communication and collaboration skills, with experience working cross-functionally to deliver complex projects

Preferred

Experience working with Machine Learning products

Benefits

Equity for all full time roles
Exceptional benefits
Commissions or bonus plans

Company

Moveworks

company-logo
Moveworks offers an AI-powered assistant designed to enhance workflows and automate tasks within enterprises.

H1B Sponsorship

Moveworks has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (40)
2024 (24)
2023 (13)
2022 (38)
2021 (24)
2020 (8)

Funding

Current Stage
Late Stage
Total Funding
$305M
2025-03-10Acquired
2021-06-30Series C· $200M
2019-11-14Series B· $75M

Leadership Team

leader-logo
Bhavin Shah
CEO & Founder
linkedin
leader-logo
Jiang Chen
Founder & CTO, AI
linkedin
Company data provided by crunchbase