Senior Machine Learning Engineer II - LLM jobs in United States
cer-icon
Apply on Employer Site
company-logo

Moveworks · 1 week ago

Senior Machine Learning Engineer II - LLM

Moveworks is an AI Assistant company that enhances productivity by helping employees find information and automate tasks. They are seeking a Senior Machine Learning Engineer II to build and optimize ML infrastructure for large language models, which is critical for the scalability of their AI product.

Agentic AIArtificial Intelligence (AI)Cloud ComputingInformation TechnologyTechnical Support
check
H1B Sponsor Likelynote

Responsibilities

Design, build and optimize scalable machine learning infrastructure to support training, evaluation, and deployment of large language models
Build abstractions to automate various steps in different ML workflows
Collaborate with cross functional teams of engineers, data analytics, machine learning experts, and product to build new features
Leverage your experience to drive best practices in ML and data engineering

Qualification

Machine Learning InfrastructureDeep Learning FrameworksPythonEnd-to-End ML SystemsMicroservicesETL PipelinesC++GoLangEffective CommunicationCollaboration

Required

2+ years of industry experience in Machine Learning, Infrastructure or related fields
Experience with deep learning framework such as Pytorch or Huggingface or LLM serving frameworks such as vLLM or TensorRT-LLM
Experience with building and scaling end-to-end machine learning systems
Experience building scalable micro services and ETL pipelines
Expertise in Python and experience with performant language such as C++ or GoLang
Bachelor's in Computer Science, Computer Engineering, Mathematics, or equivalent field
A love of research publications in the machine learning and software engineering communities
Effective communicator with experience collaborating cross-functionally with other teams

Preferred

Experience with ML Inference optimization using TensorRT
Experience with distributed training frameworks such as Deepspeed
Experience in managing and scaling GPU Inference services via Kubernetes

Benefits

Equity for all full time roles
Exceptional benefits
Commissions or bonus plans

Company

Moveworks

company-logo
Moveworks offers an AI-powered assistant designed to enhance workflows and automate tasks within enterprises.

H1B Sponsorship

Moveworks has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (40)
2024 (24)
2023 (13)
2022 (38)
2021 (24)
2020 (8)

Funding

Current Stage
Late Stage
Total Funding
$305M
2025-03-10Acquired
2021-06-30Series C· $200M
2019-11-14Series B· $75M

Leadership Team

leader-logo
Bhavin Shah
CEO & Founder
linkedin
leader-logo
Jiang Chen
Founder & CTO, AI
linkedin
Company data provided by crunchbase