Moveworks · 1 week ago
Senior Machine Learning Engineer II - LLM
Moveworks is an AI Assistant company that enhances productivity by helping employees find information and automate tasks. They are seeking a Senior Machine Learning Engineer II to build and optimize ML infrastructure for large language models, which is critical for the scalability of their AI product.
Agentic AIArtificial Intelligence (AI)Cloud ComputingInformation TechnologyTechnical Support
Responsibilities
Design, build and optimize scalable machine learning infrastructure to support training, evaluation, and deployment of large language models
Build abstractions to automate various steps in different ML workflows
Collaborate with cross functional teams of engineers, data analytics, machine learning experts, and product to build new features
Leverage your experience to drive best practices in ML and data engineering
Qualification
Required
2+ years of industry experience in Machine Learning, Infrastructure or related fields
Experience with deep learning framework such as Pytorch or Huggingface or LLM serving frameworks such as vLLM or TensorRT-LLM
Experience with building and scaling end-to-end machine learning systems
Experience building scalable micro services and ETL pipelines
Expertise in Python and experience with performant language such as C++ or GoLang
Bachelor's in Computer Science, Computer Engineering, Mathematics, or equivalent field
A love of research publications in the machine learning and software engineering communities
Effective communicator with experience collaborating cross-functionally with other teams
Preferred
Experience with ML Inference optimization using TensorRT
Experience with distributed training frameworks such as Deepspeed
Experience in managing and scaling GPU Inference services via Kubernetes
Benefits
Equity for all full time roles
Exceptional benefits
Commissions or bonus plans
Company
Moveworks
Moveworks offers an AI-powered assistant designed to enhance workflows and automate tasks within enterprises.
H1B Sponsorship
Moveworks has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (40)
2024 (24)
2023 (13)
2022 (38)
2021 (24)
2020 (8)
Funding
Current Stage
Late StageTotal Funding
$305M2025-03-10Acquired
2021-06-30Series C· $200M
2019-11-14Series B· $75M
Recent News
2026-01-06
2025-12-30
Company data provided by crunchbase