Scale AI · 12 hours ago
Senior/Staff Machine Learning Engineer, General Agents, Enterprise GenAI
NYC Metro Area
Full-time
Hybrid
Senior Level, Lead/Staff
$218K/yr - $273K/yr
5+ years expScale AI is the data foundation for AI, helping organizations build and deploy reliable production AI applications. As a Senior/Staff Machine Learning Engineer on the General Agents team, you will design, build, and deploy production-ready AI agents that solve high-impact enterprise problems, working across the full agent lifecycle.
Artificial Intelligence (AI)Big DataAI InfrastructureData Collection and LabelingGenerative AIImage RecognitionMachine Learning
Responsibilities
Design and implement end-to-end agent systems that combine LLM reasoning, tool use, memory, and control logic to solve recurring enterprise use cases
Build scalable, reliable agent architectures that can be deployed across many customers with varying data, tools, and constraints
Develop evaluation frameworks, datasets, environments, and metrics to measure agent performance, reliability, and business impact in production settings
Collaborate closely with product managers, customers, data annotators, and other engineering teams to translate enterprise requirements into robust agent designs
Productionize frontier agent techniques (e.g., planning, multi-step reasoning and tool-use, multi-agent patterns) into maintainable, observable systems
Own deployment, monitoring, and iteration of agent systems, including failure analysis and continuous improvement based on real-world usage
Contribute to technical direction and architectural decisions for general agent development best practices and methods, with increasing scope and leadership at the Staff level
Qualification
Required
5+ years of experience building and deploying machine learning or AI systems for real-world, production use cases
Strong engineering fundamentals, supported by a Bachelor's and/or Master's degree in Computer Science, Machine Learning, AI, or equivalent practical experience
Deep understanding of modern LLMs, prompt-, context-, and system-level optimization, and agentic system design
Proven proficiency in Python, including writing production-quality, testable, and maintainable code
Experience building systems that integrate models with external tools, APIs, databases, and services
Ability to operate in ambiguous problem spaces, balancing research-driven approaches with pragmatic product constraints
Strong communication skills and comfort working in customer-facing or cross-functional environments
Preferred
Hands-on experience building AI agents using modern generative AI stacks (OpenAI APIs, commercial or open-source LLMs)
Experience with agent frameworks, orchestration layers, or workflow systems (e.g., tool calling, planners, multi-agent setups)
Familiarity with evaluation, monitoring, and observability for LLM-powered systems in production
Experience deploying ML systems in cloud environments and operating them at scale
Experience fine-tuning or adapting foundation models using methods like supervised fine-tuning (SFT), reinforcement learning with verifiable rewards (RLVR), and low-rank adaptation (LoRA) to improve agent performance on domain-specific tasks
Interest in shaping the future of general-purpose enterprise agents and their real-world impact
Benefits
Comprehensive health, dental and vision coverage
Retirement benefits
A learning and development stipend
Generous PTO
Commuter stipend
Company
Scale AI
Scale’s mission is to develop reliable AI systems for the world’s most important decisions.
501-1000 employees
H1B Sponsorship
Scale AI has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (82)
2024 (54)
2023 (29)
2022 (17)
2021 (10)
2020 (10)
Funding
Current Stage
Late StageTotal Funding
$15.9BKey Investors
MetaAccelDragoneer Investment Group,Greenoaks,Tiger Global Management
2025-06-10Corporate Round· $14.3B
2025-06-04Series Unknown
2024-05-21Series F· $1B
Leadership Team
Jason Droege
Interim Chief Executive Officer
Clemens Viernickel
Head of Product
Recent News
2026-01-16
CB Insights
2026-01-09
Company data provided by crunchbase