Amazon · 1 day ago
Applied Science Manager, Artificial General Intelligence
Boston, MA
Full-time
Onsite
Mid, Senior Level
$184K/yr - $249K/yr
4+ years expAmazon is seeking an Applied Science Manager for their Artificial General Intelligence team to lead a group of Applied Scientists in ensuring the highest standards of data quality. The role involves managing quality strategies, overseeing auditing frameworks, and enhancing customer experiences through high-quality training data for Large Language Models.
Artificial Intelligence (AI)DeliveryE-CommerceFoundational AIRetail
Responsibilities
Lead and mentor a team of Applied Scientists who develop comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows
Guide the team in designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that align with core scientist team developing Amazon Nova models
Oversee expert-level manual audits, meta-audits to evaluate auditor performance, and provide coaching to uplift overall quality capabilities across the team
Manage the development and maintenance of LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment
Oversee the configuration of data collection workflows and ensure effective communication of quality feedback to stakeholders
Recruit, hire, and develop team members, conduct performance reviews, set clear expectations and growth plans, and foster a culture of scientific excellence and innovation
Communicate with senior leadership, cross-functional technical teams, and customers to collect requirements, describe product features and technical designs, and articulate product strategy
Lead quality solution design, guide root cause analysis on data quality issues, drive research into new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards
Work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice
Conduct regular 1:1s with team members, provide mentorship and coaching, and ensure the team delivers high-impact results aligned with organizational goals
Qualification
Required
2+ years of team management experience
Master's degree in engineering, technology, computer science, machine learning, robotics, operations research, statistics, mathematics or equivalent quantitative field
2+ years of machine learning, statistical modeling, data mining, and analytics techniques experience
2+ years of building machine learning models or developing algorithms for business application experience
3+ years of programming in Java, C++, Python or related language experience
Preferred
Experience communicating with users, other technical teams, and management to collect requirements, describe software product features, and technical designs
3+ years of scientists or machine learning engineers management experience
Ph.D. in engineering, technology, computer science, machine learning, robotics, operations research, statistics, mathematics or equivalent quantitative field
Have publications at top-tier peer-reviewed conferences or journals
4+ years of solving business problems through machine learning, data mining and statistical algorithms experience
Experience with Machine Learning and Large Language Model fundamentals, including architecture, training/inference lifecycles, and optimization of model execution, or experience in developing and deploying LLMs in production on GPUs, Neuron, TPU or other AI acceleration hardware
Benefits
Health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
401(k) matching
Paid time off
Parental leave
Company
Amazon
Amazon is a tech firm with a focus on e-commerce, cloud computing, digital streaming, and artificial intelligence.
10001+ employees
H1B Sponsorship
Amazon has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (22803)
2024 (21175)
2023 (19057)
2022 (24088)
2021 (12233)
2020 (14881)
Funding
Current Stage
Public CompanyTotal Funding
$8.11BKey Investors
AmazonKleiner Perkins
2023-01-03Post Ipo Debt· $8B
2001-07-24Post Ipo Equity· $100M
1997-05-15IPO
Leadership Team
Douglas J. Herrington
CEO, Worldwide Amazon Stores
Werner Vogels
VP & CTO
Recent News
2026-01-22
2026-01-22
2026-01-22
Company data provided by crunchbase