Meta · 2 weeks ago
Research Scientist Manager, MetaAI Assistant Measurement
New York, NY
Full-time
Onsite
Director/Executive
$213K/yr - $293K/yr
12+ years expMeta is a technology company that builds tools to help people connect and grow businesses. They are seeking a Research Scientist Manager to lead a team focused on developing measurement and evaluation paradigms for AI Assistants, ensuring alignment between model development and user value.
Computer Software
Responsibilities
Define and execute the scientific roadmap for measurement of AI Assistant with purpose, agility, and efficiency
Lead the development of innovative offline and online evaluation metrics, benchmarks, and data synthesis methodologies to drive model improvement and improve user experience
Partner closely with research, engineering, and product teams to integrate robust measurement into the model development lifecycle (the "evaluation flywheel")
Communicate, collaborate, and build relationships with clients and peer teams to facilitate cross-functional projects
Mentor and grow a team of Industry-Leading research scientists and applied scientists, fostering a of scientific rigor, impact, and success
Qualification
Required
12+ years of, or PhD + 8 years of hands-on experience in large language model, NLP, and Transformer modeling, in the setting of both research and engineering development
Experience and track record of landing large research and/or product impacts in a time-sensitive environment
2+ years of people-management experience leading research scientists or applied scientists
Proven technical vision in where the field of generative AI will go
Experience of and knowledge of online and offline measurement, benchmark building, and data synthesis
Experience with cross functional collaboration with other teams including non-engineering functions
Demonstrated experience recruiting, building, structuring, leading technical organizations, including performance management
Preferred
PhD or equivalent research experience in fields such as machine learning, statistics, econometrics, causal inference, computer science, optimization, or related areas
Experience developing evaluation frameworks for LLMs, multimodal models, or interactive assistants
Expertise in online measurement, user-behavior modeling, A/B testing, and experiment platform design
Experience building large-scale datasets and ontologies used for training or evaluation
Background in safety, alignment, content evaluation, or human-AI interaction
Ability to communicate complex ideas clearly to executives, product partners, and engineering stakeholders
Proven ability to build high-performing teams that thrive under ambiguity and rapid iteration
Experience with cross functional collaboration with other teams including non-technical functions
Demonstrated experience recruiting, building, structuring, leading technical organizations, including performance management
Benefits
Bonus
Equity
Benefits
Company
Meta
Meta's mission is to build the future of human connection and the technology that makes it possible.
10001+ employees
Funding
Current Stage
Late StageLeadership Team
Kathryn Glickman
Director, CEO Communications
Christine Lu
CTO Business Engineering NA
Recent News
Crunchbase News
2025-11-17
2025-11-16
Company data provided by crunchbase