Meta · 17 hours ago
Research Engineering Manager, Evaluations, Meta Superintelligence Labs
Meta is seeking a Research Engineering Manager to lead the Evaluations team within Meta Superintelligence Labs. This leadership role involves guiding a team of research engineers to build benchmarks for advanced AI models and collaborating with researchers to define the strategic vision for evaluation infrastructure.
Computer Software
Responsibilities
Build, mentor, and grow a team of research engineers and scientists focused on evaluation infrastructure and benchmarking
Conduct performance reviews, career development conversations, and provide technical mentorship to team members
Foster a culture of engineering excellence, research rigor, and rapid iteration within the team
Partner with recruiting to hire world-class research engineering talent
Curate and integrate publicly available and internal benchmarks to direct the capabilities of frontier model development
Oversee the development and implementation of evaluation environments, including environments for novel model capabilities and modalities
Establish partnerships with external data vendors to source and prepare high-quality evaluation datasets
Influence the technical roadmap for evaluation infrastructure in collaboration with MSL Infra team
Translate the technical vision of research scientists into actionable engineering plans and execution strategies
Partner with research scientists, product teams, and other engineering teams to align evaluation priorities with organizational goals
Build robust, reusable evaluation pipelines that scale across multiple model lines and product areas
Drive the development of evaluation tooling that measures the quality and reliability of evaluation suites
Communicate technical progress, challenges, and strategic decisions to leadership
Maintain technical credibility through hands-on contributions to critical evaluation projects (20-30% of time)
Review code, provide technical guidance, and unblock complex technical challenges
Set engineering standards and best practices for the team
Follow best software engineering practices including version control, testing, code review, and system design
Qualification
Required
Bachelor's or Master's degree in Computer Science, Machine Learning, or a related technical field
4+ years of experience in machine learning engineering, machine learning research, or a related technical role
3+ years of experience managing or leading technical teams, including hiring, mentoring, and performance management
Proficiency in Python and experience with ML frameworks such as PyTorch
Proven track record of leading medium to large-scale technical projects from conception to deployment
Demonstrated experience balancing hands-on technical work with people management and strategic planning
Clear communication and experience influencing cross-functional stakeholders
Preferred
Publications at peer-reviewed venues (NeurIPS, ICML, ICLR, ACL, EMNLP, or similar) related to language model evaluation, benchmarking, or deep learning
Hands-on experience with language model post-training and deep learning systems, or building reinforcement learning environments
Experience implementing or developing evaluation benchmarks for large language models and multimodal models (e.g., vision-language, audio, video)
Experience building and scaling large-scale distributed systems and data pipelines
Familiarity with language model evaluation frameworks and metrics
Track record of open-source contributions to ML evaluation tools or benchmarks
Experience managing teams in fast-paced research or startup environments
PhD in Computer Science, Machine Learning, or related field
Benefits
Bonus
Equity
Benefits
Company
Meta
Meta's mission is to build the future of human connection and the technology that makes it possible.
Funding
Current Stage
Late StageRecent News
Crunchbase News
2025-11-17
2025-11-16
Company data provided by crunchbase