METR ยท 2 months ago
Human Data Lead
METR is a nonprofit research organization focused on assessing AI capabilities and risks. The Human Data Lead will be responsible for leading human data collection efforts critical for generating evidence about AI progress and will work closely with researchers to develop data analysis plans.
Artificial Intelligence (AI)CharityNon Profit
Responsibilities
Work with researchers to write clear specifications and data analysis plans for research involving human data
Design, build, and maintain end-to-end processes for human data collection and analysis
Strategize between METR's many competing human data needs
Build and manage external partnerships
Manage participant recruitment, coordination, and experience
Use the systems you build to execute human data campaigns
Qualification
Required
Strong operational and project management capabilities
Python fluency
Excellent communication skills for managing diverse stakeholders
Work with researchers to write clear specifications and data analysis plans for research involving human data
Design, build, and maintain end-to-end processes for human data collection and analysis
Strategize between METR's many competing human data needs
Build and manage external partnerships
Manage participant recruitment, coordination, and experience
Use the systems you build to execute human data campaigns
Preferred
DevOps experience
Statistical analysis and data visualization skills
Familiarity with relevant machine learning or social science literature and methods
Experience recruiting and managing contractors or research participants
Well-calibrated expectations around project timelines
Good instincts for staying close to the data, testing systems before you launch, reviewing incoming data, spotting issues early
Strong prioritization skills in ambiguous environments
Company
METR
METR is a research non-profit that develops evaluations to empirically test AI systems for capabilities that could threaten catastrophic harm to society.
H1B Sponsorship
METR has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (6)
2024 (2)
Funding
Current Stage
Early StageCompany data provided by crunchbase