University of Chicago · 1 month ago
Machine Learning Validation & Data Operations Manager
The University of Chicago is focused on promoting cognitive and social-emotional development in young children through the TMW Center. The ML Validation & Data Operations Manager will lead operations for algorithm improvement and validation, collaborating with various teams to ensure efficient data management and integration.
Higher Education
Responsibilities
Lead data labeling effort to build ground-truth corpus for existing and future algorithms, including identifying data requirements and protocols
Determine validation criteria and metrics across models and settings/partnerships/use cases
Collaborate with data management teams, and application development teams to identify and capture the data necessary to perform validation
Recruit, train, and lead a team of data labelers
Ensure alignment between the validation roadmap and Center’s priorities
Establish timelines and strategies for the validation of different algorithms
Work with ML and engineering teams to develop and manage pipelines for continuous algorithm validation and optimization
Promote advances in, and creative ML solutions for validation and data management enhancement (e.g., automation of protocols and training pipelines)
Build quality assurance processes to continuously assess reliability of data
Maintain comprehensive records of data sources, methodologies, and results
Establish best practice-based processes related to reproducibility, documentation, and version control
Investigates, analyzes and resolves day-to-day technical problems using standard procedures
Works with stakeholders to gather and analyze requirements for developmental programs. Receives a moderate level of guidance to design applications to meet University and business requirements
Performs code testing on components and works to ensure that appropriate implementation standards are met. Evaluates design alternatives for development cost and solutions using various methods
Supports and maintains existing applications. Works with web developers and responds to requests from users
Performs other related work as needed
Qualification
Required
Minimum requirements include a college or university degree in related field
Minimum requirements include knowledge and skills developed through 2-5 years of work experience in a related job discipline
Resume (required)
Preferred
Advanced Degree in economics, data science, data analytics, computer science, software engineering or related fields strongly preferred
Knowledge and skills developed through 5 years of work experience in a related job discipline, strongly preferred
2 years of experience managing people, strongly preferred
Prior experience setting up data labeling and validation processes
Demonstrated understanding of data science management, Machine Learning and Data operations
Experience building out ML operations teams and processes
Experience with statistical modeling and programming
Demonstrated ability to work independently with little supervision
Excellent strategic planning and execution skills
Strong problem-solving skills
Ability to balance short-term, long-term, and big picture objectives
Benefits
The University of Chicago offers a wide range of benefits programs and resources for eligible employees, including health, retirement, and paid time off.
Company
University of Chicago
One of the world’s great intellectual destinations, the University of Chicago empowers scholars and students to ask tough questions, cross disciplinary boundaries, and challenge conventional thinking to enrich human life around the globe.
H1B Sponsorship
University of Chicago has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (341)
2024 (318)
2023 (285)
2022 (233)
2021 (179)
2020 (172)
Funding
Current Stage
Late StageRecent News
2025-11-08
San Gabriel Valley Tribune
2025-10-23
Company data provided by crunchbase