Biological Sciences Division at the University of Chicago · 4 weeks ago
Machine Learning Validation & Data Operations Manager
Chicago, IL
Full-time
Hybrid
Mid, Senior Level
$80K/yr - $120K/yr
2+ years expThe Biological Sciences Division at the University of Chicago is focused on developing evidence-based interventions for early childhood development. The ML Validation & Data Operations Manager will oversee operations for continuous algorithm improvement and validation, collaborating with various teams to ensure effective data management and integration.
Higher Education
Responsibilities
Lead data labeling effort to build ground-truth corpus for existing and future algorithms, including identifying data requirements and protocols
Determine validation criteria and metrics across models and settings/partnerships/use cases
Collaborate with data management teams, and application development teams to identify and capture the data necessary to perform validation
Recruit, train, and lead a team of data labelers
Ensure alignment between the validation roadmap and Center’s priorities
Establish timelines and strategies for the validation of different algorithms
Work with ML and engineering teams to develop and manage pipelines for continuous algorithm validation and optimization
Promote advances in, and creative ML solutions for validation and data management enhancement (e.g., automation of protocols and training pipelines)
Build quality assurance processes to continuously assess reliability of data
Maintain comprehensive records of data sources, methodologies, and results
Establish best practice-based processes related to reproducibility, documentation, and version control
Investigates, analyzes and resolves day-to-day technical problems using standard procedures
Works with stakeholders to gather and analyze requirements for developmental programs. Receives a moderate level of guidance to design applications to meet University and business requirements
Performs code testing on components and works to ensure that appropriate implementation standards are met. Evaluates design alternatives for development cost and solutions using various methods
Supports and maintains existing applications. Works with web developers and responds to requests from users
Performs other related work as needed
Qualification
Required
Minimum requirements include a college or university degree in related field
Minimum requirements include knowledge and skills developed through 2-5 years of work experience in a related job discipline
Resume (required)
Preferred
Advanced Degree in economics, data science, data analytics, computer science, software engineering or related fields strongly preferred
Knowledge and skills developed through 5 years of work experience in a related job discipline, strongly preferred
2 years of experience managing people, strongly preferred
Prior experience setting up data labeling and validation processes
Demonstrated understanding of data science management, Machine Learning and Data operations
Experience building out ML operations teams and processes
Experience with statistical modeling and programming
Demonstrated ability to work independently with little supervision
Excellent strategic planning and execution skills
Strong problem-solving skills
Ability to balance short-term, long-term, and big picture objectives
Benefits
Health
Retirement
Paid time off
Company
Biological Sciences Division at the University of Chicago
As part of the University of Chicago, the Biological Sciences Division (BSD) pursues globally impactful solutions to seemingly unsolvable challenges.
1001-5000 employees
Funding
Current Stage
Late StageCompany data provided by crunchbase