Signify Technology · 2 weeks ago
Senior Product Manager - Data Labelling and Evals
San Francisco, CA
Full-time
Onsite
Mid, Senior Level
3+ years expSignify Technology is seeking a Senior Product Manager to lead the development of their evaluation and data generation platform for large-scale AI systems. This role is central to ensuring the reliability, quality, and impact of models by driving how training and testing datasets are created, managed, and optimized.
Information TechnologyRecruiting
Responsibilities
Define the strategy, metrics, and architecture for model evaluation across AI agent behaviors
Partner with ML engineers, data scientists, and domain experts to design and maintain robust benchmarks
Build and manage workflows for labeling, QA, and data generation — both internal and with external vendors
Monitor dataset quality, identify gaps, and iterate on tools and processes to improve efficiency
Collaborate closely with training teams to align data feedback loops with product outcomes
Qualification
Required
3+ years of product management experience in AI/ML evaluation, labeling platforms, or data pipeline systems
Strong understanding of LLM or ML dataset development, especially for sensitive or high-impact applications
Hands-on experience with labeling operations, data QA, or vendor management for annotation workflows
Attention to detail in process design for human-in-the-loop systems
Ability to work cross-functionally in fast-moving, technical environments
Company
Signify Technology
Technology Recruitment Company
11-50 employees
H1B Sponsorship
Signify Technology has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
Funding
Current Stage
Early StageLeadership Team
Samantha Smylie
Global Head of Human Resources
Recent News
2025-04-12
Company data provided by crunchbase