Caddie AI ยท 10 hours ago
Member of Technical Staff (Applied ML)
San Francisco, CA
Full-time
Onsite
Mid LevelCaddie AI is a stealth-mode AI research company focused on developing systems that teach AI models about quality and subjective judgment. The Machine Learning Research Engineer will drive research at the intersection of AI and creativity, owning experiments and collaborating with top AI labs.
Internet
Responsibilities
Train reward models, classifiers, and verifiers for subjective domains (design, writing, visual style)
Develop novel evaluations and benchmarks for taste, quality, and subjective judgment
Run post-training experiments on open-source models to test new data formats and techniques
Apply and extend post-training methods such as SFT, RLHF, and DPO
Collaborate with AI labs and creative experts on pilots and research initiatives
Own the end-to-end research pipeline from data to deployment
Publish findings through blogs, whitepapers, and research artifacts
Qualification
Required
Experience in ML research, applied ML, or ML research engineering
Hands-on experience post-training large models (LLMs or diffusion models required)
Strong familiarity with modern architectures (transformers, multimodal models)
Experience with SFT, RLHF, DPO, or related techniques
Ability to think like a researcher and execute like an engineer
Comfort operating in ambiguity and undefined problem spaces
Demonstrated creative thinking or background
Experience working on creative products, personalization, or subjective systems
Creative side projects, hobbies, or academic focus are strong signals
Deep motivation to improve AI quality, judgment, and taste
Benefits
Competitive compensation
Meaningful equity
Visa sponsorship available in select cases
Company
Caddie AI
Caddie AI is the global hiring marketplace built for tech startups.
Founded in 2024
2-10 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase