Roblox · 1 month ago
Senior Data Scientist - Generative AI
San Mateo, CA, United States
Full-time
Onsite
Senior Level
$217K/yr - $258K/yr
5+ years expRoblox is a platform that allows millions to create and connect through immersive digital experiences. They are seeking a Senior Data Scientist specializing in Generative AI to develop evaluation frameworks and enhance model performance, focusing on improving user interactions and product quality.
3D TechnologyGamingMetaverseOnline GamesSoftwareVideo Games
Responsibilities
Develop and improve evaluation frameworks for GenAI features (text, image, 3D, 4D, agentic workflow), including eval experiment design, eval dataset design, label reliability analysis, results analysis, and online evaluation based on user behavior and feedback
Establish best practices and guidelines for GenAI evaluation
Conduct product analytics, online experiments (A/B tests) and causal analyses to quantify GenAI feature impact and identify opportunities
Build automated evaluation systems, such as research and implement LLM-as-judge and VLM-as-judge methods
Research and apply state-of-the-art methodologies in GenAI evaluation
Advance reproducible evaluation tooling to lift evaluation rigor and efficiency at the company
Proactively explore and develop solutions to improve the AI model and data generation flow, ensuring high-quality input for training and deployment
Design and implement agentic workflows and AI agents to enable teams to effectively access data, extract data insights, and follow best data practices
Partner closely with cross-functional teams to align goals, plans, and execution
Qualification
Required
An advanced Degree and/or PhD in Statistics, Economics, Operations Research, Computer Science, Applied Math, Physics, Engineering, or another quantitative field
5+ years of experience in data science or a related field
Familiarity with GenAI models and GenAI evaluation methods
Passion for the GenAI field and enthusiasm for continuously improving methods and practices to drive product quality and business impact
Ability to effectively use AI tools to enhance productivity in research, ideation, coding, and documentation
Proficiency in SQL, Hive, or Spark for transforming and manipulating large datasets
Experience with scripting languages such as Python or R
A demonstrated track record of solving open-ended data science and modeling problems that drive business impact and improve user experience
Preferred
Strong learning agility, experience conducting applied research or writing technical papers is a plus
Benefits
Equity compensation
Company
Roblox
Roblox is an online gaming and entertainment platform that offers a shared digital experience that brings people together through play.
1001-5000 employees
H1B Sponsorship
Roblox has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (240)
2024 (111)
2023 (139)
2022 (153)
2021 (91)
2020 (92)
Funding
Current Stage
Public CompanyTotal Funding
$874.45MKey Investors
Andreessen HorowitzAltos Ventures
2024-10-01Post Ipo Equity
2022-04-12Series Unknown· $17.71M
2021-08-11Series Unknown
Leadership Team
David Baszucki
Founder and CEO
Michael Guthrie
CFO
Recent News
2026-01-08
2026-01-08
2026-01-08
Company data provided by crunchbase