Roblox · 2 days ago
Senior Data Scientist - Generative AI
San Mateo, CA
Full-time
Hybrid
Senior Level
$220K/yr - $262K/yr
5+ years expRoblox is a platform that empowers millions of users to create and share immersive experiences. As a Senior Data Scientist, you will focus on enhancing user-facing Generative AI systems and improving engineering efficiency through data-driven insights and rigorous experimentation.
3D TechnologyGamingMetaverseOnline GamesSoftwareVideo Games
Responsibilities
Develop Evaluation Frameworks: Design and operationalize rigorous evaluation systems for either GenAI features (text, image, video, 3D, 4D) or internal AI Agents (Code Review, Refactor, Test Gen). This includes eval experiment design, dataset design, label reliability analysis, and implementing and finetuning LLM-as-judge methods
Run Rigorous Experiments: Conduct online experiments (A/B tests) and causal inference to quantify the impact of GenAI features or AI-assisted coding tools. You will identify opportunities, measure lift, and ensure statistical rigor
Define Success Metrics: Partner with cross-functional teams to define leading/lagging indicators—whether for GenAI safety and user satisfaction, or for engineering productivity and code health
Build Automated Systems: Research and apply state-of-the-art methodologies to build reproducible evaluation tooling and agentic workflows that lift rigor and efficiency across the company
Drive Strategy & Visibility: Develop dashboards and reporting frameworks that reveal trends (e.g., model performance or developer friction) and translate complex data into clear, prioritized recommendations for leadership
Qualification
Required
Advanced Degree: PhD or Master's in Statistics, Economics, Computer Science, Applied Math, Physics, Engineering, or a related quantitative field
Experience: 5+ years of experience in data science, analytics, or a quantitative role
Technical Proficiency: Strong proficiency in SQL (Hive/Spark) for manipulating large datasets and scripting languages (Python or R) for analysis and modeling
Experimentation and Causal Inference: A solid grounding in experimentation, causal inference, and statistical analysis, including test design and metric design for feature impact
Problem Solving: A demonstrated track record of framing ambiguous problems, designing analytical approaches, and solving open-ended data science problems that drive business impact
Learning Agility: Ability to effectively and responsibly use AI tools to enhance productivity and a passion for continuously improving methods in a fast-evolving field
GenAI Familiarity: Familiarity with GenAI models and safety/quality evaluation methods. Expertise in the model training lifecycle is a plus (e.g., fine-tuning, RLHF, or synthetic data generation)
Engineering Development Workflow: Experience with engineering development workflows and engineering efficiency data is a plus for the Engineering Efficiency and Code Intelligence role
Applied Research Background: A track record of applied research or publications in relevant technical fields is highly valued
Benefits
Equity compensation
Benefits as described on this page
Company
Roblox
Roblox is an online gaming and entertainment platform that offers a shared digital experience that brings people together through play.
1001-5000 employees
H1B Sponsorship
Roblox has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (240)
2024 (111)
2023 (139)
2022 (153)
2021 (91)
2020 (92)
Funding
Current Stage
Public CompanyTotal Funding
$874.45MKey Investors
Andreessen HorowitzAltos Ventures
2024-10-01Post Ipo Equity
2022-04-12Series Unknown· $17.71M
2021-08-11Series Unknown
Leadership Team
David Baszucki
Founder and CEO
Michael Guthrie
CFO
Recent News
2026-01-08
2026-01-08
2026-01-08
Company data provided by crunchbase