Be an early applicantLess than 25 applicants

Company

Original Job Post

Meta · 3 days ago

Data Scientist, GenAI

Menlo Park, CA

Full-time

Onsite

Senior Level

7+ years exp

Wonder how qualified you are to the job?

Maximize your interview chances

Internet

Comp. & Benefits

Insider Connection @Meta

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Leverage internal tools and external APIs to run existing evaluations on Llama models and key competitors to benchmark our performance against the competition.

Work to operationalize and standardize the evaluation process to make it faster and more reliable. Consult with DE on data infra/dashboarding and building eval datasets

Extract insights from evaluations and competitor comparisons to feed back into model training and development

Work with research to develop new frontier evals, both to measure new modalities/capabilities (e.g., agentic models, speech generation, video generation) and to better assess core existing capabilities like coding, math, general knowledge

Do foundational work to assess how we can measure AGI

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Product planningStrategy developmentStakeholder managementProduct analyticsAI infrastructurePrivacy productsProblem-solvingCollaborationCommunicationIntellectual curiosityDecisivenessPythonPredictive ModelingMachine LearningCausal Inference

Required

Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.

7+ years of work experience leading analytics work in IC capacity, working collaboratively with Engineering and cross-functional partners, and guiding data-influenced product planning, prioritization and strategy development

Experience working effectively with multiple stakeholders and cross-functional teams, including Engineering, PM/TPM, Analytics and Finance

Experience framing and communication skills

Intellectual curiosity and drive, decisiveness, with ambiguity and complexity

Experience doing product analytics on consumer facing digital products, or working on AI Infra and Privacy related products.

Preferred

Experience working with researchers and infrastructure teams.

Experience with Python.

Experience with predictive modeling, machine learning, and experimentation/causal inference methods.

Masters or Ph.D. Degree in a quantitative field

Company

H1B Sponsorship

Meta has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Trends of Total Sponsorships

2023 (2750)

2022 (5507)

2021 (798)