Meta · 3 days ago
Data Scientist, GenAI
Wonder how qualified you are to the job?
Internet
Insider Connection @Meta
Responsibilities
Leverage internal tools and external APIs to run existing evaluations on Llama models and key competitors to benchmark our performance against the competition.
Work to operationalize and standardize the evaluation process to make it faster and more reliable. Consult with DE on data infra/dashboarding and building eval datasets
Extract insights from evaluations and competitor comparisons to feed back into model training and development
Work with research to develop new frontier evals, both to measure new modalities/capabilities (e.g., agentic models, speech generation, video generation) and to better assess core existing capabilities like coding, math, general knowledge
Do foundational work to assess how we can measure AGI
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
7+ years of work experience leading analytics work in IC capacity, working collaboratively with Engineering and cross-functional partners, and guiding data-influenced product planning, prioritization and strategy development
Experience working effectively with multiple stakeholders and cross-functional teams, including Engineering, PM/TPM, Analytics and Finance
Experience framing and communication skills
Intellectual curiosity and drive, decisiveness, with ambiguity and complexity
Experience doing product analytics on consumer facing digital products, or working on AI Infra and Privacy related products.
Preferred
Experience working with researchers and infrastructure teams.
Experience with Python.
Experience with predictive modeling, machine learning, and experimentation/causal inference methods.
Masters or Ph.D. Degree in a quantitative field
Company
Meta
Meta builds technologies that help people connect, find communities, and grow businesses.
H1B Sponsorship
Meta has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Trends of Total Sponsorships
2023 (2750)
2022 (5507)
2021 (798)
Funding
Current Stage
Late StageRecent News
2024-05-14
Android Authority
2024-05-14
Company data provided by crunchbase