Essential AI · 5 months ago
Member of Technical Staff: Research Engineer, Pre-Training
San Francisco
Full-time
Onsite
Mid Level
$225K/yr - $250K/yrEssential AI is building an open platform to fuel and accelerate AI breakthroughs globally. The Research Engineer, Pre-Training will design and implement novel pre-training approaches for powerful foundation models, collaborating closely with research teams to identify challenges and develop new techniques.
Artificial Intelligence (AI)Information TechnologySoftware
Responsibilities
You will be a core contributor to our research bets that advance the real-world capabilities of our models
You will collaborate closely across the research engineering stack to close the loop between research and execution, identify capability gaps, and evaluate progress
Lead long-term research initiatives focused on pre-training models. Work closely with research engineers to prototype, understand, implement, and deploy novel techniques to improve the capabilities of our models
Develop novel algorithms and methodologies for pre-training models, ensuring scalability, efficiency, and effectiveness
Design, develop, and optimize machine learning models and prototypes, ensuring high performance, scalability, and robustness
Stay close to the latest advancements in pre-training techniques, incorporating relevant findings into research directions
Qualification
Required
Self-motivated and takes a proactive approach to constantly iterate by continuously experimenting, inferring, and deciding the right set of next experiments
Research experience with a focus on pre-training and building large language models using frameworks such as Megatron, DeepSpeed, MaxText, etc
You have strong ML fundamentals and first principles thinking that guides your approach to research
You have experience in coming up with new methods or improving existing techniques in ML or related fields
Proficiency in programming languages such as Python and frameworks such as JAX, PyTorch or TF
Experience with data engineering and preprocessing, in particular, optimization of data pipelines, feature engineering, and model evaluation, is beneficial
Strong problem-solving, analytical, communication, and collaboration skills with the ability to analyze complex datasets and derive actionable insights
Ability to prototype and deploy pre-trained models in production environments
You enjoy building things from the ground up in a fast-paced, collaborative environment
Benefits
Equity
401(k)
Health benefits
Monthly wellness & education stipend
Daily onsite lunches and snacks
Company
Essential AI
Essential AI creates AI solutions that enhance efficiency through the automation of labor-intensive and repetitive workflows.
Founded in 2023
11-50 employees
H1B Sponsorship
Essential AI has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2024 (1)
2023 (1)
Funding
Current Stage
Early StageTotal Funding
$64.5MKey Investors
March CapitalThrive Capital
2023-12-12Series A· $56.5M
2023-05-04Seed· $8M
Recent News
2025-02-25
21st CENTURY CHRONICLE
2025-02-25
Company data provided by crunchbase