Senior Python Engineer- Evaluations jobs in United States
cer-icon
Apply on Employer Site
company-logo

MagicSchool AI · 2 months ago

Senior Python Engineer- Evaluations

MagicSchool AI is the premier generative AI platform for teachers, aiming to make a real social impact. As a Senior Python Engineer- Evaluations, you will contribute to the Trust, Safety and Quality team by expanding Generative AI Evaluations capabilities through application and data engineering, ensuring safety, quality, and user impact.

Artificial Intelligence (AI)E-LearningEdTechEducation

Responsibilities

Ensure we're building the safest product MagicSchool can build
Build tools and processes for evaluating MagicSchool output at scale
Stay up to date on the latest tools and literature
Passionate about solving education problems with technology
Work closely with Evaluations product manager, team lead, data scientist and engineer and deliver high quality features
Design, architect, and write high quality code to expand our Evaluations framework's capabilities
Debug complex code and applications in a cloud environment
Build software that is easy for others to understand and easy to maintain
Data modeling in a relational database, data warehouse, and object stores
Assess and help the team choose appropriate third party solutions to problems when building doesn't make sense
Work cross-functionally to integrate MagicSchool's evaluations platform with the larger application

Qualification

PythonSQL (PostgreSQL)DockerData modelingAWSResourcefulnessLLMsTypeScriptReactCommunicationTeam collaborationAdaptabilityEmotional intelligence

Required

Working knowledge of SQL (PostgreSQL) and database design / data modeling
Expert knowledge of Python
Modern Python features like typehints and asyncio
Python Multiprocessing to support evaluation jobs in the 10s to 100s of thousands per run
Familiarity with Pydantic
Strong communication skills: team-first mindset, highly collaborative, can articulate decisions within team's context
Experience working with and deploying docker applications
Builds relationships easily: emotionally intelligent, communication, warm
Gets a lot done: Works hard, resourceful, do whatever it takes
Adaptable: Smart, learns fast, curious
7+ years as an engineer, 2 of which were at senior level or above
Start up experience
Experience with LLMs and Generative AI APIs and systems

Preferred

Experience with evaluating generative AI systems
TypeScript and React (useful for internal tooling and cross-team contributions)
AWS experience (bedrock, E(C|K)S)

Benefits

Unlimited time off to empower our employees to manage their work-life balance.
Choice of employer-paid health insurance plans so that you can take care of yourself and your family.
Dental and vision are also offered at very low premiums.
Every employee is offered generous stock options, vested over 4 years.
401k match & monthly wellness stipend.

Company

MagicSchool AI

twittertwittertwitter
company-logo
MagicSchool is an AI platform in education and growing technology for schools.

Funding

Current Stage
Growth Stage
Total Funding
$62.4M
Key Investors
Valor Equity PartnersBain Capital VenturesRange Ventures
2025-02-04Series B· $45M
2024-06-27Series A· $15M
2023-08-28Pre Seed· $2.4M

Leadership Team

leader-logo
Adeel Khan
Founder & CEO
linkedin
leader-logo
Mike Biven
President
linkedin
Company data provided by crunchbase