AI Platform Engineer, Applied AI jobs in United States
cer-icon
Apply on Employer Site
company-logo

ChatGPT Jobs · 22 hours ago

AI Platform Engineer, Applied AI

Circle is building an all-in-one platform for online communities, and they are seeking an AI Platform Engineer to help establish the foundation for measuring, diagnosing, and improving AI system speed and performance. This role focuses on production AI systems and involves building evaluation infrastructure, creating observability tooling, and analyzing customer usage of AI features.

Computer Software

Responsibilities

Build evaluation infrastructure to measure AI system speed and accuracy
Create observability tooling and dashboards
Diagnose quality gaps in AI systems
Experiment with different models and agent configurations
Prototype and validate improvements to our RAG pipeline
Analyze how customers are using AI features
Work closely with other engineers to improve quality
Stay up-to-date with AI research, techniques, and tools

Qualification

AI systems evaluationPythonRAG architectureRuby on RailsData analysisExperimentation skillsEnglish proficiencyFast-paced environment

Required

Experience building and evaluating AI systems in production (RAG pipelines, search / retrieval systems, LLM-powered applications)
Proficiency in Python
Openness to learning Ruby on Rails
Comfortable building infrastructure and tooling
Deep understanding of RAG architecture
Strong experimentation and data analysis skills
Ability to work in a fast-paced environment with ambiguity
Alignment with company values
Proficient in English (C2/ILR Level 5)

Preferred

Experience with evaluation frameworks (Braintrust, LangSmith, or similar)

Benefits

PTO
Fully remote work from anywhere.
Autonomy and trust.
35 days of PTO annually and paid sabbatical after 5 years.
Awesome medical coverage!
Parental leave.
Home office stipend.
Learning & development stipend.
Annual bonus potential.
Company retreats twice a year.

Company

ChatGPT Jobs

twitter
company-logo
We find the best job offers for experts in ChatGPT and related technologies.

Funding

Current Stage
Early Stage
Company data provided by crunchbase