This job has closed.

Myria · 3 weeks ago

Lead AI Agent Engineer (Prompting & Evaluation)

United States

Full-time

Remote

Entry, Mid Level

$160K/yr - $200K/yr

1+ years exp

Myria is a company that builds a private marketplace for the most successful individuals in the world. They are seeking a Lead AI Agent Engineer to refine global system prompts, design evaluations for prompt changes, and collaborate with engineering and product teams to integrate new tools into their AI mission control.

CommunitiesConsumerMarketplace

No H1B

Responsibilities

Refine the global system prompt and per-category prompts for Houston (our AI mission control), driving down errors and ambiguity

Design/run evals and regression tests for new prompt changes, tools, and MCP integrations

Build and maintain prompt kits, playbooks, and examples that cover real-world edge cases (classification, intent, safety, intake, ideation vs. request)

Collaborate with eng/product to wire new APIs/tools into the MCP server and ensure the agent uses them reliably

Ship fast: diagnose failures in production traces, patch prompts, validate with targeted evals, and land safe PRs

Qualification

LLMs experienceEvals/regression designPrompt engineeringRedwoodJS/TypeScript/GraphQLProduct senseMCP/tool orchestrationLuxury/concierge domain knowledgeCommunication