Skyrocket Ventures · 1 week ago
Founding Agentic AI Software Engineer - Hypergrowth Social AI Startup
San Francisco, CA
Full-time
Hybrid
Senior LevelSkyrocket Ventures is a recruiting firm for high growth technology companies, and they are seeking a Founding Agentic AI Software Engineer for a hypergrowth social AI startup. The role involves shipping agentic matchmaking systems, optimizing AI chat systems, and collaborating with cofounders to translate user problems into agent behaviors.
EmploymentRecruiting
No H1B
Hiring Manager
Matthew Strassberg
Responsibilities
Ship agentic matchmaking from research to production - owning the end-to-end loop (retrieval, reasoning, tool use, safety) and driving measurable accuracy improvements
Building a prompt & model evaluation harness (offline + online) to compare prompts/models/policies, supporting A/B testing, and enabling fast iteration
Optimizing AI chat systems for lower latency, higher perceived “human-likeness,” and more consistent outcomes across providers
Designing and maintaining context engineering pipelines (RAG, memory, summarization, compression, grounding) for conversations and matchmaking
Standing up observability for agents (traces, costs, failures, hallucinations, guardrails) and creating dashboards that guide product decisions
Collaborating daily with the cofounders and product to translate user problems into agent behaviors, experiments, and shipped features
Creating small internal tools and SDKs other engineers (and AIs) will use
Qualification
Required
Self driven, self starter
Builder's mindset: thrives with ambiguity, ships quickly, debugs systematically, and sweats the user experience
Expertise with LLMs, as demonstrated clearly on your resume via professional experience or standout personal projects
Experience building with multiple LLM providers and tool-calling/function-calling; comfortable swapping models and orchestrating fallbacks
Hands-on with RAG (indexing, chunking, embeddings, reranking) and context engineering for reliability and cost/latency trade-offs
Strong programming foundations (data structures, algorithms, testing, profiling)
Practical prompt engineering and prompt libraries; can reason about failure modes and systematically improve prompts/policies
Ability to define metrics/KPIs (accuracy, latency, cost, safety), run A/B tests, and loop in human feedback for quality
Comfortable with MongoDB in production
Preferred
Familiarity with vector databases (e.g., pgvector/Redis/Pinecone/Weaviate)
MCP (Model Context Protocol)
Agent frameworks (LangGraph/CrewAI/Assistants)
LLM observability/evals (e.g., Langfuse/Promptfoo/Ragas/TruLens)
Retrieval & embeddings know-how, safety/guardrails/red-teaming
Company
Skyrocket Ventures
Skyrocket Ventures is a recruiting firm for high growth technology companies in the San Francisco Bay Area.
Founded in 2010
11-50 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase