Reflex Media, Inc. ยท 1 month ago
Senior Agent Engineer
United States
Full-time
Remote
Senior LevelReflex Media, Inc. is seeking a Senior AI Agent Engineer who is a strong software engineer with applied Machine Learning expertise. This role focuses on building, scaling, and evaluating robust AI agent workflows integrated into the company's core backend, leveraging LLMs and software best practices.
AdvertisingBrand MarketingMarketing
Responsibilities
Architect end-to-end AI agent systems capable of multi-step reasoning, planning, and self-correction. Design complex control flows (loops, conditionals, DAGs) rather than simple linear chains
Integrate agents seamlessly into production backends. Build robust integrations enabling agents to use APIs, databases, and vector stores with strict data validation
Design systems to manage agent context windows, conversation history, and long-term memory (Vector DBs) efficiently to balance performance and cost
Apply engineering rigor to agent reliability. Design evaluation pipelines (e.g., LLM-as-a-judge, functional unit tests) to quantify performance and handle the non-deterministic nature of LLMs
Optimize agent workflows for latency and token usage costs. Implement caching, retries, and async processing to ensure high throughput
Instrument code to provide deep visibility into agent reasoning steps (tracing), ensuring failures can be debugged in production environments
Extract data using SQL and Python and conduct comprehensive data analysis to identify trends, anomalies, and patterns
Qualification
Required
Education: Bachelor's or Master's in CS, AI, or equivalent practical experience
Software Engineering Mastery: Deep expertise in Python, system design, testing, Git, and deploying production-grade services. This is an engineering-heavy role
Backend Infrastructure: Proven experience developing and maintaining backend infrastructure (AWS/Azure/GCP) and containerization (Docker/Kubernetes)
Agentic Frameworks: Hands-on experience with frameworks such as LangChain, LlamaIndex, LangGraph, CrewAI, or AutoGen
Applied ML & RAG: Experience with grounding techniques (RAG, vector search), prompt engineering, and utilizing Embeddings APIs
Evaluation Rigor: Experience building automated evaluation harnesses to test agent logic against 'Golden Datasets.'
Problem-Solving: Excellent analytical skills to debug complex, non-deterministic system failures
Team Mentorship: Ability to inspire, motivate, and mentor fellow team members through activities such as code reviews and technical meetings
Preferred
Familiarity with neural network fundamentals (e.g., Transformers)
Experience with LLM Observability tools (e.g., LangSmith, Arize Phoenix)
Understanding of LLM security (e.g., prompt injection defense)
Company
Reflex Media, Inc.
Reflex Media is a next-generation high-tech marketing company led by our Founder & CEO, an MIT alumni.
Founded in 2015
51-200 employees
Funding
Current Stage
Growth StageLeadership Team
Ruben Buell
Chief Operations Officer & Chief Technology Officer
Company data provided by crunchbase