Senior Software Engineer, AI Agents jobs in United States
cer-icon
Apply on Employer Site
company-logo

The General Intelligence Company of New York · 2 hours ago

Senior Software Engineer, AI Agents

positionNYC Metro Area
timeFull-time
remoteHybrid
seniorityMid, Senior Level
money$250K/yr - $300K/yr
date4+ years exp

The General Intelligence Company of New York is seeking a Senior Software Engineer specializing in AI Agents. The role involves owning core backend systems and applied LLM work to enhance agent reliability and autonomy, while also building evaluation pipelines and deploying improvements that impact user outcomes directly.

Artificial Intelligence (AI)Business Process Automation (BPA)Information Technology
check
H1B Sponsor Likelynote

Responsibilities

Design and implement agent improvements end-to-end: prompting strategies, tool selection, action planning, memory usage, safety/guardrails, and recovery paths
Build robust evaluation pipelines for the agent: offline evals (golden tasks, regression suites, behavior tests), online metrics (latency, success rate, fallout modes, cost efficiency), and experimentation frameworks (A/B, canaries, guardrail thresholds)
Productionize applied LLM techniques: function/tool-calling orchestration, self-reflection, retrieval/RAG, multi-agent handoffs, caching/embedding strategies, and hallucination reduction
Improve core backend systems: reliable job orchestration, retries/backoff, idempotency, and auditability; scalable memory and context routing; data pipelines across Gmail, Slack, Notion, Linear, Google Workspace, etc.; observability and tracing for agent actions/outcomes
Partner with product and infra to define success metrics and ship fast, safe iterations
Write clean, well-tested code; document design decisions and runbooks

Qualification

Backend engineeringLLM experienceEvaluation designDistributed systemsPythonData pipelinesDebugging skillsExperimentationDocumentation

Required

4+ years backend engineering experience, preferably Python (we care about impact over years)
Hands-on LLM experience: prompt engineering, function-calling, retrieval, embeddings, evaluation design; you've shipped LLM features to production
Track record building evaluation harnesses and using them to drive improvements (regression suites, task success metrics, cost/runtime tradeoffs)
Solid distributed systems fundamentals: concurrency, reliability, performance, data modeling, lifecycle management
Pragmatic experimentation: hypothesis → prototype → measured improvement → rollout
Excellent debugging and instrumentation skills; you enjoy finding and fixing edge cases in the wild

Preferred

Experience with agent frameworks, tool orchestration, and memory architectures
RAG systems in production (chunking, retrieval quality, freshness strategies)
Redis, Postgres/Supabase, queues (e.g., Celery/Arq/SQS), and event-driven designs
Observability stacks (Datadog, OpenTelemetry), and cost/latency optimization

Benefits

Comprehensive benefits
Flexible work setup

Company

The General Intelligence Company of New York

twittertwitter
company-logo
The General Intelligence Company is building highly-capable ai agents to run entire businesses autonomously.
dateFounded in 2025
location
New York, New York, USA
people-size2-10 employees
web-link
https://cofounder.co/

H1B Sponsorship

The General Intelligence Company of New York has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)

Funding

Current Stage
Early Stage
Total Funding
$8.7M
Key Investors
Union Square Ventures
2025-10-31Seed· $8.7M

Recent News

Business Insider
AI status symbols are popping up everywhere
2025-10-09
Company data provided by crunchbase