Instrumentl · 18 hours ago
Software Engineer, AI/ML GenAI
United States
Full-time
Remote
Senior Level
$175K/yr - $220K/yr
5+ years expInstrumentl is a mission-driven startup focused on helping the nonprofit sector with grant discovery and management through their SaaS platform. The Software Engineer, AI/ML GenAI will own the full lifecycle of AI features, collaborating closely with Product and Design teams to build and deploy AI systems that enhance nonprofit fundraising efforts.
Non ProfitSaaSSoftware
Responsibilities
Design agentic systems & ship AI to production: Turn prototypes into resilient, observable services with clear SLAs, rollback/fallback strategies, and cost/latency budgets. Build tool‑using LLM “agents” (task planning, function/tool calling, multi‑step workflows, guardrails) for tasks like grant discovery, application drafting, and research assistance
Own RAG end‑to‑end: Ingest and normalize content, choose chunking/embedding strategies, implement hybrid retrieval, re‑ranking, citations, and grounding. Continuously improve recall/precision while managing index health
Manage embeddings at scale: Select, evaluate, and migrate embedding models; maintain vector stores (e.g., pgvector/FAISS/Pinecone/Weaviate/Milvus/Qdrant); monitor drift and rebuild strategies
Fine‑tune & build evaluation: Run SFT/LoRA or instruction‑tuning on curated datasets; evaluate the ROI vs. prompt engineering/model selection; manage data versioning and reproducibility. Create offline and online eval harnesses (helpfulness, groundedness, hallucination, toxicity, latency, cost), synthetic test sets, red‑teaming, and human‑in‑the‑loop review
Collaborate cross‑functionally while raising engineering standards: Work side by side with Product, Design, and GTM on scoping, UX, and measurement; run experiments (A/B, canaries), interpret results, and iterate. Write clear, maintainable code, add tests and docs, and contribute to reliability practices (alerts, dashboards, incident response)
Qualification
Required
5+ years of professional software engineering experience, including 2+ years working with modern LLMs (as an IC)
Proven production impact: You've taken LLM/RAG systems from prototype to production, owned reliability/observability, and iterated post‑launch based on evals and user feedback
Experience building tool/function‑calling workflows, planning/execution loops, and safe tool integrations (e.g., with LangChain/LangGraph, LlamaIndex, Semantic Kernel, or custom orchestration)
Strong grasp of document ingestion, chunking/windowing, embeddings, hybrid search (keyword + vector), re‑ranking, and grounded citations
Hands‑on with embedding model selection/versioning and vector DBs (e.g., pgvector, FAISS, Pinecone, Weaviate, Milvus, Qdrant)
Comfort designing eval suites (RAG/QA, extraction, summarization), using automated and human‑in‑the‑loop methods; familiarity with frameworks like Ragas/DeepEval/OpenAI Evals or equivalent
Proficiency in Python (FastAPI, Celery) and TypeScript/Node; familiarity with Ruby on Rails (our core platform) or willingness to learn
Experience with AWS/GCP, Docker, CI/CD, and observability (logs/metrics/traces)
Comfortable with SQL, schema design, and building/maintaining data pipelines that power retrieval and evaluation
You thrive in a cross‑functional environment and can translate researchy ideas into shippable, user‑friendly features
Bias for action and ownership with an eye for speed, quality, and simplicity
Preferred
Practical experience with SFT/LoRA or instruction‑tuning (and good intuition for when fine‑tuning vs. prompting vs. model choice is the right lever)
Exposure to open‑source LLMs (e.g., Llama) and providers (e.g., OpenAI, Anthropic, Google, Mistral)
Familiarity with responsible AI, red‑teaming, and domain‑specific safety policies
Benefits
100% covered health, dental, and vision insurance for employees, 50% for dependents
Generous PTO policy, including parental leave
401(k)
Company laptop + stipend to set up your home workstation
Company retreats for in-person time with your colleagues
Work with awesome nonprofits around the US.
Company
Instrumentl
Instrumentl is an end-to-end platform for grant management that supports organizations throughout the entire grant lifecycle.
51-200 employees
H1B Sponsorship
Instrumentl has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (3)
2024 (4)
2023 (2)
2022 (4)
2021 (6)
2020 (2)
Funding
Current Stage
Growth StageTotal Funding
$55MKey Investors
Summit Partners
2025-04-23Private Equity· $55M
2020-01-01Series Unknown
2017-08-01Seed
Leadership Team
Gauri Manglik
CEO & Co-founder
Angela Braren
Co-founder leading Engineering, Product & Design
Recent News
2025-11-04
2025-07-17
Company data provided by crunchbase