Flock Safety · 2 months ago
Staff AI Systems Engineer
United States
Full-time
Remote
Senior Level, Lead/Staff
$200K/yr - $225K/yr
5+ years expFlock Safety is a leading safety technology platform focused on crime prevention and security. They are seeking a Staff AI Systems Engineer to support their AI copilot product, Night Shift, by automating investigative processes and improving system architecture for agentic AI.
ManufacturingPublic SafetySecuritySensor
Responsibilities
Immerse yourself in the current system design and agent/tooling landscape. Understand the core customer use cases and data flows
Support the team by shipping a few quick wins (e.g., refining tool APIs, prompt engineering, fixing bugs)
Stand up the foundational eval and observability scaffolding (datasets, metrics, KPIs, reporting)
Propose a technical architecture and implementation plan for an agent evaluation framework
Deliver the MVP evaluation harness to produce initial metrics, enable debugging and perform regression testing
Take on a system feature that offers demonstrated improvement against your MVP evaluation suite
Productionize the evaluation and observability platform and make it the source of truth for quality and safety. (e.g. Online/offline tracing, alerting, dashboards, evaluations and PR-gated regression suite)
Own the roadmap for evolving the agent evaluation platform
Lead deeper R&D threads (e.g., lightweight fine-tuned projection layers, specialized embeddings, multimodal understanding) that can improve system performance on core metrics
Qualification
Required
5+ years building and shipping ML/LLM systems to production
ML Inference (PyTorch, TensorRT, NVIDIA Triton), ideally in multimodal domains (text/image/video)
LLM Inference (LangChain/LangGraph, vLLM, OpenAI/Gemini/Anthropic APIs)
Compute orchestration (Kubernetes, Prefect, Ray)
Cloud Infrastructure (AWS, Terraform, VPC, Networking)
Observability (Prometheus, Grafana, OpenTelemetry, LangSmith/Langfuse)
Data (ClickHouse, Postgres, Redis)
Web services (Express/FastAPI, REST, SSE, JWTs)
Backend JS (e.g. NodeJS) familiarity required; Typescript and Python familiarity welcome
Hands-on experience with LLM agents including: Agent Design: tool use (via MCP), retrieval, memory, grounding/attribution for claims, and guardrails
Planning and hand-off for multi-agent systems, context management
Experience with vector/hybrid search (e.g. pgvector, turbopuffer, chroma), re-rankers (e.g. Cohere, JinaAI)
Built offline/online eval harnesses and are familiar with the methodologies and metrics to measure: Search, retrieval, and recommendation performance
Agentic task success, trajectory quality, preference learning (SFT, DPO, RLHF, LLM-as-judge)
Safety & robustness (security, compliance, red-teaming, regression testing)
Cost, performance and latency trade-offs
Ability to obtain and maintain Criminal Justice Information Services (CJIS) certification as a condition of employment
Meet all FBI CJIS Security Policy requirements, including a fingerprint-based background check
Benefits
Flexible PTO: We offer non-accrual PTO, plus 11 company holidays.
Fully-paid health benefits plan for employees: including Medical, Dental, and Vision and an HSA match.
Family Leave: All employees receive 12 weeks of 100% paid parental leave. Birthing parents are eligible for an additional 6-8 weeks of physical recovery time.
Fertility & Family Benefits: We have partnered with Maven, a complete digital health benefit for starting and raising a family. Flock will provide a $50,000-lifetime maximum benefit related to eligible adoption, surrogacy, or fertility expenses.
Spring Health: Spring Health offers a variety of mental health benefits, including therapy, coaching, medication management, and digital tools, all tailored to each individual's needs.
Caregiver Support: We have partnered with Cariloop to provide our employees with caregiver support.
Carta Tax Advisor: Employees receive 1:1 sessions with Equity Tax Advisors who can address individual grants, model tax scenarios, and answer general questions.
ERGs: We want all employees to thrive and feel like they belong at Flock. We offer four ERGs today - Women of Flock, Flock Proud, LEOs and Melanin Motion.
WFH Stipend: $150 per month to cover the costs of working from home.
Productivity Stipend: $300 per year to use on Audible, Calm, Masterclass, Duolingo and so much more.
Home Office Stipend: A one-time $750 to help you create your dream office.
Company
Flock Safety
Flock Safety provides end-to-end surveillance solutions to support law enforcement and communities.
1001-5000 employees
H1B Sponsorship
Flock Safety has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2024 (1)
2022 (2)
2021 (2)
Funding
Current Stage
Late StageTotal Funding
$655.58MKey Investors
Andreessen HorowitzTiger Global ManagementMeritech Capital Partners
2025-03-13Series F· $275M
2022-02-15Series E· $150M
2021-07-13Series D· $150M
Leadership Team
Garrett Langley
Founder & CEO
Mandy Schuler
Vice President Supply Chain
Recent News
Press Telegram
2026-01-18
2026-01-16
2026-01-16
Company data provided by crunchbase