Backend AI Platform Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Freshworks · 4 hours ago

Backend AI Platform Engineer

positionBellevue, WA
timeFull-time
remoteHybrid
senioritySenior Level
money$238K/yr - $342K/yr
date7+ years exp

Freshworks is a company that builds uncomplicated service software to enhance customer and employee experiences. They are seeking a Backend AI Platform Engineer to design and build core backend services for their Agentic AI Platform, focusing on high-performance APIs and orchestration runtimes.

CRMInformation ServicesInformation TechnologySaaSSoftware
check
H1B Sponsor Likelynote

Responsibilities

Experience building agent runtime systems, orchestration layers, or reasoning engines
Implement agent runtime orchestration services for reasoning, planning, and tool invocation (integrating LangChain/LangGraph)
Develop APIs and SDKs for building, deploying, and managing agent workflows and tools
Build stateful dialog management and memory services to support multi-turn, context-aware agents
Implement multi-agent communication (A2A) protocols and shared context for collaborative agent behavior
Work with the Architect to build cloud-native, event-driven backend services using microservices or service mesh architecture
Design task scheduling and workflow orchestration (e.g., Temporal/Airflow) for agent planning and long-running operations
Develop real-time message buses (Kafka/Pub-Sub) for agent communication and event propagation
Optimize LLM orchestration performance and cost efficiency with caching, batching, and token usage monitoring
Implement integrations with enterprise systems, APIs, and knowledge sources (REST, GraphQL, gRPC)
Work with vector DBs (e.g., ElasticSearch, Pinecone, Weaviate, FAISS) and RAG pipelines for knowledge-augmented reasoning agents
Support metadata and telemetry pipelines for LangSmith-based evaluation and observability
Build secure multi-tenant backend services with RBAC, API authentication, and tenant isolation
Ensure agent action auditability and reproducibility for compliance and governance
Collaborate on implementing platform guardrails (rate limiting, content filtering, safe tool usage)
Write automated test suites (unit, integration, load testing) for backend services
Implement logging, tracing, and metrics (OpenTelemetry, Prometheus, Grafana) for full observability
Participate in on-call rotations and improve platform resiliency and fault tolerance

Qualification

Backend engineeringAI/ML platform developmentJavaPythonDistributed systemsLangChainLangGraphLangSmithEvent-driven architectureMicroservicesCloud platformsKubernetesIaCPostgreSQLElasticSearchSoft skills

Required

7+ years of backend engineering experience, with at least 2+ years in AI/ML platform development
Strong programming skills in Java and Python
Hands-on experience with LangChain, LangGraph, LangSmith LLM/agent frameworks
Expertise in distributed systems, event-driven architectures, and microservices
Solid experience with cloud platforms (AWS), Kubernetes, and IaC (Terraform/Helm)
Familiarity with databases (PostgreSQL, Redis, MongoDB) and vector databases (ElasticSearch, Pinecone, FAISS, Weaviate)
Understanding of workflow orchestration (Temporal/Airflow) and messaging systems (Kafka, RabbitMQ)
Knowledge of AI/LLM (OpenAI, Anthropic, Azure OpenAI, etc.) and prompt/tool orchestration

Preferred

Exposure to conversation orchestration, dialog state tracking, and AI-driven planning systems
Familiarity with enterprise security standards (RBAC, SSO/OAuth2, data encryption)
Prior experience in startup or high-growth environments building SaaS platforms
Contributions to open-source AI agentic frameworks or backend libraries

Benefits

Freshworks offers multiple options for dental, medical, vision, disability and life insurances.
Equity + ESPP, flexible PTO, flexible spending, commuter benefits and wellness benefits are also offered.
Freshworks also offers adoption and parental leave benefits.

Company

Freshworks

twittertwittertwitter
Glassdoor3.7
company-logo
Freshworks is building and delivering online cloud-based software-as-a-service that provides helpdesk support with automation solutions.
dateFounded in 2010
location
San Mateo, California, USA
people-size1001-5000 employees
web-link
https://www.freshworks.com

H1B Sponsorship

Freshworks has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (22)
2024 (23)
2023 (7)
2022 (11)
2021 (10)
2020 (4)

Funding

Current Stage
Public Company
Total Funding
$484M
Key Investors
Steadview CapitalPeak XV PartnersTiger Global Management
2021-09-21IPO
2020-01-01Secondary Market· $85M
2019-11-04Series H· $150M

Leadership Team

leader-logo
Dennis Woodside
CEO, President
linkedin
leader-logo
Shan Krishnasamy
Co-founder and CTO

Recent News

womenentrepreneursreview.com
The Week That Was: Grassroots Wins, Policy Signals & More
2026-01-11
thefly.com
Freshworks appoints Kady Srinivasan as CMO
2026-01-08
GlobeNewswire
Freshworks Appoints Kady Srinivasan as Chief Marketing Officer
2026-01-07
Company data provided by crunchbase