Freshworks · 13 hours ago
Backend AI Platform Engineer
San Mateo, CA
Full-time
Hybrid
Senior Level
$238K/yr - $342K/yr
7+ years expFreshworks is a company that builds uncomplicated service software to enhance customer and employee experiences. They are seeking a Backend AI Platform Engineer to design and build core backend services for their Agentic AI Platform, focusing on high-performance APIs and orchestration runtimes.
CRMInformation ServicesInformation TechnologySaaSSoftware
Responsibilities
Experience building agent runtime systems, orchestration layers, or reasoning engines
Implement agent runtime orchestration services for reasoning, planning, and tool invocation (integrating LangChain/LangGraph)
Develop APIs and SDKs for building, deploying, and managing agent workflows and tools
Build stateful dialog management and memory services to support multi-turn, context-aware agents
Implement multi-agent communication (A2A) protocols and shared context for collaborative agent behavior
Work with the Architect to build cloud-native, event-driven backend services using microservices or service mesh architecture
Design task scheduling and workflow orchestration (e.g., Temporal/Airflow) for agent planning and long-running operations
Develop real-time message buses (Kafka/Pub-Sub) for agent communication and event propagation
Optimize LLM orchestration performance and cost efficiency with caching, batching, and token usage monitoring
Implement integrations with enterprise systems, APIs, and knowledge sources (REST, GraphQL, gRPC)
Work with vector DBs (e.g., ElasticSearch, Pinecone, Weaviate, FAISS) and RAG pipelines for knowledge-augmented reasoning agents
Support metadata and telemetry pipelines for LangSmith-based evaluation and observability
Build secure multi-tenant backend services with RBAC, API authentication, and tenant isolation
Ensure agent action auditability and reproducibility for compliance and governance
Collaborate on implementing platform guardrails (rate limiting, content filtering, safe tool usage)
Write automated test suites (unit, integration, load testing) for backend services
Implement logging, tracing, and metrics (OpenTelemetry, Prometheus, Grafana) for full observability
Participate in on-call rotations and improve platform resiliency and fault tolerance
Qualification
Required
7+ years of backend engineering experience, with at least 2+ years in AI/ML platform development
Strong programming skills in Java and Python
Hands-on experience with LangChain, LangGraph, LangSmith LLM/agent frameworks
Expertise in distributed systems, event-driven architectures, and microservices
Solid experience with cloud platforms (AWS), Kubernetes, and IaC (Terraform/Helm)
Familiarity with databases (PostgreSQL, Redis, MongoDB) and vector databases (ElasticSearch, Pinecone, FAISS, Weaviate)
Understanding of workflow orchestration (Temporal/Airflow) and messaging systems (Kafka, RabbitMQ)
Knowledge of AI/LLM (OpenAI, Anthropic, Azure OpenAI, etc.) and prompt/tool orchestration
Preferred
Exposure to conversation orchestration, dialog state tracking, and AI-driven planning systems
Familiarity with enterprise security standards (RBAC, SSO/OAuth2, data encryption)
Prior experience in startup or high-growth environments building SaaS platforms
Contributions to open-source AI agentic frameworks or backend libraries
Benefits
Freshworks offers multiple options for dental, medical, vision, disability and life insurances.
Equity + ESPP, flexible PTO, flexible spending, commuter benefits and wellness benefits are also offered.
Freshworks also offers adoption and parental leave benefits.
Company
Freshworks
Freshworks is building and delivering online cloud-based software-as-a-service that provides helpdesk support with automation solutions.
1001-5000 employees
H1B Sponsorship
Freshworks has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (22)
2024 (23)
2023 (7)
2022 (11)
2021 (10)
2020 (4)
Funding
Current Stage
Public CompanyTotal Funding
$484MKey Investors
Steadview CapitalPeak XV PartnersTiger Global Management
2021-09-21IPO
2020-01-01Secondary Market· $85M
2019-11-04Series H· $150M
Leadership Team
Dennis Woodside
CEO, President
Shan Krishnasamy
Co-founder and CTO
Recent News
womenentrepreneursreview.com
2026-01-11
2026-01-08
2026-01-07
Company data provided by crunchbase