Fiddler AI · 2 months ago
Staff Backend Engineer (Hybrid)
Palo Alto
Full-time
Hybrid
Senior Level, Lead/Staff
$190K/yr - $300K/yr
7+ years expFiddler AI is dedicated to building trust in AI applications and is seeking a Staff Backend Engineer to design and build core services for AI-based solutions. The role involves developing distributed systems and scalable data infrastructure while contributing to team building and technical leadership.
AnalyticsArtificial Intelligence (AI)Big DataEnterpriseMachine LearningSoftware
Responsibilities
Design and build core services and components of a world-class cloud platform to help enterprises develop, monitor and improve their full suite of AI based applications (covering predictive models, LLMs, GenAI models and agentic applications)
Lead the design and implementation of distributed systems and microservices that compute, persist, and expose new ML + agentic observability metrics (e.g., response relevancy, hallucination scores) from raw trace data
Design enterprise-grade, scalable data infrastructure, services and APIs to support enterprise scale workloads and meet compliance needs and SLAs
Spearhead the development of new types of metrics and evaluation capabilities to satisfy evolving customer needs. Take part in conversations with customers around discovery and support
Define and evolve the operational maturity (reliability, latency, SLOs, observability) of core services, establish best practices and champion improvements to internal CI/CD processes, testing frameworks, error handling, efficiency and resiliency
Team & Culture Building: you will take an active role in building a world-class engineering team and actively participate in the talent acquisition process through interviewing, candidate evaluation and coaching
Qualification
Required
Masters or Bachelors degree in Computer Science or related field, combined with 7+ years of industry experience, with demonstrated solid foundation in software development
Deep proficiency with Python and a strong command of essential backend technologies like Postgres, Redis, Kafka, RabbitMQ, Ray. This includes the ability to design, build, and debug complex, large-scale systems
Experience with deploying and working with ML/LLM models in production. The candidate should be comfortable with modern LLM frameworks (e.g., Langchain, HuggingFace, vLLM) and evaluation frameworks (e.g., Ragas, MLFlow) to ensure model performance and reliability
Adaptability & Ownership: proven ability to thrive in ambiguity and a fast-paced environment. We need a self-motivated initiator who can take ownership of projects with a high degree of autonomy, confidently filling in the gaps when the full picture isn't available
System Design & Optimization: A strong grasp of distributed systems and the capacity to troubleshoot production issues
Technical Leadership & Collaboration: Demonstrated ability to plan, execute, and deliver projects by effectively breaking down complex problems into manageable tasks, and guiding a small team of engineers. Must be adept at cross-functional collaboration across a geographically distributed team, working closely with product managers, designers, frontend developers, and data scientists to ensure alignment and successful project outcomes
Coaching & Mentorship: you should be an excellent collaborator and a mentor to other team members, raising the technical bar for the entire team and regularly engage in code and design reviews
Ability to work in our Palo Alto office 3 days a week
Preferred
Experience with cloud infrastructure (AWS/GCP, Kubernetes) and specialized databases (Clickhouse/Druid), indicating a deeper understanding of system architecture and performance optimization
Benefits
Equity
Benefits
Company
Fiddler AI
Fiddler provides enterprise model performance management software that allows monitoring, explaining, analyzing, and improving ML models.
51-200 employees
H1B Sponsorship
Fiddler AI has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (5)
2024 (4)
2023 (6)
2022 (12)
2021 (8)
2020 (1)
Funding
Current Stage
Growth StageTotal Funding
$63.8MKey Investors
Dentsu VenturesInsight PartnersHaystack
2024-12-12Series B· $18.6M
2023-07-06Series Unknown
2023-04-13Series Unknown
Leadership Team
Krishna Gade
Founder & CEO
Amit Paka
Founder, COO, CPO & Board Member
Recent News
2025-11-04
Carahsoft Technology Corporation
2025-06-20
Company data provided by crunchbase