ServiceNow · 2 weeks ago
Staff AI Engineer: Foundational AI Services
Addison, TX
Full-time
Hybrid
Lead/Staff
8+ years expServiceNow is a global market leader in AI-enhanced technology, transforming how organizations work. They are seeking a Staff AI Engineer to architect and scale their core AI intelligence layer, focusing on building foundational services that empower product teams to deploy production-grade GenAI.
Agentic AIBusiness Process Automation (BPA)Cloud ManagementEnterprise SoftwareRobotic Process Automation (RPA)SaaS
Responsibilities
LLM Fine-Tuning & Distillation: Lead domain-specific model optimization using PEFT (LoRA/QLoRA) and knowledge distillation to balance cost, latency, and reasoning capability
Architect Foundational RAG: Build next-gen Retrieval-Augmented Generation pipelines using hybrid search, cross-encoders, and self-correcting retrieval loops
Agentic Orchestration: Design and deploy multi-agent systems using frameworks like LangGraph or CrewAI, enabling autonomous task planning and tool-use (Function Calling)
Enterprise-Grade Evaluation: Build "LLM-as-a-judge" frameworks and robust eval pipelines to measure hallucination rates, groundedness, and safety
Inference Optimization: Implement high-throughput, low-latency serving strategies including quantization, speculative decoding, and prompt caching
Qualification
Required
Typically requires 8+ years of overall software engineering experience
Core AI: Expert-level mastery of Transformers, attention mechanisms, and the latest frontier models (GPT-4o, Claude 3.5, Llama 3)
The Stack: Deep experience with vector databases (Pinecone, Weaviate, Milvus), orchestration layers (LangChain, LlamaIndex), and MLOps tools
Software Craft: You are a Staff-level coder in Python/Rust who understands distributed systems, concurrency, and API design
Modern Buzz: You live and breathe Chain-of-Thought (CoT), DSPy, GraphRAG, and Semantic Caching
Company
ServiceNow
ServiceNow is an AI platform that delivers IT operations, field service management and app engine solutions.
10001+ employees
H1B Sponsorship
ServiceNow has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (910)
2024 (876)
2023 (807)
2022 (840)
2021 (447)
2020 (439)
Funding
Current Stage
Public CompanyTotal Funding
$83.7MKey Investors
Sequoia CapitalJMI Equity
2022-12-09Post Ipo Equity
2012-07-29IPO
2012-03-20Private Equity· $10.98M
Leadership Team
Bill McDermott
Chairman and CEO
Pat Casey
Chief Technology Officer & EVP of DevOps
Recent News
2026-01-07
Company data provided by crunchbase