Palo Alto Networks · 1 month ago
IT Principal AI Engineer
Santa Clara, CA
Full-time
Onsite
Lead/Staff
$167K/yr - $270K/yr
10+ years expPalo Alto Networks is a cybersecurity company committed to protecting the digital way of life. They are seeking a Principal AI Engineer to lead the architecture and implementation of innovative AI solutions that enhance their business applications and Go-To-Market processes.
Agentic AICloud SecurityCyber SecurityNetwork SecuritySecurity
Responsibilities
Lead the architecture and implementation of a Proxy-First "AI Gateway" intermediary layer to ensure seamless LLM vendor independence
Design and build a unified API endpoint to abstract LLM complexities and provide centralized control for access and security
Implement comprehensive GenAI observability pipelines to track trace-level data, prompt inputs/outputs, and model latency
Create architecture to optimize performance and expense by intelligently routing simpler queries to cost-effective models
Integrate observability data into the development cycle to identify real-time bottlenecks, high-latency chains, and model drift
Institute and promote innovative thinking by incorporating Agentic AI, designing sophisticated Multi-Agent Systems and Agent-to-Agent (A2A) workflows
Apply GenAI to complex Go-To-Market (GTM) business logic, automating critical workflows like customer support and entitlement platforms
Pioneer "LLM as a Judge" testing methodologies to automate quality assurance of system outputs (correctness, tone, and helpfulness)
Build robust guardrails to filter inputs and outputs, preventing PII exposure, offensive content, and prompt injection attacks
Develop detection mechanisms, including keyword filtering, behavioral analysis, and adversarial training, to protect model instructions from manipulation
Qualification
Required
10+ years of overall IT system architecture, design, development, and deployment experience
Proven track record leading technical teams in Agile/Scrum environments for large-scale implementations with aggressive timelines
Experience partnering with business stakeholders to design workflows for Go-To-Market (GTM), sales, or support operations
Bachelor's degree or equivalent in Computer Science or a related field
Strong verbal and written communication skills with the ability to explain complex AI concepts to senior leadership
Extensive knowledge in building modern applications using Large Language Models (LLMs) such as Llama 3, GPT-4, and Anthropic
Deep experience building and maintaining highly observable GenAI systems, including proficiency with tracing and evaluation tools (e.g., LangSmith, Arize, HoneyHive, or custom OpenTelemetry)
Deep experience with Multi-Agent systems, Agent-to-Agent (A2A) communication, and orchestration frameworks
Experience establishing 'Golden Datasets' for ground truth testing and performing comparative analysis across different models
Expert-level proficiency in Python; familiarity with Java or Node.js for enterprise integration is a plus
Benefits
Restricted stock units
Bonus
Company
Palo Alto Networks
Palo Alto Networks is a cybersecurity company that offers cybersecurity solutions for organizations.
10001+ employees
H1B Sponsorship
Palo Alto Networks has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (579)
2024 (482)
2023 (341)
2022 (452)
2021 (493)
2020 (235)
Funding
Current Stage
Public CompanyTotal Funding
$65MKey Investors
Icon VenturesLehman HoldingsGlobespan Capital Partners
2012-07-20IPO
2008-11-03Series C· $10M
2008-08-18Series C· $27M
Leadership Team
Helmut Reisinger
CEO EMEA
Nikesh Arora
Chairman CEO
Recent News
The Times Of Israel
2026-01-17
2026-01-16
2026-01-16
Company data provided by crunchbase