Principal Engineer - AI jobs in United States
cer-icon
Apply on Employer Site
company-logo

Safe Security · 2 days ago

Principal Engineer - AI

SAFE Security is committed to building CyberAGI, a system that autonomously predicts, detects, and remediates cybersecurity threats. As a Principal Engineer - AI, you will lead the technical direction of AI systems for various products, collaborating with teams to design scalable and enterprise-ready solutions.

Artificial Intelligence (AI)Cyber SecurityInformation TechnologyNetwork SecurityRisk Management
check
Comp. & Benefits

Responsibilities

Architect Safe’s AI Systems: Design and scale AI-driven components — LLM orchestration, retrieval-augmented generation (RAG), vector stores, prompt pipelines, and AI microservices. Drive architecture for AI observability, safety, and evaluation (precision, recall, F1, hallucination detection, cost metrics)
Productionize AI Agents: Build multi-turn, goal-oriented agent systems that automate reasoning across TPRM, CTEM, and CRQ domains (e.g., control reviews, issue RCA, automated responses). Ensure reliability, traceability, and deterministic behavior in production
AI Infrastructure & Platform Ownership: Partner with Platform & DevOps teams to operationalize model serving (AWS SageMaker, Bedrock, or self-hosted Llama), build AI APIs, and manage model lifecycle and versioning. Establish feature stores, embedding management, and in-memory retrieval layers
Data Pipeline & Knowledge Graph Integration: Work with Data Engineering to design pipelines for structured and unstructured data ingestion, semantic indexing, and context retrieval (Snowflake + Iceberg + LlamaIndex)
AI Evaluation, Monitoring & Governance: Define internal frameworks for golden dataset validation, LLM evaluation (LangFuse/LangSmith), and safety enforcement policies. Implement human-in-the-loop (HITL) mechanisms and continuous feedback loops
Mentor & Multiply: Guide AI and backend engineers on architectural design, experimentation methodologies, and prompt optimization. Collaborate with product leaders to translate abstract AI goals into measurable engineering deliverables

Qualification

AI/ML systemsLLM infrastructurePython programmingRAG pipelinesLangChainVector databasesCloud deploymentData systemsMLOpsMentoringCollaborationContinuous learning

Required

12+ years total experience in software engineering, including 4+ years building AI/ML systems or large-scale data/LLM infrastructure
Strong programming fundamentals in Python, Go, or TypeScript
Deep understanding of LLM-based architectures, prompt engineering, and RAG pipelines
Hands-on experience with LangChain, LlamaIndex, or equivalent orchestration frameworks
Vector databases (FAISS, Pinecone, Weaviate, Redis Vector, or Milvus)
Cloud model deployment (AWS SageMaker, Bedrock, Vertex AI, or custom inference APIs)
Data systems: Snowflake, Iceberg, S3, Postgres/MySQL
Familiar with model versioning, CI/CD for ML, and performance optimization for real-time inference
Practical understanding of evaluation metrics, hallucination detection, RAG reliability, and enterprise AI safety

Preferred

Experience integrating AI into cybersecurity or risk management products
Familiarity with multi-agent systems and autonomous workflows (CrewAI, LangGraph, AutoGen)
Experience building AI evaluation dashboards and AI observability stacks
Knowledge of knowledge graphs, semantic search, or retrieval pipelines
Exposure to data governance, compliance, or SOC2/ISO 27001 environments
Published research, open-source contributions, or prior leadership of AI teams is a strong plus

Benefits

Health, dental, and vision insurance
401(k)
Flexible paid time off
Life insurance
Opportunities for professional growth

Company

Safe Security

company-logo
Safe Security provides cyber risk management solutions to quantify and manage enterprise‑wide cyber risk in real time.

Funding

Current Stage
Growth Stage
Total Funding
$212.96M
Key Investors
Avataar Venture PartnersBTMS&AD Ventures
2025-07-31Series C· $70M
2023-04-18Series B· $50M
2021-07-21Series A· $33M

Leadership Team

leader-logo
Saket Modi
Co-Founder and CEO
linkedin
leader-logo
Rahul Tyagi
Co-Founder
linkedin
Company data provided by crunchbase