BMC Software · 8 hours ago
Principal AI Engineer - Hybrid
Santa Clara, CA
Full-time
Hybrid
Lead/Staff
$172K/yr - $286K/yr
10+ years expBMC Software is a leading company empowering organizations to accelerate business value through innovative technology. They are seeking a Principal AI Engineer to build a next-generation Agentic AI platform, focusing on designing, coding, and shipping production-grade AI capabilities for external B2B customers.
Cloud ComputingInformation ServicesInformation TechnologySoftware
Responsibilities
Design, build, and evolve agentic AI systems that reason, plan, execute, and adapt in production environments
Take AI-driven features from concept to production in a true 0–1 product environment
Write and review high-quality production code (Python-first) across AI pipelines, inference services, orchestration layers, and supporting systems
Implement prompt engineering, tool use, memory, evaluation, and guardrails as first-class engineering concerns, not experiments
Design agent frameworks that balance autonomy with determinism, observability, and safety
Make pragmatic architectural trade-offs across latency, cost, accuracy, scalability, and maintainability
Integrate and operate LLMs (commercial and/or open-source) including model selection, fine-tuning strategies, embeddings, retrieval (RAG), and inference optimization
Address real-world issues: hallucinations, drift, prompt regressions, failure modes, and customer trust
Deploy and operate AI services across cloud platforms (AWS, Azure, GCP), including secure enterprise integrations and customer-specific deployments
Design scalable inference and orchestration architectures using containers, APIs, and distributed systems
Ensure the platform is shippable, debuggable, and supportable — not fragile or research-grade
Act with founder-level ownership: identify gaps, propose solutions, and move forward without waiting for perfect requirements
Qualification
Required
10+ years of professional software development experience, with significant time shipping B2B products used by external customers
Strong software engineering foundation with expert-level Python and experience designing production systems
Proven experience building, deploying, and operating AI-powered products in production — not just prototypes or research
Hands-on experience with LLMs and GenAI systems in real applications (e.g., agents, copilots, automation, decision systems)
Deep understanding of at least several of the following: Agent frameworks and orchestration, Prompt engineering and tool-use patterns, RAG architectures and vector search, Model evaluation, feedback loops, and monitoring, Safety, guardrails, and enterprise controls
Hands-on experience with multiple of the following in real systems: LangGraph and/or LangChain, LlamaIndex, Vector databases (e.g., Pinecone, Weaviate, FAISS, Milvus), Prompt engineering as a managed, versioned, testable artifact
Experience deploying and operating LLMs using: AWS SageMaker, Vertex AI, or equivalent managed platforms, Direct API integrations (OpenAI, Anthropic)
Experience designing multi-agent systems or complex agent workflows
Experience commercializing AI features under enterprise constraints (security, compliance, uptime)
Comfort operating in ambiguity and making decisions with incomplete information
Preferred
Contributions to open-source GenAI tooling or internal frameworks used at scale
Experience with Supervised fine-tuning, Parameter-efficient tuning methods (LoRA, QLoRA), reinforcement learning (RLHF) and preference optimization (PPO, DPO, GRPO)
Experience deploying LLMs at scale (Kubernetes, model serving, GPU optimization)
Benefits
Other rewards may include a variable plan and country specific benefits.
Company
BMC Software
BMC Software is a business service management platform offering cloud and IT management solutions for businesses.
5001-10000 employees
H1B Sponsorship
BMC Software has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (13)
2024 (20)
2023 (24)
2022 (24)
2021 (21)
2020 (27)
Funding
Current Stage
Public CompanyTotal Funding
$750M2018-05-29Series Unknown
2018-05-29Acquired
2014-04-08Debt Financing· $750M
Leadership Team
Ayman Sayed
President and CEO
Ram Chakravarti
Chief Technology Officer
Recent News
Morningstar.com
2026-01-20
DevOps.com
2026-01-16
Company data provided by crunchbase