Johnson Controls · 15 hours ago
Seniorr AI/ML Platform Engineer
Milwaukee-Wisconsin-United States of America
Full-time
Hybrid
Senior Level, Lead/Staff
$126K/yr - $189K/yr
10+ years expJohnson Controls is a global leader in smart, healthy, and sustainable buildings, seeking a Senior AI/ML Platform Engineer to drive the strategy and architecture of their AI and Machine Learning platforms. This role involves designing scalable ML infrastructure on Azure and mentoring engineering teams while shaping platform standards for enterprise-wide adoption of AI capabilities.
Industrial EngineeringPhysical SecuritySmart Building
Responsibilities
Architect, lead, and optimize complex ML/LLM pipelines on Azure ML, defining best practices for CI/CD, testing automation, and secure deployment across environments
Drive the operationalization of large-scale LLMs (GPT, LLaMA, Claude, etc.), ensuring maintainability, observability, and model lifecycle efficiency
Define Terraform based IaC patterns and oversee provisioning of compute clusters (AKS, AML Compute), networking, and storage for ML workloads
Establish governance, drift monitoring, and enterprise grade model management practices
Architect high availability, low latency inference environments using Azure Kubernetes Service, serverless compute (Azure Functions), and distributed microservice patterns
Design and scale advanced RAG pipelines using vector databases such as Azure Cognitive Search, Redis, or FAISS, integrated with frameworks like Microsoft Agent Framework
Set standards for Azure security (RBAC, identity, audit), logging, observability, and compliance across ML/AI environments
Lead the creation of reusable, enterprise-wide Azure DevOps CI/CD templates for ML assets, ensuring consistency across data science teams
Champion automated testing, gating, rollback strategies, quality controls, and monitoring for ML service deployments
Establish platform wide SRE practices for ML systems, including reliability, scalability, and cost optimization frameworks
Partner with Data Science, Cloud Architecture, and Product teams to deliver highly impactful AI solutions that scale globally
Provide architectural guidance for real-time AI, conversational AI, enterprise search, analytics, and summarization workloads powered by LLMs
Mentor ML engineers and advocate for engineering excellence, design reviews, and knowledge-sharing across teams
Influence JCI’s AI platform roadmap, standards, and long-term architectural strategy
Qualification
Required
Bachelor's or Master's in Computer Science, Engineering, or a related field
10+ years of experience in ML engineering, platform engineering, data engineering, or cloud architecture roles
Deep experience deploying and scaling ML systems on Azure, including Azure ML, AKS, Azure DevOps, and distributed compute
Significant hands-on experience with Terraform and cloud-native architectural patterns at enterprise scale
Proven background in building secure, automated ML/LLM systems and managing full model lifecycles in production
Expert proficiency in Python (PyTorch, Transformers, LangChain), Terraform, and Bash/PowerShell
Advanced experience with Docker, Kubernetes, and GPU-accelerated inference on AKS
Strong understanding of scalable inference patterns, LLM optimization, vector databases, and RAG architectures
Deep knowledge of CI/CD, model registries, artifact management, and ML observability tooling
Strategic thinker who can influence platform direction and drive architectural decisions
Strong leadership, documentation, communication, and stakeholder management skills
Ability to balance innovation, reliability, security, and cost to deliver business value at scale
Demonstrated experience mentoring engineers and guiding cross-functional technical teams
Preferred
Expertise in LLMOps, prompt orchestration frameworks (LangChain, Microsoft Agent Framework), and custom model deployment (open-weights, fine-tuning, quantization)
Experience with IoT, smart building systems, or edge AI pipelines
Knowledge of enterprise governance, AI compliance, and responsible AI practices
Azure certifications (Azure Solutions Architect, Azure AI Engineer) and Terraform Associate
Benefits
Competitive salary and bonus plan
Paid vacation/holidays/sick time
Comprehensive benefits package including 401K, medical, dental, and vision care
On the job/cross training opportunities
Encouraging and collaborative team environment
Dedication to safety through our Zero Harm policy
Company
Johnson Controls
Johnson Controls offers smart buildings that create safe, healthy, and sustainable environments.
10001+ employees
H1B Sponsorship
Johnson Controls has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (61)
2024 (57)
2023 (80)
2022 (95)
2021 (81)
2020 (93)
Funding
Current Stage
Public CompanyTotal Funding
$1.6BKey Investors
US Department of Energy
2024-12-05Post Ipo Debt· $250M
2024-12-04Post Ipo Debt· $525.61M
2024-05-20Post Ipo Equity· $90M
Leadership Team
Joakim Weidemanis
Chief Executive Officer
Marc Vandiepenbeeck
Executive Vice President and Chief Financial Officer
Recent News
Company data provided by crunchbase