Senior Software Engineer, Machine Learning Platform Technologies - Traffic Infrastructure jobs in United States
cer-icon
Apply on Employer Site
company-logo

Apple · 3 days ago

Senior Software Engineer, Machine Learning Platform Technologies - Traffic Infrastructure

Apple is seeking a hands-on technical leader for their MLPT Traffic Infrastructure Team to design and scale traffic platforms that power Apple’s Search and ML ecosystems. The role involves architecting L4/L7 traffic systems, collaborating with multiple teams, and contributing to open-source projects to enhance networking technologies.

AppsArtificial Intelligence (AI)BroadcastingDigital EntertainmentFoundational AIMedia and EntertainmentMobile DevicesOperating SystemsTVWearables
check
Comp. & Benefits
check
H1B Sponsor Likelynote

Responsibilities

Architect and build L4/L7 traffic platforms for ML training and inference using Envoy, Istio, and modern load-balancing techniques
Design and implement dynamic, capacity-aware, and metrics-driven load balancing strategies for HTTP, gRPC, and streaming ML inference workloads
Develop and optimize service mesh architectures for high-throughput, low-latency ML systems, including multi-cluster and multi-region topologies
Lead the evolution of client-to-server and server-to-server traffic patterns, including adoption of HTTP/3 where appropriate
Collaborate with ML and platform teams to support scalable inference, A/B traffic shifting, canarying, and adaptive routing strategies
Contribute to and upstream improvements in Envoy, Istio, Kubernetes networking, or related CNCF projects, representing Apple in the open-source community
Implement observability, telemetry, and debugging frameworks for traffic flows (latency, tail behavior, retries, backpressure, saturation)
Ensure traffic platforms are secure, resilient, and cost-efficient, supporting hybrid and multi-cloud environments at global scale
Mentor engineers and drive architectural decisions across networking and traffic-infra domains

Qualification

EnvoyIstioL4/L7 load balancingHTTP/2GRPCHTTP/3Kubernetes networkingCapacity-based routingObservability stacksGolangPythonTechnical writingCross-functional leadership

Required

BS/MS in Computer Science or equivalent practical experience
5+ years of experience in distributed systems, networking, or traffic infrastructure engineering
Strong programming experience in Golang and Python, especially for control-plane or data-plane systems
Deep expertise in L4/L7 networking concepts, including load balancing, connection management, retries, timeouts, and congestion control
Hands-on experience with Envoy, Istio, or similar service mesh / proxy technologies
Strong understanding of HTTP/1.1, HTTP/2, gRPC, and modern transport protocols
Experience designing and operating high-throughput, low-latency systems in production
Proven ability to lead complex technical initiatives and mentor engineers

Preferred

9+ years in networking, traffic infrastructure, or large-scale distributed systems roles
Contributions to CNCF or networking open-source projects (Envoy, Istio, Kubernetes networking, eBPF, etc.)
Experience with HTTP/3, QUIC, or next-generation transport protocols
Strong understanding of capacity-based routing, adaptive load balancing, and feedback-driven traffic systems
Experience supporting ML inference platforms, GPU-backed services, or latency-sensitive ML workloads
Familiarity with observability stacks (OpenTelemetry, Prometheus, Grafana) for traffic and networking telemetry
Experience operating traffic systems across multi-region, multi-cloud, or hybrid environments
Excellent communication, technical writing, and cross-functional leadership skills
B.S., M.S., or Ph.D. in Computer Science, Computer Engineering, or equivalent practical experience

Company

Apple is a technology company that designs, manufactures, and markets consumer electronics, personal computers, and software.

H1B Sponsorship

Apple has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (6998)
2024 (3766)
2023 (3939)
2022 (4822)
2021 (4060)
2020 (3656)

Funding

Current Stage
Public Company
Total Funding
$5.67B
Key Investors
Berkshire HathawayMicrosoftSequoia Capital
2025-05-05Post Ipo Debt· $4.5B
2025-01-16Post Ipo Debt· $0.31M
2021-04-30Post Ipo Equity

Leadership Team

leader-logo
Tim Cook
CEO
leader-logo
Craig Federighi
SVP, Software Engineering
Company data provided by crunchbase