Coupang Fulfillment Services · 2 months ago
Sr. Director - Backend Engineering
Coupang is a rapidly growing e-commerce company that aims to revolutionize the shopping experience. They are seeking a Senior Director of Back-end Engineering to define and execute the vision for AI infrastructure orchestration, lead a high-performing team, and ensure the reliability and security of AI services.
DeliveryLogisticsWarehousing
Responsibilities
Define and execute the long-term vision and roadmap for the company’s AI infrastructure orchestration layer, aligning it with overall business and AI Services goals
Lead, mentor, and grow a high-performing engineering and operations team focused on AI infrastructure, and platform engineering
Manage budget and resource allocation for AI infrastructure deliverables
Act as a key liaison between AI Infra and other services owners and consumers, core engineering, Cloud infrastructure, and executive leadership
Oversee the design, implementation, and maintenance of the core orchestration platforms for large-scale AI model training (e.g., distributed training, hyperparameter tuning) and deployment (e.g., containerization, serverless functions, edge deployment)
Ensure reliability, security, and compliance of the AI infrastructure, meeting strict standards for data governance and model integrity
Establish Service Level Objectives (SLOs) and Key Performance Indicators (KPIs) for the AI platform services and lead efforts for continuous optimization and performance tuning
Select, evaluate, and integrate the core technologies required for the AI stack (e.g., Kubernetes, Kubeflow, Ray, ML frameworks, GPU/accelerator management, distributed file systems)
Champion infrastructure-as-code (IaC) principles to manage and provision AI resources consistently and at scale
Qualification
Required
Education: Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field
15+ years of progressive experience in software engineering, infrastructure, or platform operations
5+ years of experience leading and managing technical teams, ideally in a Director or Sr. Director level or equivalent capacity
Deep, hands-on experience designing and operating large-scale distributed systems and cloud-native architectures
Proven experience specifically with AI infrastructure orchestration (e.g., using Kubernetes, Kubeflow, or similar MLOps tools) and managing accelerated compute resources (GPUs, TPUs etc)
15+ years of Cloud backend engineering, Cloud Design, Deployment, DevOps
15+ years of experience leading system design, architecture leveraging Private Clouds and AWS and/or Azure/ GCP
10+ years of demonstrable building and operating infrastructure as code. Infra Automation, Comfortable with many flavors of Linux
15+ years of experience in building high-performance, highly-available and scalable distributed systems in the cloud
15+ years of experience in building and managing high-performance, highly-available and scalable Hybrid Cloud environments
Excellent cross-group collaboration, outstanding verbal and written communication
Expert-level knowledge of containerization and orchestration (Docker, Kubernetes)
Strong background in DevOps and MLOps principles and tooling
Proficiency in at least one modern programming language (e.g., Python, Go)
Exceptional strategic planning, organizational, and written/verbal communication skills
Preferred
Prior experience managing infrastructure for training and inferring of large language models (LLMs) or foundation models
Experience in a regulated industry with strict compliance requirements
AI Private Cloud - Building and operating
Benefits
Medical/Dental/Vision/Life, AD&D insurance
Flexible Spending Accounts (FSA) & Health Savings Account (HSA)
Long-term/Short-term Disability
Employee Assistance Program (EAP) program
401K Plan with Company Match
18-21 days of the Paid Time Off (PTO) a year based on the tenure
12 Public Holidays
Paid Parental leave
Pre-tax commuter benefits
MTV - [Free] Electric Car Charging Station
Company
Coupang Fulfillment Services
Coupang Fulfillment Services provides warehousing, delivery, and delivery logistics services.
Funding
Current Stage
Late StageRecent News
2026-02-06
2026-02-04
Company data provided by crunchbase