Director of Technical Product Management, Inference as a Service jobs in United States
cer-icon
Apply on Employer Site
company-logo

MARA · 1 month ago

Director of Technical Product Management, Inference as a Service

MARA is seeking a Director of Technical Product Management to lead the strategy, development, and deployment strategy for their Inference as a Service platform. This role involves bridging technical, operational, and customer-facing teams to build scalable inference infrastructure that supports real-world AI applications, focusing on enabling clients to deploy and scale ML models with maximum performance and uptime.

Computer Software
check
H1B Sponsor Likelynote

Responsibilities

Define and drive the product vision and roadmap for our Inference as a Service offering
Gather and prioritize customer requirements from AI developers, enterprise users, and internal stakeholders
Collaborate with engineering, data center ops, and energy teams to ensure the compute infrastructure meets IaaS needs (e.g., GPU availability, latency targets)
Work closely with sales and business development to support customer onboarding and ensure alignment with SLAs
Identify market trends, emerging AI inference patterns (LLMs, vision, etc.), and integrate them into product strategy
Define product KPIs, collect usage data, and iterate quickly based on performance insights
Ensure the IaaS platform meets compliance, cost-efficiency, and environmental goals

Qualification

Product managementML inference workloadsGPU/accelerator environmentsInfrastructure productsKubernetesTritonStakeholder managementCommunication skills

Required

8–12+ years of product management, ideally in data infrastructure, cloud services, or AI/ML domains
Strong technical understanding of ML inference workloads and GPU/accelerator environments
Proven experience launching infrastructure products or platforms used by technical teams
Excellent communication and stakeholder management skills across engineering and non-technical functions

Preferred

Experience with tools like Kubernetes, Triton, or model-serving platforms is a plus

Company

MARA

twitter
company-logo
MARA (NASDAQ: MARA) deploys digital energy technologies to advance the world's energy systems.

H1B Sponsorship

MARA has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2024 (1)
2023 (1)

Funding

Current Stage
Growth Stage

Leadership Team

leader-logo
Fred Thiel
Chairman & Chief Executive Officer
linkedin
leader-logo
Salman Khan
Chief Financial Officer
linkedin
Company data provided by crunchbase