Arc.dev · 1 day ago
Technical Project Manager – Generative AI & Cloud Infrastructure
United States
Full-time
Remote
Mid, Senior Level
3+ years expArc.dev is building a next-generation AI cloud platform combining ultra-fast LLM inference with high-performance cloud infrastructure. They are seeking a Technical Project Manager to drive execution across engineering, infrastructure, and product teams, ensuring complex AI infrastructure projects are delivered on time and aligned with company strategy.
Career PlanningHuman ResourcesRecruiting
Responsibilities
Plan and manage projects involving GPU clusters, LLM inference systems, storage infrastructure, and developer APIs
Coordinate multi-team initiatives (infra engineering, product, ML, DevOps) from concept → delivery
Own roadmaps for major system components such as inference, fine-tuning, observability, network stack, and data pipelines
Run standups, sprint planning, retros, and weekly cross-team check-ins
Translate technical requirements into actionable plans, timelines, and milestones
Track blockers, manage complex dependencies, and ensure engineering has what they need to move fast
Serve as a bridge between engineering teams and leadership/stakeholders
Provide visibility through clear status updates, documentation, timelines, and KPIs
Facilitate technical discussions, capture decisions, and maintain project artifacts
Introduce lightweight processes that remove friction without slowing down engineers
Optimize how infra, ML, and product teams collaborate as the platform scales
Implement tooling and workflows (Jira, Linear, Notion, dashboards) to improve visibility
Qualification
Required
3–7+ years experience as a Technical Project Manager, Program Manager, Scrum Master, or similar role
Strong experience working with engineering-heavy teams (cloud infra, AI infra, platform, backend)
Ability to understand high-level concepts related to: GPUs, accelerators, H100/GB200 clusters; Distributed systems and microservices; LLM inference and fine-tuning workflows; Cloud infrastructure (AWS/GCP/Azure)
Exceptional organization and planning skills
Excellent communication—able to coordinate technical teams and align stakeholders
Preferred
Experience working in generative AI, ML tooling, or large-scale infra companies
Familiarity with Kubernetes, container orchestration, and infrastructure automation
Exposure to networking, storage systems, observability stacks, and cloud security
Ability to write clear technical summaries, architecture notes, or project spec documents
Benefits
Competitive compensation
Equity
Benefits
Flexible remote/hybrid environment
Company
Arc.dev
Arc is a global marketplace of top remote talent, vetted and ready to interview.
11-50 employees
H1B Sponsorship
Arc.dev has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2)
2022 (3)
Funding
Current Stage
Early StageTotal Funding
$1MKey Investors
Hyphen Capital
2021-04-28Equity Crowdfunding· $1M
2021-03-01Seed
Leadership Team
Weiting Liu
Founder & CEO
Recent News
linkedin.com
2024-12-02
Company data provided by crunchbase