Anyscale · 12 hours ago
Head of Ray Core / Ray Ecosystem ( Director of Engineering)
San Francisco, CA
Full-time
Onsite
Director/Executive
8+ years expAnyscale is on a mission to democratize distributed computing, focusing on the Ray ecosystem for scalable machine learning applications. The Director of Engineering will lead the Ray Core Engineering organization, shaping the technical direction and ensuring the growth and adoption of OSS Ray while collaborating with cross-functional teams.
AI InfrastructureArtificial Intelligence (AI)Developer PlatformInformation TechnologyMachine LearningOpen Source
Responsibilities
Lead and grow a team of senior engineers working on Ray Core and adjacent ecosystem components
Act as a technical leader in the open-source Ray community, setting standards for design, quality, and collaboration. Own the growth and adoption of OSS Ray
Own the technical vision and roadmap for Ray’s distributed runtime, including:
Cluster scheduling and resource management
Distributed execution and control-plane architecture
Fault tolerance, recovery, and correctness
Performance, scalability, and efficiency
Drive high-quality systems design and architecture, including RFCs, design reviews, and long-term API strategy
Ensure Ray Core continues to scale across:
Larger clusters and heterogeneous hardware
Increasingly diverse workloads (ML, data, agents, serving)
A growing open-source user and contributor base
Partner cross-functionally with product, research, and go-to-market teams to align technical execution with company strategy
Develop and mentor engineering leaders and senior ICs, fostering a strong culture of technical excellence and ownership
Qualification
Required
8+ years of software engineering experience, with significant time spent building distributed systems or systems infrastructure
5+ years of experience leading and scaling engineering teams, ideally including managers
Strong background in one or more of: distributed systems and/or databases, schedulers, runtimes, or control planes, cloud infrastructure or large-scale backend systems
Deep understanding of systems fundamentals such as: concurrency and parallelism, fault tolerance and consistency, performance and resource isolation
Experience working with or leading open-source software (as a maintainer, contributor, or heavy user)
Ability to operate as a player-coach: comfortable diving into technical details while leading at the organizational level
Strong communication skills and a track record of making sound technical tradeoffs in complex systems
Preferred
Experience with Ray, Spark, Kubernetes, or similar distributed frameworks
Background in ML systems, data systems, or large-scale compute platforms
Experience leading teams responsible for widely used, long-lived APIs
Benefits
Competitive compensation
Equity
Benefits
Company
Anyscale
Anyscale accelerates the development and productionization of any AI app, on any cloud, at any scale.
201-500 employees
H1B Sponsorship
Anyscale has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (33)
2024 (14)
2023 (10)
2022 (10)
2021 (4)
2020 (1)
Funding
Current Stage
Growth StageTotal Funding
$259MKey Investors
New Enterprise AssociatesAndreessen Horowitz
2022-08-23Series C· $99M
2021-12-07Series C· $100M
2020-10-21Series B· $40M
Leadership Team
Keerti Melkote
Chief Executive Officer
Ion Stoica
Co-Founder & Executive Chairman
Recent News
globalventuring.com
2026-01-12
Andreessen Horowitz
2026-01-12
Company data provided by crunchbase