Apply on Employer Site

Wallaroo.AI · 1 month ago

Principal or Staff AI/ML Engineer

United States

Full-time

Remote

Lead/Staff

8+ years exp

Wallaroo.AI is a Microsoft-backed startup at the forefront of AI, developing a powerful software platform that empowers AI teams to deploy AI inference at scale. The Principal or Staff AI/ML Engineer will lead the charge in advancing inference capabilities on the latest hardware, collaborating closely with customers and hardware teams to solve problems and mentor less experienced team members.

Artificial Intelligence (AI)Enterprise SoftwareMachine LearningReal Time

Responsibilities

At Wallaroo.AI, building a great product is a team endeavor

We expect active participation in discussions, proactive communication, and continuous feedback

You'll partner closely with customers and hardware teams to solve problems and build capabilities

As an experienced engineer, you'll negotiate tradeoffs with product managers, break down feature requests into incremental, high-quality deliverables, and mentor less experienced team members

You'll also propose process and workflow improvements, and confidently advocate for your perspective while thoughtfully listening to others

Qualification

PythonVLLMDeep learning architecturesML pipelinesRustDockerAWSGPU software environmentsCommunication

Required

Excellent verbal and written communication skills

Expert Python, including extensive packaging experience using Pip, uv, etc

Strong experience with vLLM, SGLang, and other modern serving frameworks

Experience developing high-scale production ML pipelines

A strong foundation in deep learning architectures, especially the Transformer architecture, including experience with NLP tasks like text generation, summarization, and sentiment analysis using commonly available LLM APIs and SDKs (ie, OpenAI, Anthropic, Mistral, etc)

At least eight years related experience recommended