Apply on Employer Site

Cast AI · 1 month ago

Senior Machine Learning Engineer - AI Enabler Team

European Union

Full-time

Onsite

Senior Level

$6,500/mo - $9,000/mo

5+ years exp

Cast AI is the leading Application Performance Automation platform, enabling customers to optimize cloud costs and improve performance. The Senior Machine Learning Engineer will be part of the AI Enabler team, focusing on R&D challenges related to AI infrastructure and ensuring automated, cost-efficient AI-related decisions for clients' Kubernetes infrastructure.

Artificial Intelligence (AI)Cloud ComputingCloud InfrastructureCloud ManagementCloud SecurityDeveloper PlatformDeveloper ToolsDevOpsSaaSSoftware

No H1B

Responsibilities

Evaluate and Analyze LLM performance

Architect and build inference and training pipelines, directly contributing through hands-on design, model training pipeline, and deployment strategies

Stay up to date with industry trends

Qualification

Machine LearningPythonML inference optimizationsDistributed training patternsNetwork optimizationIndependenceEnglish skillsVerbal communicationWritten communicationCollaboration

Required

5+ years of hands-on experience in Data Science and Machine Learning, with a proven track record, demonstrated through a robust portfolio of projects

Strong software engineering skills in Python

Ability to move fast in an environment where things are sometimes loosely defined and may have competing priorities or deadlines

Expertise in ML inference optimizations, including techniques such as: Reducing initialization time and memory requirements; Utilizing reduced precision and weight quantization; Inference engine tuning (vLLM, SGLang, TensorRT)

Knowledge of network optimization for distributed ML training and inference

Understanding of distributed training patterns and checkpointing strategies

You have to be physically in any of the European countries GMT 0 to GMT +3

Strong English skills

Strong verbal and written communication skills

Ability to work independently and collaborate in a group