ChatGPT Jobs · 6 hours ago
Principal Machine Learning Engineer
Boston, MA
Full-time
Onsite
Lead/Staff
$190K/yr - $313K/yrRed Hat is seeking a Principal Machine Learning Engineer to join our AI Inference team, focused on bringing open-source LLMs and vLLM to enterprises. The role involves developing and optimizing deep learning software, implementing model compression algorithms, and productizing deep learning research.
Computer Software
Responsibilities
Contribute to the design, development, and testing of various inference optimization algorithms in vLLM and related projects
Create and manage inference serving deployment pipelines
Benchmark, profile, and evaluate different parallelizations, quantization and sparsification approaches
Participate in technical design discussions and provide innovative solutions
Stay up-to-date with the latest advancements in open source LLM model architecture and Inference parallelizations/optimizations techniques
Stay up-to-date of latest CPU and GPU hardware architecture and features to boost AI inference performance
Give thoughtful and prompt code reviews
Mentor and guide other engineers
Continuous collaboration with internal and external open source committers and contributors
Qualification
Required
Strong understanding of machine learning and deep learning fundamentals
Experience with tensor math libraries such as PyTorch and NumPy
Strong programming skills with Python based machine learning solutions
Ability to develop and implement research ideas and algorithms
Experience with mathematical software, especially linear algebra
Understanding of Linear Algebra, Gradients, Probability, and Graph Theory
Strong communications skills with both technical and non-technical team members
BS, or MS in computer science or computer engineering or a related field
Preferred
A PhD in a ML related domain is considered a strong plus
Benefits
Medical
Dental
Vision
Retirement
PTO
Company
ChatGPT Jobs
We find the best job offers for experts in ChatGPT and related technologies.
Founded in 2024
2-10 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase