Machine Learning Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Red Hat · 1 day ago

Machine Learning Engineer

positionBoston
timeFull-time
remoteHybrid
seniorityEntry, Mid Level
money$134K/yr - $221K/yr
date2+ years exp

Red Hat is the world’s leading provider of enterprise open source software solutions, and they are seeking a Machine Learning Engineer. The role involves designing and implementing high-performance code for inference systems and optimizing algorithms to enhance performance and efficiency.

Enterprise SoftwareInsurTechLinuxOpen SourceOperating SystemsSoftware
check
Culture & Values
check
H1B Sponsor Likelynote

Responsibilities

Develop, test, and optimize LLM inference algorithms, including quantization and sparsification techniques, to improve latency, throughput, and memory use
Conduct performance profiling and modeling on NVIDIA GPUs using tools such as Nsight, tune CUDA, Triton, or CUTLASS kernels for deep neural networks
Participate in technical design reviews and propose innovative HPC solutions for large-scale model serving
Review peer code promptly and leverage AI-assisted development tools to uphold code quality standards
Collaborate with cross-functional AI, product, and research teams to deliver features to Red Hat AI Inference Platform
Document best practices and mentor engineers to foster a culture of continuous learning and open-source contribution
Stay current with cutting-edge LLM optimization research (quantization, sparsity, speculative decoding) and integrate relevant advances into the product

Qualification

PythonC++CUDADeep learning frameworksPerformance analysisLLM inference optimizationDistributed computingMentoringCollaborationDocumentation

Required

Bachelor's degree (U.S. or foreign equivalent) in Computer Science, Computer Engineering or related field and two (2) years of experience in the job offered or related role
Must have two (2) years of experience with: Python and Modern C++; CUDA, Triton, or CUTLASS kernel optimization; Deep learning frameworks, including PyTorch; performance analysis and profiling; and GPU memory architecture
Must have one (1) year of experience with: LLM inference optimization; and distributed computing including inter and intra GPU communication protocols

Benefits

May also be eligible for bonus, commission, and/or equity.

Company

Red Hat

twittertwittertwitter
Glassdoor4.1
company-logo
Red Hat is a software company that offers enterprise open-source software solutions. It is a sub-organization of IBM.
dateFounded in 1993
location
Raleigh, North Carolina, USA
people-size10001+ employees
web-link
http://www.redhat.com

H1B Sponsorship

Red Hat has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (159)
2024 (148)
2023 (156)
2022 (181)
2021 (154)
2020 (106)

Funding

Current Stage
Public Company
Total Funding
unknown
2018-10-28Acquired
1999-08-20IPO
1999-03-09Corporate Round

Leadership Team

leader-logo
Chris Wright
Chief Technology Officer and Senior Vice President Global Engineering
linkedin
leader-logo
Andrew Brown
Senior Vice President and Chief Revenue Officer
linkedin

Recent News

Business Wire
Lenovo Revolutionizes Real-Time Enterprise AI with New Inferencing Servers
2026-01-07
MarketScreener
Lenovo Group Limited Revolutionizes Real-Time Enterprise Ai with New Inferencing Servers
2026-01-07
The New Stack
Red Hat Customizes RHEL for Nvidia’s Vera Rubin AI Platform
2026-01-07
Company data provided by crunchbase