Linux Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Kerry Search Partners ยท 6 hours ago

Linux Engineer

Kerry Search Partners is a global leader in the semiconductor manufacturing ecosystem, driving technology behind various electronic devices. They are seeking a ML Ops Engineer to design, build, and operate a foundational Generative AI platform that supports internal products and engineering tooling, focusing on both on-premises and cloud environments.

Responsibilities

Build and operate a GenAI platform that supports internal products such as AI assistants and engineering tooling
Design and maintain Kubernetes-based AI infrastructure running on on-prem GPU clusters and cloud environments
Configure and manage LLMs (e.g., open-source models such as LLaMA variants) for enterprise use
Deploy and operate vector databases to support retrieval-augmented generation (RAG) workflows
Ensure high availability, scalability, and efficient GPU utilization across expensive compute environments
Partner closely with ML engineers and application teams who will build on top of the platform you create
Implement secure, compliant, and observable infrastructure suitable for enterprise adoption
Leverage Linux and open-source tooling to optimize performance in high-performance computing (HPC) environments

Qualification

Linux systemsKubernetesAI/ML platformsGPU infrastructureLLMsVector databasesHPC environmentsOpen-source toolingCost optimizationPlatform support

Required

Strong Linux systems background (on-prem experience is essential)
Deep experience with Kubernetes as a core platform (deploying, operating, troubleshooting)
Hands-on experience building or operating AI/ML platforms (not just consuming them)
Experience configuring and managing GPU infrastructure for AI/ML workloads
Familiarity with LLMs, GenAI infrastructure, and vector databases
Exposure to HPC environments and high-throughput workloads
Experience operating platforms across on-prem, cloud, or hybrid environments

Preferred

Experience deploying open-source GenAI tooling
Understanding of cost optimization and scheduling for GPU-heavy workloads
Experience supporting internal platform consumers at scale

Company

Kerry Search Partners

twitter
company-logo
We are a boutique executive-search firm with a dedicated focus on the pharmaceutical, medical device and technology sectors across North America and EMEA.

Funding

Current Stage
Early Stage
Company data provided by crunchbase