62 applicants

Company

NVIDIA · 1 day ago

Senior Deep Learning Algorithm Engineer - Agentic LLM Inference

California, United States

Full-time

Remote

Mid, Senior Level

$180K/yr - $339K/yr

3+ years exp

Maximize your interview chances

Artificial Intelligence (AI)GPU

Growth Opportunities

H1B Sponsor Likely

Hiring Manager

Deepika Yammanur (she/her/hers)

Insider Connection @NVIDIA

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Research and Development: Explore and incorporate contemporary research on generative AI, agents, and inference systems into the NVIDIA LLM software stack.

Workload Analysis and Optimization: Conduct in-depth analysis, profiling, and optimization of agentic LLM workloads to significantly reduce request latency and increase request throughput while maintaining workflow fidelity.

System Design and Implementation: Design and implement scalable systems to accelerate agentic workflows and efficiently handle sophisticated datacenter-scale use cases.

Collaboration and Communication: Advise future iterations of NVIDIA software, hardware, and system by engaging with a diverse set of teams at NVIDIA and external partners and formalizing the strategic requirements presented by their workloads.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Deep LearningPythonC++Computer ArchitectureGPU ComputingPerformance AnalysisLLM Inference SystemsSystem DesignCUDAOpenCLLangchainLLamaIndex

Required

BS, MS, PhD in Computer Science, Electrical Engineering, Computer Engineering, or a related field (or equivalent experience).

3+ years of experience in deep learning and deep learning systems design.

Proficiency in Python and C++ programming.

Strong understanding of computer architecture, and GPU/parallel datacenter computing fundamentals.

Proven interest in analyzing, modeling, and tuning application performance.

Preferred

2+ years of experience in building large-scale LLM inference systems, especially those involving compound AI.

Experience with agentic LLM frameworks such as Langchain and LLamaIndex.

Experience with processor and system-level performance modeling.

GPU programming experience with CUDA or OpenCL.

Benefits

Equity

Benefits

Company

NVIDIA

Glassdoor

4.6

NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.

Founded in 1993

Santa Clara, California, USA

10,001+ employees

https://www.nvidia.com

H1B Sponsorship

NVIDIA has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2023 (735)

2022 (892)

2021 (696)

2020 (534)