Senior AI Infrastructure Software Engineer jobs in United States
info-icon
This job has closed.
company-logo

NVIDIA · 5 days ago

Senior AI Infrastructure Software Engineer

NVIDIA is a leading company in the field of AI technology, and they are seeking a Senior AI Infrastructure Software Engineer. The role involves collaborating with researchers to design and scale agents, developing scalable infrastructure for AI applications, and driving improvements in architecture and performance.

AI InfrastructureArtificial Intelligence (AI)Consumer ElectronicsFoundational AIGPUHardwareSoftwareVirtual Reality
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Design, develop, and improve scalable infrastructure to support the next generation of AI applications, including copilots and agentic tools
Drive improvements in architecture, performance, and reliability, enabling teams to bring to bear LLMs and advanced agent frameworks at scale
Collaborate across hardware, software, and research teams, mentoring and supporting peers while encouraging best engineering practices and a culture of technical excellence
Stay informed of the latest advancements in AI infrastructure and contribute to continuous innovation across the organization

Qualification

PythonLarge-scale distributed systemsMicroservicesJavaScriptSQLNoSQL databasesDistributed messaging systemsLLMs integrationCommunicationCollaborative approach

Required

Master or PhD or equivalent experience in Computer Science or related field, with a minimum of 5 years in large-scale distributed systems or AI infrastructure
Advanced expertise in Python (required), strong experience with JavaScript, and deep knowledge of software engineering principles, OOP/functional programming, and writing high-performance, maintainable code
Demonstrated expertise in crafting scalable microservices, web apps, SQL, and NoSQL databases (especially MongoDB and Redis) in production with containers, Kubernetes, and CI/CD
Solid experience with distributed messaging systems (e.g., Kafka), and integrating event-driven or decoupled architectures into robust enterprise solutions
Practical experience integrating and fine-tuning LLMs or agent frameworks (e.g., LangChain, LangGraph, AutoGen, OpenAI Functions, RAG, vector databases, timely engineering)
Demonstrated end-to-end ownership of engineering solutions, from architecture and development to deployment, integration, and ongoing operations/support
Excellent communication skills and a collaborative, proactive approach

Benefits

Equity
Benefits

Company

NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.

H1B Sponsorship

NVIDIA has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)

Funding

Current Stage
Public Company
Total Funding
$4.09B
Key Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity

Leadership Team

leader-logo
Jensen Huang
Founder and CEO
linkedin
leader-logo
Michael Kagan
Chief Technology Officer
linkedin
Company data provided by crunchbase