Software Engineering Intern — LLM Systems & Applied AI Engineering jobs in United States
cer-icon
Apply on Employer Site
company-logo

A10 Networks, Inc · 6 hours ago

Software Engineering Intern — LLM Systems & Applied AI Engineering

A10 Networks, Inc is looking for a Software Engineering Intern passionate about building systems that make Large Language Models (LLMs) work in the real world. The intern will design and implement backend components, APIs, and pipelines that connect models to applications, contributing to high-impact projects in a fast-moving team at the intersection of software engineering and AI.

Cloud ComputingHardwareSecuritySEOVirtualizationWeb Hosting
badNo H1Bnote

Responsibilities

Design and implement backend components to support LLM inference and evaluation
Integrate model endpoints into APIs and services powering real-world applications
Contribute to tooling for fine-tuning, model orchestration, and inference optimization
Build monitoring and analytics layers to track model responses, latency, and reliability
Collaborate with ML engineers on serving pipelines, prompt evaluation, and guardrail logic
Prototype and ship features that connect models to production-grade systems

Qualification

GoPythonAPI designLLM frameworksInference performanceEagerness to learnSelf-driven mindset

Required

Currently enrolled in a Bachelor's, Master's, or PhD program in Computer Engineering or a related field in the U.S. for the full duration of the internship
Graduation expected between December 2026 – June 2027
Available for 12 weeks between May–August 2026 or June–September 2026

Preferred

Proficiency in Go and/or Python
Strong understanding of software engineering fundamentals and API design
Exposure to LLM frameworks such as Hugging Face, vLLM, or OpenAI API
Interest in model fine-tuning, evaluation pipelines, and prompt optimization
Familiarity with inference performance concepts such as token throughput, latency, and caching
Curiosity about how backend systems bring AI models to life from request to response
Self-driven mindset and eagerness to learn across AI and systems boundaries

Benefits

Hands-on experience with LLM model integration, fine-tuning, and inference systems
Deep understanding of how AI models are deployed, scaled, and evaluated in production
Mentorship from engineers building real-world AI infrastructure and safety systems
A collaborative, fast-paced environment where you can experiment, learn, and grow quickly

Company

A10 Networks, Inc

company-logo
A10 Networks provides security and infrastructure solutions for on-premises, hybrid cloud, and edge-cloud environments.

Funding

Current Stage
Public Company
Total Funding
$371.8M
Key Investors
Silicon Valley BankSummit PartnersMitsui Global Investment
2025-03-12Post Ipo Debt· $193.8M
2016-12-02Post Ipo Debt· $25M
2014-03-21IPO

Leadership Team

leader-logo
Dhrupad Trivedi
President & Chief Executive Officer
linkedin
leader-logo
Terry Young
Director, 5G and Service Provider Product Marketing
linkedin
Company data provided by crunchbase