Software Engineering Intern — LLM Systems &… at A10 Networks,… · San…

Summary: A10 Networks, Inc is seeking a Software Engineering Intern passionate about building systems for Large Language Models (LLMs). The intern will design and implement backend components and APIs that connect models to applications, contributing to high-impact projects in AI. Responsibilities: - Design and implement backend components to support LLM inference and evaluation - Integrate model endpoints into APIs and services powering real-world applications - Contribute to tooling for fine-tuning, model orchestration, and inference optimization - Build monitoring and analytics layers to track model responses, latency, and reliability - Collaborate with ML engineers on serving pipelines, prompt evaluation, and guardrail logic - Prototype and ship features that connect models to production-grade systems Required Qualifications: - Currently enrolled in a Bachelor's, Master's, or PhD program in Computer Engineering or a related field in the U.S. for the full duration of the internship - Graduation expected between December 2026 – June 2027 - Available for 12 weeks between May–August 2026 or June–September 2026 Preferred Qualifications: - Proficiency in Go and/or Python - Strong understanding of software engineering fundamentals and API design - Exposure to LLM frameworks such as Hugging Face, vLLM, or OpenAI API - Interest in model fine-tuning, evaluation pipelines, and prompt optimization - Familiarity with inference performance concepts such as token throughput, latency, and caching - Curiosity about how backend systems bring AI models to life from request to response - Self-driven mindset and eagerness to learn across AI and systems boundaries Required Skills: Go, Python, Software engineering fundamentals, API design, LLM frameworks, Model fine-tuning, Evaluation pipelines, Prompt optimization, Inference performance, Backend systems, Model integration, Model inference, Eagerness to learn, Self-driven mindset