Modular · 3 hours ago
GenAI Performance and Quality Intern
Modular is on a mission to revolutionize AI infrastructure by rebuilding the AI software stack. The intern will analyze, optimize, and safeguard the performance of large language models and generative AI systems, focusing on performance bottlenecks and automation frameworks.
AI InfrastructureArtificial Intelligence (AI)Generative AIMachine LearningSoftware
Responsibilities
Analyzing, optimizing, and safeguarding the performance of large language models and generative AI systems
Identifying performance bottlenecks in LLM inference pipelines
Developing automation frameworks to streamline performance testing
Designing and implementing performance analysis workflows
Designing performance regression detection pipelines
Conducting speed-of-light analyses
Benchmarking across several inference frameworks
Optimizing model serving infrastructure
Investigating memory and compute efficiency
Establishing performance baselines and alerting systems
Qualification
Required
Currently pursuing a Bachelor's, Master's, or PhD degree in Computer Science, Computer Engineering, or a related field, with graduation expected by Spring 2027 at the latest
Proficiency in Python
Experience and interest in designing and building automated performance analysis workflows
Strong problem-solving skills and a passion for building tools and robust workflows to improve system reliability and developer productivity
Preferred
Experience with systems performance analysis, C++, or systems-level programming is a strong plus
Familiarity with profiling tools, benchmarking methodologies, CI/CD systems, or performance optimization techniques
Experience with tools such as NVIDIA Nsight Systems (nsys), Nsight Compute, PyTorch Profiler, Linux perf, or Intel VTune is a plus
Benefits
Competitive Compensation.
Stock options.
Team Building Events.
Company
Modular
Modular provides AI infrastructure for deployment, serving, and programming GPUs.
H1B Sponsorship
Modular has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (10)
2024 (6)
2023 (8)
2022 (4)
Funding
Current Stage
Growth StageTotal Funding
$380MKey Investors
US Innovative Technology FundGeneral CatalystGoogle Ventures
2025-09-24Series C· $250M
2023-08-24Series B· $100M
2022-06-30Seed· $30M
Recent News
General Catalyst
2026-01-14
General Catalyst
2026-01-14
Greylock
2025-12-29
Company data provided by crunchbase