Anthropic · 2 weeks ago
Performance Engineer, GPU
San Francisco, CA
Full-time
Hybrid
Senior Level
$315K/yr - $560K/yrAnthropic is a public benefit corporation focused on creating reliable and interpretable AI systems. The GPU Performance Engineer will architect and implement foundational systems to maximize GPU utilization and performance for large language models, working at the intersection of hardware and software.
Artificial Intelligence (AI)Foundational AIGenerative AIInformation TechnologyMachine Learning
Responsibilities
Architect and implement foundational systems that power Claude and push the frontiers of what's possible with large language models
Maximize GPU utilization and performance at unprecedented scale
Develop cutting-edge optimizations that directly enable new model capabilities and dramatically improve inference efficiency
Implement state-of-the-art techniques from custom kernel development to distributed system architectures
Work spans the entire stack—from low-level tensor core optimizations to orchestrating thousands of GPUs in perfect synchronization
Deliver transformative GPU performance improvements in production ML systems
Shape the future of AI infrastructure alongside world-class researchers and engineers
Co-design attention mechanisms and algorithms for next-generation hardware architectures
Develop custom kernels for emerging quantization formats and mixed-precision techniques
Design distributed communication strategies for multi-node GPU clusters
Optimize end-to-end training and inference pipelines for frontier language models
Build performance modeling frameworks to predict and optimize GPU utilization
Implement kernel fusion strategies to minimize memory bandwidth bottlenecks
Create resilient systems for planet-scale distributed training infrastructure
Profile and eliminate performance bottlenecks in production serving infrastructure
Partner with hardware vendors to influence future accelerator capabilities and software stacks
Qualification
Required
At least a Bachelor's degree in a related field or equivalent experience
Deep experience with GPU programming and optimization at scale
Impact-driven, passionate about delivering measurable performance breakthroughs
Ability to navigate complex systems from hardware interfaces to high-level ML frameworks
Enjoy collaborative problem-solving and pair programming
Desire to work on state-of-the-art language models with real-world impact
Care about the societal impacts of your work
Thrive in ambiguous environments where you define the path forward
Preferred
GPU Kernel Development: CUDA, Triton, CUTLASS, Flash Attention, tensor core optimization
ML Compilers & Frameworks: PyTorch/JAX internals, torch.compile, XLA, custom operators
Performance Engineering: Kernel fusion, memory bandwidth optimization, profiling with Nsight
Distributed Systems: NCCL, NVLink, collective communication, model parallelism
Low-Precision: INT8/FP8 quantization, mixed-precision techniques
Production Systems: Large-scale training infrastructure, fault tolerance, cluster orchestration
Benefits
Equity and benefits
Optional equity donation matching
Generous vacation and parental leave
Flexible working hours
Company
Anthropic
Anthropic is an AI research company that focuses on the safety and alignment of AI systems with human values.
Founded in 2021
501-1000 employees
H1B Sponsorship
Anthropic has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (105)
2024 (13)
2023 (3)
2022 (4)
2021 (1)
Funding
Current Stage
Late StageTotal Funding
$33.74BKey Investors
Lightspeed Venture PartnersGoogleAmazon
2025-09-02Series F· $13B
2025-05-16Debt Financing· $2.5B
2025-03-03Series E· $3.5B
Leadership Team
Dario Amodei
CEO & Co-Founder
Daniela Amodei
President and co-founder
Recent News
2026-01-11
Insurance giant Allianz signs Claude Code deal with Anthropic | CIO
2026-01-11
Company data provided by crunchbase