poolside · 10 months ago
Member of Engineering (Inference)
United States
Full-time
Remote
Mid, Senior LevelPoolside is a company focused on creating Artificial General Intelligence to drive economic value and scientific progress. The role involves building out multi-device inference of Large Language Models and optimizing performance across various hardware platforms.
Artificial Intelligence (AI)Developer PlatformInformation TechnologyInfrastructureSoftware
Responsibilities
Follow the latest research on LLMs, inference and source code generation
Propose and evaluate innovations, both in the quality and the efficiency of the inference
Monitor and implement LLM inference metrics in production
Write high-quality high-performance Python, Cython, C/C++, Triton, ThunderKittens, native CUDA, Amazon Neuron code
Work in the team: plan future steps, discuss, and always stay in touch
Qualification
Required
Experience with Large Language Models (LLM)
Confident knowledge of the computational properties of transformers
Knowledge/Experience with cutting-edge inference tricks
Knowledge/Experience of distributed and lower precision inference
Knowledge of deep learning fundamentals
Strong engineering background
Theoretical computer science knowledge is a must
Experience with programming for hardware accelerators
SIMD algorithms
Expert in matrix multiplication bottlenecks
Know hardware operation latencies by heart
Programming experience in Linux
Programming experience with Git
Programming experience in Python with PyTorch or Jax
Programming experience in C/C++, CUDA, Triton, ThunderKittens
Use modern tools and are always looking to improve
Opinionated but reasonable, practical, and not afraid to ignore best practices
Strong critical thinking and ability to question code quality policies when applicable
Preferred
Can freely discuss the latest papers and descend to fine details
You have strong opinions, weakly held
Author of scientific papers on any of the topics: applied deep learning, LLMs, source code generation, etc
Prior experience in non-ML programming
Benefits
Fully remote work & flexible hours
37 days/year of vacation & holidays
Health insurance allowance for you and dependents
Company-provided equipment
Wellbeing, always-be-learning and home office allowances
Frequent team get togethers
Great diverse & inclusive people-first culture
Company
poolside
Poolside is an artificial intelligence platform that offers foundation concepts and infrastructure to write software codes.
Founded in 2023
51-200 employees
H1B Sponsorship
poolside has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
Funding
Current Stage
Growth StageTotal Funding
$626MKey Investors
Bain Capital VenturesRedpoint
2024-10-02Series B· $500M
2023-08-24Series A· $100M
2023-05-14Seed· $26M
Leadership Team
Eiso Kant
Co-CEO & Co-founder
Jason Warner
Co-CEO & Co-Founder
Recent News
2025-12-17
2025-11-13
2025-11-11
Company data provided by crunchbase