AssemblyAI · 2 months ago
Senior Research Engineer
AssemblyAI is at the forefront of Speech AI, creating powerful models for speech-to-text and speech understanding. They are seeking a highly skilled Senior Research Engineer to collaborate with Research and Engineering teams, focusing on diagnosing and resolving bottlenecks in large-scale distributed training and inference systems while driving optimizations for existing high-performance pipelines.
Artificial Intelligence (AI)Developer APIsGenerative AIInformation TechnologySpeech Recognition
Responsibilities
Investigate and mitigate performance bottlenecks in large-scale distributed training and inference systems
Develop and implement both low-level (operator/kernel) and high-level (system/architecture) optimization strategies
Translate research models and prototypes into highly optimized, production-ready inference systems
Explore and integrate inference compilers such as TensorRT, ONNX Runtime, AWS Neuron and Inferentia, or similar technologies
Design, test, and deploy scalable solutions for parallel and distributed workloads on heterogeneous hardware
Facilitate knowledge transfer and bidirectional support between Research and Engineering teams, ensuring alignment of priorities and solutions
Qualification
Required
Strong expertise in the Python ecosystem and major ML frameworks (PyTorch, JAX)
Deep understanding of GPU acceleration (CUDA, profiling, kernel-level optimization)
Proven ability to accelerate deep learning workloads using compiler frameworks, graph optimizations, and parallelization strategies
Solid understanding of the deep learning lifecycle: model design, large-scale training, data processing pipelines, and inference deployment
Strong debugging, profiling, and optimization skills in large-scale distributed environments
Excellent communication and collaboration skills, with the ability to clearly prioritize and articulate impact-driven technical solutions
Preferred
Experience with lower-level programming (C++ or Rust preferred)
TPU experience is a strong plus
Benefits
Competitive equity grants
100% employer-paid benefits
The flexibility of being fully remote
Company
AssemblyAI
AssemblyAI is an artificial intelligence company that engages in building a platform of APIs to transcribe and understand audio data.
H1B Sponsorship
AssemblyAI has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2024 (1)
Funding
Current Stage
Growth StageTotal Funding
$113.12MKey Investors
AccelInsight Partners
2023-12-03Series C· $50M
2022-07-14Series B· $30M
2022-03-04Series A· $28M
Recent News
2025-11-24
Crunchbase News
2025-09-10
EIN Presswire
2025-07-15
Company data provided by crunchbase