Otter.ai · 10 hours ago
Software Engineer, Infrastructure (ML and Real-Time Speech)
United States
Full-time
Remote
Entry, Mid Level
$185K/yr - $275K/yr
2+ years expOtter.ai is a leading tool for meeting transcription and collaboration, aiming to make conversations more valuable. They are seeking an experienced Software Engineer to build infrastructure for advanced speech recognition and real-time speaker identification systems, working closely with machine learning researchers and product managers.
Artificial Intelligence (AI)CollaborationConsumer SoftwareEnterprise SoftwareInformation Technology
Responsibilities
Design, build, and operate backend services that power real-time, multi-language, ASR and speaker identification features
Architect scalable, fault-tolerant infrastructure across databases, queues, and pub/sub systems to support low-latency ML workflows
Partner with ML teams to productionize models (training pipelines, model deployment, versioning, and monitoring) for real-time and batch inference
Improve system observability, reliability, and performance for large-scale speech data ingestion and streaming
Contribute to the evolution of our platform architecture, including microservices, orchestration (Kubernetes), and API integrations
Collaborate with cross-functional teams to streamline developer experience, CI/CD pipelines, and automated testing for ML-backed services
Qualification
Required
2+ years of experience designing and building scalable backend systems and distributed infrastructure
Fluent in Python (bonus for C++) and familiar with building high-performance services
Understands data structures, algorithms, distributed systems, and operating systems at a deep level
Has worked with databases (SQL & NoSQL), queuing systems, and pub/sub solutions, and knows what's happening 'under the hood'
Has experience with ML infrastructure / MLOps (e.g., model deployment, feature stores, pipelines) or is eager to learn quickly
Enjoys collaborating with ML engineers and product teams to translate research into production-ready systems
Thrives in a fast-paced environment where innovation and reliability go hand in hand
Preferred
Experience with real-time streaming frameworks (Kafka, Pulsar, Flink)
Hands-on experience with container orchestration (Kubernetes, ECS)
Familiarity with SDK integrations or developer platform design
Experience building or optimizing speech/voice AI pipelines
Company
Otter.ai
Otter.ai improves business team productivity by providing an app to capture, share, and recall all meeting notes.
51-200 employees
H1B Sponsorship
Otter.ai has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (30)
2024 (17)
2023 (19)
2022 (8)
2021 (4)
Funding
Current Stage
Growth StageTotal Funding
$73MKey Investors
Horizons Ventures
2021-02-25Series B· $40M
2021-02-25Convertible Note· $10M
2020-01-23Series Unknown· $10M
Leadership Team
Sam Liang
CEO, Founder
Yun Fu
CTO and Co-Founder
Recent News
Company data provided by crunchbase