ML Engineer - Inference jobs in United States
cer-icon
Apply on Employer Site
company-logo

Symbl.ai (Acq. by Invoca) · 5 months ago

ML Engineer - Inference

Symbl.ai is a venture-funded AI startup focused on building conversational AI since 2018. As an ML Engineer specializing in Inference, you will be responsible for developing and optimizing deep learning models for real-time communication, particularly for the Nebula large language model.

Artificial Intelligence (AI)Developer APIsGenerative AIInformation Technology
check
H1B Sponsor Likelynote

Responsibilities

Design and implement efficient algorithms and models for real-time inference in Conversation AI applications, with a focus on Nebula
Collaborate with cross-functional teams to integrate machine learning models into production systems, ensuring scalability, reliability, and performance
Optimize and fine-tune machine learning models for resource-constrained environments, such as edge devices or cloud-based platforms
Develop monitoring and evaluation mechanisms to assess the performance and effectiveness of inference models in real-world scenarios
Stay updated on the latest advancements in machine learning inference techniques and methodologies, incorporating new approaches into our projects as needed
Contribute to the documentation and dissemination of best practices for implementing and deploying machine learning inference solutions

Qualification

Machine LearningDeep LearningPythonTensorFlowPyTorchModel OptimizationCUDNN/TensorRTCommunication FrameworksPassion for LearningProblem-SolvingCollaboration

Required

5 years of experience in machine learning and inference models
Strong background in machine learning, with hands-on experience in developing and deploying inference models in production environments
Proficiency in Python and relevant machine learning frameworks such as TensorFlow or PyTorch
Experience with optimization techniques for machine learning models, including quantization, pruning, and model compression
Strong problem-solving skills and the ability to troubleshoot and debug complex technical issues related to inference
Excellent communication and collaboration skills, with the ability to work effectively in a remote team environment
Passion for learning and staying updated on advancements in machine learning inference technologies, with a keen interest in applying these technologies to Conversation AI
Experience in fundamental libraries for accelerating ML workflows, like CUDNN/TensorRT, ROCm, OpenVino, or OpenPPL
Understanding of one or more ML communication frameworks like NCCL is an advantage

Benefits

100% covered health coverage for you, and 90% for your dependents.
100% covered Life & AD&D, and short-term disability coverage for you.
401(k) with 3% matching.
Continued education and professional development.
Symbl’s fixed leave policy of 18 Planned vacation days, 8 sick days, generous maternity, paternity and 16 annual holidays.

Company

Symbl.ai (Acq. by Invoca)

twittertwittertwitter
company-logo
Symbl.ai | The Real-time AI Infrastructure for Human Conversations Get access to state of the art understanding and generative models built for all types of communication data to transform unstructured conversations into knowledge, events and insights.

H1B Sponsorship

Symbl.ai (Acq. by Invoca) has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2022 (3)

Funding

Current Stage
Growth Stage
Total Funding
$23.62M
Key Investors
GreatPoint VenturesCrosscut VenturesFlying Fish Partners
2025-05-28Acquired
2021-11-05Series A· $17M
2020-10-30Seed· $4.7M

Leadership Team

leader-logo
Surbhi Rathore
CEO & Co-Founder
linkedin
leader-logo
Toshish Jawale
CTO & Co-founder
linkedin
Company data provided by crunchbase