TRM Labs · 1 month ago
Senior MLOps Engineer – LLMOps
United States
Full-time
Remote
Senior Level
$215K/yr - $230K/yrTRM Labs is a blockchain intelligence company focused on fighting crime and enhancing global security. As a Senior MLOps Engineer specializing in LLMOps, you will be responsible for building and scaling the technical infrastructure for AI/ML systems, ensuring efficient deployment and governance of AI models and workflows.
Big DataBlockchainComplianceCryptocurrency
Responsibilities
Build reusable CI/CD workflows for model training, evaluation, and deployment — integrating Langfuse, GitHub Actions, and experiment tracking, etc
Automate model versioning, approval workflows, and compliance checks across environments
Build out a modular and scalable AI infrastructure stack — including vector databases, feature stores, model registries, and observability tooling
Partner with engineering and data science to embed AI models and agents into real-time applications and workflows
Continuously evaluate and integrate state-of-the-art AI tools (e.g. LangChain, LlamaIndex, vLLM, MLflow, BentoML, etc.)
Drive AI reliability and governance, enabling experimentation while ensuring compliance, security, and uptime
Build and enhance AI/ML Model Performance
Ensure data accuracy, consistency and reliability, leading to better model training and inferencing
Deploy infrastructure to support offline and online evaluation of LLMs and agents — including regression testing, cost monitoring, and human-in-the-loop workflows
Enable researchers to iterate quickly by providing sandboxes, dashboards, and reproducible environments
Qualification
Required
Write high-quality, maintainable software — primarily in Python, but we value engineering ability over language familiarity
Have a strong background in scalable infrastructure, including:
Containerization and orchestration (e.g. Docker, Kubernetes)
Infrastructure-as-code and deployment (e.g. Terraform, CI/CD pipelines)
Monitoring and logging frameworks (e.g. Datadog, Prometheus, OpenTelemetry)
Understand and implement ML Ops best practices, including:
Model versioning and rollback strategies
Automated evaluation and drift detection
Scalable model and agent serving infrastructure (e.g. vLLM, Triton, BentoML)
Deploy and maintain LLM and agentic workflows in production, including:
Monitoring cost, latency, and performance
Capturing traces for analysis and debugging
Optimizing prompt/response flows with real-time data access
Demonstrate strong ownership and pragmatism, balancing infrastructure elegance with iterative delivery and measurable impact
Benefits
PTO
Holidays
Parental Leave
Company
TRM Labs
TRM Labs is a software company that offers blockchain, transaction monitoring, and analytics to help financial institutions and governments.
Founded in 2018
201-500 employees
H1B Sponsorship
TRM Labs has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2024 (4)
2023 (3)
2022 (3)
2021 (1)
Funding
Current Stage
Growth StageTotal Funding
$149.9MKey Investors
Thoma BravoJP Morgan ChaseTiger Global Management
2022-11-09Series B· $70M
2022-04-04Series B
2022-02-28Series Unknown
Leadership Team
Esteban Castano
Co-founder & CEO
Rahul Raina
Co-Founder
Recent News
Business Wire
2026-01-09
2026-01-09
Company data provided by crunchbase