Fortytwo · 2 months ago
Senior MLOps Engineer
United States
Full-time
Remote
Senior Level
5+ years expFortytwo is a decentralized AI protocol on Monad that leverages idle consumer hardware for swarm inference. They are seeking a Senior MLOps Engineer to deploy scalable ML services, optimize infrastructure, and integrate advanced ML techniques into workflows.
Artificial Intelligence (AI)
Responsibilities
Deploy scalable, production-ready ML services with optimized infrastructure and auto-scaling Kubernetes clusters
Optimize GPU resources using MIG (Multi-Instance GPU) and NOS (Node Offloading System)
Manage cloud storage (e.g., S3) to ensure high availability and performance
Integrate state-of-the-art ML techniques, such as LoRA and model merging, into workflows:
Work with SOTA ML codebases and adapt them to organizational needs
Integrate LoRA (Low-Rank Adaptation) techniques and model merging workflows
Deploy and manage large language models (LLM), small language models (SLM), and large multimodal models (LMM)
Serve ML models using technologies like Triton Inference Server
Leverage solutions such as vLLM, TGI (Text Generation Inference), and other state-of-the-art serving frameworks
Optimize models with ONNX and TensorRT for efficient deployment
Develop Retrieval-Augmented Generation (RAG) systems integrating spreadsheet, math, and compiler processors
Set up monitoring and logging solutions using Grafana, Prometheus, Loki, Elasticsearch, and OpenSearch
Write and maintain CI/CD pipelines using GitHub Actions for seamless deployment processes
Create Helm templates for rapid Kubernetes node deployment
Automate workflows using cron jobs and Airflow DAGs
Qualification
Required
Bachelor's or Master's degree in Computer Science, Engineering, or a related field
Proficiency in Kubernetes, Helm, and containerization technologies
Experience with GPU optimization (MIG, NOS) and cloud platforms (AWS, GCP, Azure)
Strong knowledge of monitoring tools (Grafana, Prometheus) and scripting languages (Python, Bash)
Hands-on experience with CI/CD tools and workflow management systems
Familiarity with Triton Inference Server, ONNX, and TensorRT for model serving and optimization
Preferred
5+ years of experience in MLOps or ML engineering roles
Experience with advanced ML techniques, such as multi-sampling and dynamic temperatures
Knowledge of distributed training and large model fine-tuning
Proficiency in Go or Rust programming languages
Experience designing and implementing highly secure MLOps pipelines, including secure model deployment and data encryption
Company
Fortytwo
Fortytwo is a decentralized AI network that employs swarm intelligence by linking consumer devices to execute small AI models.
2-10 employees
Funding
Current Stage
Early StageTotal Funding
$2.3MKey Investors
Big Brain Holdings
2025-03-06Pre Seed· $2.3M
Recent News
2025-11-02
Company data provided by crunchbase