Oversight · 2 months ago
Machine Learning Engineer - LLMs and Agentic
United States
Full-time
Remote
Mid Level
3+ years expOversight is the world’s leading provider of AI-based spend management and risk mitigation solutions for large enterprises. The role involves designing, implementing, and optimizing machine learning models, particularly focusing on Large Language Models, to enhance enterprise spend management and risk controls.
AccountingArtificial Intelligence (AI)Big DataBusiness Information SystemsComplianceEnterprise SoftwareFinTechMachine LearningManagement Information SystemsSaaS
Responsibilities
Contribute to the design, training, fine-tuning, and deployment of ML/LLM models for production
Implement RAG pipelines using vector databases
Work with frameworks like LangChain, LangGraph, MCP to prototype and optimize multi-agent workflows
Develop prompt engineering, optimization, and safety techniques for agentic LLM interactions
Integrate memory, evidence packs, and explainability modules into agentic pipelines
Work hands-on with multiple LLM ecosystems: OpenAI GPT models (GPT-4, GPT-4o, fine-tuned GPTs), Anthropic Claude (Claude 2/3 for reasoning and safety-aligned workflows), Google Gemini (multimodal reasoning, advanced RAG integration), Meta LLaMA (fine-tuned/custom models for domain-specific tasks)
Collaborate with Data Engineering to build and maintain real-time and batch data pipelines that serve ML/LLM workloads
Conduct feature engineering, preprocessing, and embeddings generation for structured and unstructured data
Implement model monitoring, drift detection, and retraining pipelines
Leverage cloud ML platforms (AWS Sagemaker, Databricks ML) for experimentation and scaling
Explore and evaluate emerging LLM/SLM architectures and agent orchestration patterns
Experiment with generative AI and multimodal models to extend capabilities beyond text (images, structured financial data)
Collaborate with R&D to prototype autonomous resolution agents, anomaly detection models, and reasoning engines
Translate research prototypes into production-ready components
Work cross-functionally with R&D, Data Science, Product, and Engineering to deliver business-aligned AI features
Participate in design reviews, architecture discussions, and model evaluations
Document processes, experiments, and results effectively for knowledge sharing
Mentor junior engineers and contribute to ML engineering best practices
Qualification
Required
Bachelor's or Master's degree in Computer Science, Data Science, Machine Learning, or related field
3+ years of experience building and deploying ML systems
Proficiency in Python and libraries such as PyTorch, TensorFlow, Scikit-Learn, Hugging Face Transformers
Hands-on experience with LLMs/SLMs (fine-tuning, prompt design, inference optimization)
Demonstrated experience with at least two of the following ecosystems: OpenAI GPT models (chat, assistants, fine-tuning), Anthropic Claude (safety-first AI for reasoning and summarization), Google Gemini (multimodal reasoning, enterprise-scale APIs), Meta LLaMA (open-source, fine-tuned models)
Familiarity with vector databases, embeddings, and RAG pipelines
Ability to work with structured and unstructured data at scale
Knowledge of SQL and distributed data frameworks (Spark, Ray)
Strong understanding of ML lifecycle: data prep, training, evaluation, deployment, monitoring
Preferred
Experience with agentic frameworks (LangChain, LangGraph, MCP, AutoGen)
Knowledge of AI safety, guardrails, and explainability techniques
Hands-on experience deploying ML/LLM solutions in cloud environments (AWS, GCP, Azure)
Experience with CI/CD for ML (MLOps), monitoring, and observability
Familiarity with anomaly detection, fraud/risk modeling, or behavioral analytics
Contributions to open-source AI/ML projects or publications in applied ML research
Company
Oversight
Oversight develops & sells solutions to help businesses use artificial intelligence to guard against fraud, errors and to ensure compliance.
51-200 employees
H1B Sponsorship
Oversight has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2)
2024 (1)
2021 (1)
Funding
Current Stage
Growth StageTotal Funding
$37.15MKey Investors
Westbury Partners
2020-09-02Series Unknown
2020-09-02Acquired
2019-02-01Private Equity
Leadership Team
Terrence McCrossan
CEO
Bala Tiru
Chief Product Officer
Recent News
2026-01-06
GlobalFinTechSeries
2025-12-17
Company data provided by crunchbase