Cohere · 2 hours ago
Software Engineer - Applied ML (US/CAN)
New York, NY
Full-time
Hybrid
Mid LevelCohere is on a mission to scale intelligence to serve humanity by training and deploying frontier models for AI systems. The role of Applied AI Software Engineer involves supporting the development and deployment of custom LLMs and AI agents while collaborating closely with machine learning and platform teams to deliver impactful enterprise solutions.
Artificial Intelligence (AI)Generative AIMachine LearningNatural Language Processing
Responsibilities
Design and build Agentic AI applications, including RAG systems, to deliver high business value customer use-cases
Design, build and maintain data generation and evaluation pipelines to power custom LLM model development
Develop backend services and APIs to support ML/LLM workflows at scale
Collaborate with ML engineers on model deployment, evaluation, and experiment tracking
Ensure adherence to software engineering best practices: design, coding, testing, CI/CD, observability, and version control
Deploy and monitor applications on cloud and containerized infrastructure (Docker, Kubernetes)
Join us at a pivotal moment, shape what we build and wear multiple hats!
Qualification
Required
LLM & Agent Development: LLM evaluation fundamentals, data pipelines, RAG systems, and Agent development (MCP, LangChain/LlamaIndex)
Software Engineering: API design, scalable services, databases, testing, CI/CD, observability, and version control
ML/LLM Tooling & Infrastructure: HuggingFace, W&B, Docker, and Kubernetes
Programming Languages: Proficiency in Python for application development, data processing, and ML/LLM integration
Strong written and verbal communication skills
Ability and interest to travel up to 25%, flexible
Preferred
Vector databases (Pinecone, Weaviate, FAISS, Milvus)
Cloud platforms (AWS, GCP, Azure)
LLM architectures and fine-tuning recipes (SFT, DPO, LoRA)
LLM runtimes & libraries (vLLM, Transformers)
MLOps and experiment tracking (MLflow or similar)
Evaluation frameworks (LM Evaluation Harness, RAGAs, TruLens)
Go or JavaScript/TypeScript for backend or agent tooling
Applied NLP (SpaCy, NLTK, HuggingFace Datasets/Tokenizers)
Benefits
An open and inclusive culture and work environment
Work closely with a team on the cutting edge of AI research
Weekly lunch stipend, in-office lunches & snacks
Full health and dental benefits, including a separate budget to take care of your mental health
100% Parental Leave top-up for up to 6 months
Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend
6 weeks of vacation (30 working days!)
Company
Cohere
Cohere is an enterprise AI firm developing secure and private AI technology to address real-world business challenges.
Founded in 2019
201-500 employees
H1B Sponsorship
Cohere has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (11)
2024 (14)
2023 (13)
2022 (5)
2021 (2)
Funding
Current Stage
Late StageTotal Funding
$1.71BKey Investors
Government of CanadaTiger Global ManagementIndex Ventures
2025-09-24Series D· $100M
2025-08-14Series D· $500M
2025-06-17Secondary Market
Leadership Team
Aidan Gomez
cofounder + ceo
Ivan Zhang
Co-Founder
Recent News
2025-12-27
2025-12-24
2025-12-20
Company data provided by crunchbase