Apply on Employer Site

Moody's Corporation · 4 months ago

AI Software Engineer - NLP/LLM

New York, NY

Full-time

Onsite

Senior Level

$159K/yr - $231K/yr

5+ years exp

Moody's is a company that unites talented individuals to transform risks into opportunities through an inclusive environment. They are seeking an Associate Director of Data Science who will lead high-impact AI and machine learning projects, collaborating with cross-functional teams to deliver solutions and measure their effectiveness.

Financial Services

H1B Sponsor Likely

Responsibilities

Design and deploy end to end AI and machine learning solutions including machine learning and graph-based models, natural language processing (NLP) models, and large language model (LLM) based AI agents. Build robust pipelines for data ingestion, feature engineering, model training, validation, and real-time or batch inference

Develop and integrate large language model (LLM) applications using techniques such as fine-tuning, retrieval-augmented generation, and reinforcement learning. Build autonomous agents capable of multi-step reasoning and tool use in production environments

Lead the full model and agent development lifecycle, from problem definition and data exploration through experimentation, implementation, deployment, and monitoring. Ensure solutions are scalable, reliable, and aligned with business goals

Advocate and implement machine learning operations (MLOps) best practices including data monitoring and tracing, error analysis, automated retraining, model and prompt versioning, business metrics monitoring, and incident response

Collaborate across disciplines and provide technical leadership, working with product managers, engineers, and researchers to deliver impactful solutions. Mentor team members, lead design reviews, and promote best practices in AI and machine learning systems development

Qualification

NLP expertiseLarge language modelsMachine learning systemsTechnical leadershipGraph machine learningMLOps best practicesCommunication skillsStrategic thinkingMentorship

Required

5+ years of demonstrated experience building production-grade machine learning systems with measurable impacts; expertise in NLP and search and recommendation systems is preferred

Hands-on experience with large language model (LLM) applications and AI agents, including retrieval-augmented generation, prompt optimization, fine-tuning, agent design, and evaluation methodologies; familiarity with prompt optimization frameworks like DSPy is preferred

Deep expertise in machine learning models and systems design, including classic models (e.g., XGBoost), modern deep learning and graph machine learning architectures (e.g., transformers-based models, graph neural networks (GNN)), and reinforcement learning systems

Proven ability to take models and agents from research to production, including optimization for latency and cost, implementation of monitoring and tracing, and development of reusable platforms or frameworks

Strong technical leadership and mentorship skills, with a track record of growing engineers, improving team velocity through automation, documentation, and tooling, and influencing architectural decisions without direct authority

Excellent communication and strategic thinking abilities, capable of aligning technical decisions with business outcomes, navigating ambiguity, and driving cross-functional collaboration

Bachelor's degree or higher in Computer Science, Engineering, or a related field

Preferred

Expertise in NLP and search and recommendation systems

Familiarity with prompt optimization frameworks like DSPy

Benefits

Medical

Dental

Vision

Parental leave

Paid time off

A 401(k) plan with employee and company contribution opportunities

Life

Disability

Accident insurance

A discounted employee stock purchase plan

Tuition reimbursement

Company

Moody's Corporation

Glassdoor3.8

In a world shaped by increasingly interconnected risks, Moody’s helps customers develop a holistic view of these risks to advance their business and act decisively.

Founded in 1970

New York, New York, US

10001+ employees

http://www.moodys.com

H1B Sponsorship

Moody's Corporation has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (121)

2024 (120)

2023 (88)

2022 (112)

2021 (92)

2020 (64)