LexisNexis · 1 day ago
Senior Data Scientist III - AI Evaluation and Prompt Engineering
United States
Full-time
Remote
Mid, Senior Level
$127K/yr - $212K/yr
3+ years expLexisNexis is a global provider of information-based analytics and decision tools for professional and business customers. The role focuses on evaluating and improving large language model systems and driving the development of AI-powered legal research tools by applying data science techniques.
AccountingLegalRisk ManagementSoftware
Responsibilities
Evaluate and tune LLM-powered features, such as prompt optimization, retrieval-augmented generation (RAG) systems, and semantic search performance
Design and execute experiments to measure model quality, reliability, and user impact — translating technical findings into product recommendations
Develop and maintain data pipelines for evaluating, tracking, and improving system performance (e.g., accuracy, latency, cost, and relevance metrics)
Analyze structured and unstructured datasets (e.g., product usage logs, document metadata, LLM outputs) to identify patterns, insights, and areas for optimization
Collaborate with product managers to translate product goals into measurable data science questions, propose next steps, and inform roadmap priorities
Provide technical guidance to data engineers who build and maintain analytics and model evaluation infrastructure
Communicate results clearly — through written reports, dashboards, and presentations — to technical and non-technical stakeholders
Stay current on emerging practices in applied NLP, LLM evaluation, and data-driven product development, and thoughtfully adapt them to our environment
Qualification
Required
3–6 years of experience in data science, applied NLP, or AI product analytics, preferably within a SaaS or research-heavy product environment
Strong proficiency in Python and data analysis libraries such as Pandas; solid working knowledge of SQL
Ability to design and evaluate LLM-based systems (e.g., RAG pipelines, prompt evaluations, output scoring), even if not specialized in deep learning
Experience with data exploration, experimentation, and reporting — from defining metrics to visualizing and interpreting results
Comfort working with document-based datasets (e.g., text corpora, metadata, embeddings) and understanding information retrieval / semantic search concepts
Excellent written and verbal communication skills — able to present complex ideas simply and persuasively across distributed teams
Proven ability to self-direct, learn new tools and concepts quickly, and apply them pragmatically
Strong sense of curiosity, patience, and collaboration — especially in working across different disciplines and cultures
Preferred
Familiarity with tools like LangChain, OpenAI API, Databricks, or similar LLM/AI development environments
Experience designing evaluation frameworks or product analytics systems for AI-driven products
Prior exposure to legal, financial, or corporate document datasets
Experience mentoring or informally guiding junior technical teammates
Benefits
Flexible remote-first work environment, with the option to work from our New York office
Comprehensive health coverage, including medical, dental, and vision plans
Retirement plan with inclusive risk benefits (disability, critical illness, life cover, and funeral cover)
Modern family benefits, including adoption, surrogacy, and parental leave
Paid study leave and professional development support
Well-being initiatives and opportunities for sabbaticals and personal growth
A culture that values work/life balance, clear communication, and continuous learning
Company
LexisNexis
LexisNexis is a data analytics company that provides information solutions and law legal databases to Law and corporate businesses.
10001+ employees
H1B Sponsorship
LexisNexis has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2024 (9)
2023 (108)
2022 (138)
2021 (87)
2020 (64)
Funding
Current Stage
Late StageTotal Funding
$30MKey Investors
EquivoActua Corporation
2021-06-16Corporate Round
2000-03-22Series Unknown· $30M
1994-10-05Acquired
Leadership Team
Eric Bonnet-Maes
CEO - LexisNexis Continental Europe, Middle East and Africa
Sean Fitzpatrick
CEO LexisNexis North America, UK & Ireland
Recent News
2026-01-03
Business Insider
2025-12-12
LexisNexis on X (formerly Twitter)
2025-11-30
Company data provided by crunchbase