Apply on Employer Site

Cotiviti · 1 month ago

Sr Generative AI Scientist II - (Model Risk & Validation)

United States

Full-time

Remote

Senior Level

$145K/yr - $170K/yr

5+ years exp

Cotiviti is a company focused on improving healthcare quality and outcomes through technology. The Senior GenAI Scientist II – Risk will leverage expertise in AI and machine learning to validate models and manage risks, while working on projects that drive innovation and reduce costs in healthcare processes.

Information Technology & Services

H1B Sponsor Likely

Responsibilities

Conduct independent model validation of existing models for benchmarking, assessment, and gauging effectiveness

Determine aspects of model drift and related data drift for the purpose of model risk management (MRM) to both reduce risk and also find opportunities to drive new revenue growth and innovation

Apply deep expertise with AI/ML/GenAI model development, including hands-on experience with model building and model evaluation

Benchmark and potentially rebuild existing models as needed using updated data, and potentially newer, more modern and effective algorithms

Actively drive improvements in model monitoring activities, including methods for model registration, model metadata management, and conceptualizing approaches for related tools and techniques

Complete all responsibilities as outlined in the annual performance review and/or goal setting

Complete all special projects and other duties as assigned

Qualification

AI/ML/GenAI expertiseModel validationNatural language processingModel risk managementResponsible AI understandingMachine learning toolsProduction-grade deploymentsApache Spark experienceCommunication skillsTeam collaboration

Required

Graduate Degree in a quantitative discipline such as Computer Science/Engineering, Statistics, Operations Research covering Advanced Statistics, Machine learning and AI

Experience with the latest techniques in natural language processing including transformers, fine-tuning LLMs, measuring/benchmarking and deploying LLMs with tools such as HuggingFace, Langchain, LLAMA/Mistral and OpenAI, vector databases

5+ years of hands-on data science/AI experience, using typical machine learning and data science tools including pandas, scikit-learn, keras, nltk, and TensorFlow/PyTorch, GPU

General understanding of Responsible AI (RAI), including explainability (XAI), AI NIST RMF, and related AI risk management frameworks

Experience and understanding evaluating models for bias and fairness, with aptitude for detecting bias in the model design and data, as well as using metrics such as SHAP and LIME

Understanding appropriate model metrics and techniques for managing, evaluating and monitoring GenAI models and LLMs

Experience building production-grade machine learning deployments on AWS, Azure, or GCP

Experience working with Apache Spark™ and large-scale distributed datasets

Experience communicating technical concepts to non-technical and technical audiences is a plus

Ability to work independently as well as collaborate as a team with a sense of urgency

Professional with ability to properly handle confidential information

Be value-driven, understand that success is based on the impact of your work rather than its complexity or the level of effort

Ability to handle multiple tasks, prioritize and meet deadlines

Ability to work within a matrixed organization

Proficiency in all required skills and competencies above

Communicating with others and teamwork

Assessing the accuracy, neatness, and thoroughness of the work assigned

Flexibility to work with global teams as well geographically dispersed US based teams

Remaining in a stationary position, often standing or sitting for prolonged periods

Repeating motions that may include the wrists, hands and/or fingers

Must be able to provide high-speed internet access/connectivity and office setup and maintenance

Must be able to provide a dedicated, secure work area

Preferred

Familiarity with healthcare payor ecosystem and related data

Understanding and familiarity with model governance and data governance best practices

Strong understanding of technology systems for model development (e.g., Python, DataRobot, AWS Sagemaker), model deployments (AWS, Azure, DataRobot, DataBricks), model monitoring (AWS Model Monitor, MLFlow, NannyML, FiddlerAI, Arize) and related tools for model management and metadata management

Benefits

Medical, dental, vision, disability, and life insurance coverage

401(k) savings plans

Paid family leave

9 paid holidays per year

17-27 days of Paid Time Off (PTO) per year, depending on specific level and length of service with Cotiviti

Company

Cotiviti

Glassdoor3.7

Cotiviti enables healthcare organizations to deliver better care at lower cost through advanced technology and data analytics that improve the quality and sustainability of healthcare in the United States.

Founded in 1979

South Jordan, UT, US

5001-10000 employees

http://www.cotiviti.com

H1B Sponsorship

Cotiviti has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (165)

2024 (118)

2023 (90)

2022 (102)

2021 (72)

2020 (67)