Lead - AI Governance & QA Auditor – Data Scientist, AI Systems Audit, Compliance, AI Governance, AI Explainability, Python jobs in United States
cer-icon
Apply on Employer Site
company-logo

UPS · 3 months ago

Lead - AI Governance & QA Auditor – Data Scientist, AI Systems Audit, Compliance, AI Governance, AI Explainability, Python

UPS is a Fortune Global 500 organization seeking a highly skilled AI Governance and QA Auditor to evaluate and ensure the responsible use of Artificial Intelligence and Machine Learning systems. The role focuses on maintaining trust, fairness, and regulatory alignment across AI initiatives while collaborating with various stakeholders to establish governance frameworks.

LogisticsMessagingTransportation
check
H1B Sponsor Likelynote

Responsibilities

Design framework for technical auditing of AI/ML systems that avoid costly mistakes
Conduct independent audits of a variety of AI/ML systems in the areas of Gen AI, Deep Learning, Machine Learning, Natural Language Processing and Computer Vision
Verify compliance with benchmark standards, external regulations, and ethical AI principles
Assess data quality, feature engineering practices, and model development pipelines for reproducibility, fairness, and bias mitigation
Evaluate ML model performance, robustness, explainability, and alignment with intended business outcomes
Review deployment processes, model versioning, and monitoring practices to ensure traceability and accountability
Utilize Watsonx Governance and other enterprise AI governance tools to audit and validate responsible AI practices
Define, implement, and maintain AI governance frameworks, policies, and best practices
Identify AI risks (bias, drift, adversarial attacks, misuse) and recommend mitigation strategies
Ensure compliance with AI regulations and standards (e.g., EU AI Act, NIST AI RMF, ISO 42001, GDPR, industry-specific frameworks)
Establish governance checkpoints across the AI lifecycle (data collection, training, validation, deployment, monitoring)
Leverage Watsonx Governance for automated policy enforcement, lineage tracking, and audit readiness
Audit AI/ML systems for fairness, inclusivity, accountability, and transparency
Ensure model documentation, datasheets, and audit trails are consistently maintained
Provide assurance reports for regulators, clients, and internal executives
Monitor emerging AI regulations and update governance policies accordingly
Partner with Data Science, MLOps, and Product teams to embed assurance-by-design practices
Educate stakeholders on AI risks, governance policies, and responsible AI principles
Act as an internal advisor for audits, compliance reviews, and external certifications

Qualification

AI GovernancePythonMachine LearningRegulatory ComplianceData Science WorkflowsAI Auditing ToolsCloud PlatformsAI Risk ManagementAnalytical ThinkingStakeholder ManagementCommunication Skills

Required

Bachelor's degree in Computer Science, Data Science, Statistics, Engineering, or a related quantitative field
10+ years of overall professional experience
at least 5 years in AI/ML model development, assurance, risk management, or audit functions
Hands-on expertise with Data Science workflows, ML model evaluation, and MLOps pipelines
Prior experience in regulatory compliance, IT audit, or QA within financial services, healthcare, or other regulated industries
Strong understanding of machine learning, deep learning, and generative AI
Familiarity with AI auditing tools (e.g., Fairlearn, Aequitas, SHAP, LIME, Explainable AI frameworks)
Proficiency in Python, SQL, and model evaluation libraries
Knowledge of cloud platforms (AWS, Azure, GCP) and enterprise governance solutions such as IBM Watsonx Governance, Vertex AI Model Monitoring, and Watson OpenScale
Knowledge of AI risk management frameworks (NIST AI RMF, ISO 42001, OECD AI Principles)
Understanding of data protection and privacy laws (GDPR, HIPAA, CCPA)
Ability to translate technical findings into executive-level risk and compliance reports
Strong analytical and critical thinking with attention to detail
Excellent communication and stakeholder management skills
Ability to act as an independent, objective voice in AI governance matters

Preferred

Master's/PhD or certification in AI Governance, Risk & Compliance, or Data Ethics

Company

Operating in more than 200 countries and territories, we’re committed to moving our world forward by delivering what matters.

H1B Sponsorship

UPS has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2)
2024 (1)
2021 (5)
2020 (9)

Funding

Current Stage
Public Company
Total Funding
unknown
Key Investors
Innovate UK
2025-07-28Grant
1999-11-10IPO

Leadership Team

leader-logo
Brian Dykes
EVP & Chief Financial Officer at UPS
linkedin
leader-logo
Joel Stenson
Senior Vice President Global Operations Technology / Enterprise Data & Analytics and Gen AI
linkedin
Company data provided by crunchbase