Tential Solutions · 1 day ago
QA Data Scientist
United States
Contract
Remote
Mid Level
3+ years expTential Solutions is seeking a Quality Assurance Data Scientist to develop, analyze, and validate machine learning models used in AI applications. The role involves collaboration with QA Automation Engineers to define validation strategies and support automated testing of ML pipelines and AI models.
Human ResourcesInformation Technology
Responsibilities
Develop, analyze, and validate machine learning models used in AI applications
Perform data exploration, feature engineering, and model evaluation to support AI initiatives
Partner with AI engineers to assess model accuracy, bias, drift, robustness, and explainability
Design metrics and dashboards to track model performance and data quality over time
Work closely with Senior QA Automation Engineers to:
Define AI and data validation strategies
Create test datasets (synthetic, edge-case, adversarial)
Support automated testing of ML pipelines and AI models
Assist in testing scenarios such as:
Model retraining validation
Regression testing for AI outputs
Data drift and concept drift detection
AI fairness, bias, and ethical testing
Build and maintain data pipelines using Databricks (Spark, Delta Lake)
Write optimized SQL, PySpark, and notebooks for data processing and analysis
Collaborate with data engineers to ensure scalable, secure, and reliable data workflows
Implement best practices for data versioning, lineage, and reproducibility
Support AI readiness and quality frameworks, including model validation and auditability
Assist with AI governance, documentation, and compliance needs
Contribute to AI risk assessments, including model explainability and failure analysis
Work with security and QA teams on AI red-teaming, adversarial testing, and jailbreak scenarios (where applicable)
Qualification
Required
Bachelor's or Master's degree in Data Science, Computer Science, Engineering, Statistics, or related field
3+ years of experience as a Data Scientist or similar role
Strong hands-on experience with Databricks (Spark, Delta Lake, notebooks)
Proficiency in Python, SQL, and PySpark
Experience working with machine learning models(training, evaluation, monitoring)
Solid understanding of data quality, validation, and testing concepts
Experience collaborating with QA or Automation Engineering teams
Preferred
Experience supporting AI/ML testing or MLOps
Familiarity with model monitoring, drift detection, and ML lifecycle tools
Knowledge of AI ethics, bias detection, and explainability (XAI)
Exposure to cloud platforms (Azure preferred, especially Azure Databricks)
Understanding of CI/CD pipelines for data and ML workflows
Experience with GenAI, LLMs, or AI security testing is a plus
Company
Tential Solutions
We put people first. We’re your trusted partner - empowering you with top talent and solutions to stay competitive in today’s dynamic market.
501-1000 employees
H1B Sponsorship
Tential Solutions has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2024 (2)
2023 (1)
2022 (3)
2020 (11)
Funding
Current Stage
Late StageLeadership Team
Shane Ireland
Chief Executive Officer
Quinn Salamandra
Co-Founder
Recent News
Australian Financial Review
2024-05-02
2024-04-12
Company data provided by crunchbase