NorthBay - Pakistan · 9 hours ago
Senior AI QA Engineer
United States
Full-time
Remote
Senior Level
6+ years expNorthBay is seeking a Senior AI QA Engineer with extensive experience in software quality assurance, test automation, and validation of data-driven and AI/ML systems. The role involves test planning, automation framework development, API testing, CI/CD integration, and end-to-end testing of AI and data pipelines.
ArchitectureCloud ComputingConsultingDevOpsSoftware
Responsibilities
Define and execute test planning, test strategy, and test cases for AI/ML and data-driven applications
Develop and maintain automated test frameworks using Selenium and Pytest
Perform API testing for RESTful services
Validate data pipelines, ETL workflows, and ML model outputs
Conduct end-to-end testing across AI/ML lifecycle including data ingestion, training, inference, and deployment
Integrate automated test suites into CI/CD pipelines
Perform regression, integration, system, and performance testing
Identify, document, and track defects to closure
Collaborate with Data Engineers, ML Engineers, and DevOps teams
Ensure adherence to QA standards, best practices, and compliance requirements
Mentor junior QA team members when required
Qualification
Required
Software Quality Assurance
Test Planning and Test Strategy
Test Automation
Selenium
Pytest
Python
API Testing (REST)
CI/CD Integration
Data Pipeline Testing
AI/ML Pipeline Testing
Regression Testing
Defect Tracking
Git / Version Control
Preferred
Machine Learning model validation (accuracy, drift, bias)
Cloud platforms (AWS, Azure, GCP)
Docker and Kubernetes
Performance and Load Testing
Data Quality and Monitoring frameworks
Company
NorthBay - Pakistan
NorthBay is AWS Premier Consulting Partner and also partnered with VMware, CloudRail and SAP in support of our Customers’ AWS cloud journeys.
201-500 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase