Ampcus Inc · 5 months ago
Quality Assurance Tester – AI Systems
Chantilly, VA
Full-time
Onsite
Senior Level
7+ years expAmpcus Inc. is a certified global provider of a broad range of Technology and Business consulting services. We are seeking an experienced, detail-oriented and methodical Quality Assurance (QA) Tester to ensure the reliability, performance, and compliance of AI-enabled applications and platforms for a leading independent federal agency focused on financial system stability.
Data ManagementInformation Technology
Responsibilities
Develop and maintain comprehensive test plans, test cases, and test scripts for AI-enabled applications and services
Conduct functional, regression, integration, and performance testing across front-end, back-end, and AI components
Validate the behavior of GenAI and Agentic AI systems, including autonomous workflows, user interactions, and decision outputs
Test AI model outputs for accuracy, consistency, and alignment with business rules and ethical guidelines
Evaluate Agentic AI systems for task execution boundaries, auditability, and compliance with policy constraints
Collaborate with data scientists and AI/ML engineers to define test criteria for model performance and drift
Implement automated testing frameworks and scripts to support continuous integration and delivery (CI/CD)
Use tools such as Selenium, Postman, JMeter, or PyTest to automate UI, API, and performance testing
Integrate testing into DevOps pipelines and monitor test coverage and results
Identify, document, and track defects using issue tracking systems (e.g., Jira, Azure DevOps)
Work with development teams to reproduce issues, validate fixes, and ensure resolution
Provide regular test status reports and contribute to quality metrics dashboards
Collaborate with cross-functional teams to understand requirements, user stories, and acceptance criteria
Ensure testing aligns with federal security, accessibility (Section 508), and compliance standards
Participate in sprint planning, reviews, and retrospectives to continuously improve QA processes
Qualification
Required
Bachelor's degree in Information Systems, Computer Science, or a related field
7 years of experience in software testing, QA engineering, or test automation
Experience testing AI/ML systems, APIs, and web applications
Experience with accessibility testing
Knowledge of AI model evaluation techniques and ethical testing practices
Familiarity with GenAI platforms and Agentic AI system behaviors
Proficiency with testing tools and frameworks (e.g., Selenium, Postman, PyTest, JMeter)
Experience with AWS cloud environments and containerized applications
Strong analytical, documentation, and communication skills
Preferred
Experience in public sector or regulated environments
Knowledge of federal compliance standards
Company
Ampcus Inc
Ampcus is a global business, technology consulting and an staff augmentation firm specializing in AI/ML,digital solutions, Cybersecurity & Risk management, Testing, Forensics & Fraud services and human capital management.
1001-5000 employees
H1B Sponsorship
Ampcus Inc has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (14)
2024 (13)
2023 (7)
2022 (16)
2021 (13)
2020 (18)
Funding
Current Stage
Late StageLeadership Team
Raj Narayan
Sr. Vice President, Strategic Sales
Recent News
2025-08-18
2025-07-31
Seattle TechFlash
2025-07-15
Company data provided by crunchbase