Apply on Employer Site

Ad Hoc LLC · 11 hours ago

Senior Quality Assurance Engineer (Remote)

United States

Full-time

Remote

Mid, Senior Level

$120K/yr - $135K/yr

7+ years exp

Ad Hoc LLC is a technology company that empowers organizations to deliver scalable, impactful digital services. The Senior Quality Assurance Engineer will ensure the reliability and accessibility of digital public health experiences and develop robust testing strategies for various digital tools and platforms.

ComputerData ManagementSoftware

Culture & Values

Responsibilities

Ensures that every digital public health experience is reliable, trustworthy, accessible, and ready for production

They are the guardian of quality in an environment where content, data, and AI-driven features must remain accurate and stable—even as underlying information evolves rapidly

This engineer will develop robust testing strategies that validate everything from CMS content workflows to React interfaces, backend integrations, real-time data streams, and AI-generated responses

They will focus on unique challenges such as verifying the correct rendering of probabilistic AI outputs, ensuring confidence indicators are displayed accurately, validating fallback behavior when models or data sources are unavailable, and ensuring health content remains accessible and understandable for diverse audiences

Working Closely With Engineering, Design, And AI/ML Teams, The QA Engineer Will Build Automated Test Suites, Accessibility Audits, Performance Tests, And Error-state Scenarios That Continuously Improve Model Reliability And User Trust

Their Work Ensures That Digital Health Tools Function Flawlessly At Scale, Withstand Unexpected Usage Patterns, And Deliver Consistent, Credible Experiences To Millions Of Americans—while Helping The Organization Safely Integrate Next-generation AI Capabilities

Strong influential skills to propose and evaluate multiple approaches to technical and process problems

May lead small, less critical, or temporary team structures and projects

Presents testing strategy, results, risks, etc. to clients, stakeholders, partners, and other engineers

Demonstrates expertise, accountability, and ownership for testing strategies, tools, and frameworks for the program

Able to lead the development of a variety of test suites and partner with the team on optimizing them within their software development lifecycle

Designs and maintains information dashboards that inform the program on multiple facets and trends of quality (defects, load testing, etc.)

Monitors coverage of quality test suites (automated and manual) and builds plans to fill gaps, directing junior staff as needed

Develops program testing strategies for teams to follow that are tailored to the technical stack and skills of the team

Participates in planning and design sessions, informing team decisions on architecture and implementation that enable testing strategy, including automation

Actively participates in design and ensures building systems that are testable in the outset

Participates in technical interviews with new candidates

May serve as a mentor to other junior level team members

Qualification

Testing CMS platformsTesting React applicationsTest automation frameworksQA with AWS architecturesAccessibility testingWebSocket/SSE testingInfluential skillsMentoring junior staffDesigning information dashboardsParticipating in planning sessions

Required

Bachelor's degree and 7+ years of experience + Relevant years of experience may be substituted for education

Testing experience with modern CMS platforms (Drupal, WordPress, or similar) Ability to validate CMS-driven workflows, publishing pipelines, permissions, APIs, and content rendering across devices and formats

Strong proficiency in testing React + TypeScript applications Hands-on experience with component, integration, and end-to-end testing—ensuring dynamic, type-safe UIs reliably render AI-generated content, real-time data, and interactive health tools

USWDS (U.S. Web Design System) and accessibility testing Familiarity with federal accessibility standards (WCAG/508) and tools such as axe, WAVE, or Lighthouse to ensure components and pages meet compliance and usability requirements

Advanced test automation for stateful, async applications (e.g., Playwright, Cypress, Jest, React Testing Library) Critical for validating complex application states such as streaming AI responses, user interaction flows, real-time health data changes, and error or fallback behavior

QA experience with AWS-backed architectures Ability to test applications and APIs deployed on AWS services like Lambda, API Gateway, DynamoDB, CloudFront, and S3—ensuring performance, resilience, and correct integration across cloud components