BeaconFire Inc. · 4 weeks ago
QA ENGINEER with Conversational AI or Gen AI Experience
Hartford, CT
Contract
Onsite
Mid Level
3+ years expBeaconFire Inc. is seeking a highly skilled Quality Assurance Automation Engineer to join their Aetna IT Delivery organization within CVS Health’s DDAT division. The role involves designing, developing, and maintaining automated testing solutions for virtual assistants, ensuring high quality and compliance with standards in the healthcare domain.
Artificial Intelligence (AI)Information TechnologyIT InfrastructureMachine LearningManufacturing
Hiring Manager
Amit Jha
Responsibilities
Design, develop, and maintain automated test scripts using industry-standard tools and frameworks (e.g., Selenium, Cypress, Playwright, Appium)
Build and enhance automation frameworks to support functional, regression, and performance testing
Collaborate with developers and QA analysts to understand application functionality and define test coverage
Execute automated test suites and analyze results to identify defects and ensure compliance with quality standards
Integrate automated tests into CI/CD pipelines using tools like Jenkins, GitLab CI, or Azure DevOps
Monitor and maintain test execution in CI environments to ensure timely feedback
Log, track, and verify defects using tools such as JIRA or Azure DevOps
Work with development teams to reproduce issues and validate fixes
Prepare detailed test plans, test cases, and automation scripts documentation
Generate and present test execution reports to stakeholders
Identify opportunities to improve automation coverage and efficiency
Stay updated with emerging trends, tools, and best practices in test automation
Qualification
Required
3+ years of experience in QA automation and software testing
Strong technical expertise in core programming concepts (e.g., Java OOPs, Data Structures) with the ability to adopt and work with multiple languages such as Java, JavaScript, or Python
Hands-on experience implementing and enhancing test automation frameworks, including designing scalable and maintainable solutions
Hands-on experience with automation tools including Hammer On Demand and Selenium
Strong understanding of SDLC, Agile methodologies, and QA principles
Experience with CI/CD tools and version control systems (e.g., Git)
Frameworks & Methodologies: BDD (e.g., Cucumber, SpecFlow), TDD
Testing Expertise: Functional, Regression, Integration, and Performance Testing, including proficiency in backend API test automation and database testing
Healthcare Domain Knowledge: Familiarity with HIPAA compliance and healthcare workflows
Exposure to GenAI and AI-driven tools utilized for test automation, with an understanding of how these can be integrated into QA processes
Strong analytical and problem-solving skills
Excellent communication and collaboration abilities
Ability to clearly articulate technical concepts and demonstrate practical problem-solving skills during discussions
Preferred
Conversational AI Testing: Hands-on experience or strong exposure to testing chatbots and voice-based virtual assistants across multiple platforms
AI Model Evaluation: Familiarity with key evaluation metrics such as accuracy, precision, recall, and F1-score for assessing AI model performance
Experience with Agentic IDEs: Familiarity with AI-powered development environments (e.g., Windsurf, Cursor, or similar) for creating, maintaining, and optimizing automated test scripts
Experience with API testing (REST, SOAP)
Knowledge of cloud platforms (AWS, GCP, or IBM Cloud)
Company
BeaconFire Inc.
BeaconFire is a leading technology consulting and professional services organization.
501-1000 employees
H1B Sponsorship
BeaconFire Inc. has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (121)
2024 (63)
2023 (34)
2022 (40)
2021 (15)
2020 (1)
Funding
Current Stage
Late StageCompany data provided by crunchbase