Software Quality Analyst I jobs in United States
cer-icon
Apply on Employer Site
company-logo

Cognizant · 1 day ago

Software Quality Analyst I

Cognizant is one of the world’s leading professional services companies, helping clients modernize technology and transform experiences. They are seeking a Software Quality Analyst I to work in Seattle, Washington, responsible for validating large language models, conducting functional and regression testing, and analyzing test failures.

ConsultingIndustrial AutomationInformation TechnologySoftwareSoftware Engineering
badNo H1Bnote

Responsibilities

Working with large language model validation, ensuring the LLM performs at an acceptable level of accuracy and reliability across different models
Fix implementation: Identify and address issues in synthetic data and manual tests by comparing various models, fixing schemas
Create, curate diverse set of test cases and scenarios to challenge and refine LLM’s
Monitor Pipelines, triage failures, triage, and escalate critical pipeline failures
End to end, functional, regression testing on client software & hardware ie: Phones, tablets, watches, home speakers, Bluetooth accessories software & hardware
Manual testing with AI, Personal Assistants such as Alexa, Siri, Google
Perform test planning, test case development, and manual test execution
Analyzing test failures and filing detailed defect reports

Qualification

Blackbox Quality AssuranceSoftware Testing MethodologiesTest PlanningArtificial IntelligenceTest Automation FrameworksWrittenCuriosityProactivityAttention to DetailVerbal Communication

Required

3+ years of professional work experience in Blackbox Quality Assurance, with experience in software testing, AI technologies or LLM evaluation
Knowledge of data analysis & strong understanding of software testing methodologies
Strong understanding of software testing methodologies
Proficiency in test planning, test design, test authoring, and execution
Experience in test planning, test design, test authoring, and execution
Analyzing test results, identify defects, patterns of issues, troubleshoot, file detailed defect reports
Meticulous with attention to detail
Possess excellent written and verbal communications skills in English
Bachelor's degree in Computer Science or related field

Preferred

Experience with Artificial Intelligence, Machine Learning, ie: Chat GBT
Previous experience with annotation and data analytics is a plus
Experience with test automation frameworks and tools
Able to work in a fast paced dynamic environment
Curious and proactive. Loves to learn and explore

Benefits

Medical/Dental/Vision/Life Insurance
Paid holidays plus Paid Time Off
401(k) plan and contributions
Long-term/Short-term Disability
Paid Parental Leave
Employee Stock Purchase Plan

Company

Cognizant

company-logo
Cognizant is a professional services company that helps clients alter their business, operating, and technology models for the digital era.

Funding

Current Stage
Public Company
Total Funding
$0.24M
Key Investors
Summit Financial Wealth Advisors
2025-03-08Post Ipo Equity
2016-11-18Post Ipo Equity· $0.24M
1998-06-19IPO

Leadership Team

leader-logo
Ravi Kumar S
Chief Executive Officer
linkedin
leader-logo
Anil Cheriyan
CTO / EVP Strategy & Technology
linkedin
Company data provided by crunchbase