Apply on Employer Site

AI Cybersecurity Company · 15 hours ago

Quality Assurance Engineer

San Jose, CA

Full-time

Onsite

Senior Level

5+ years exp

AI Cybersecurity Company is a well-funded AI startup focused on transforming the cybersecurity landscape with cutting-edge AI. They are seeking a Quality Assurance Engineer to develop and implement testing strategies for their AI-powered cybersecurity analytics platform, ensuring the reliability and accuracy of threat detection systems.

Computer Software

Responsibilities

Design & Execute Security-Focused Test Strategies: Develop and implement comprehensive testing strategies for our cybersecurity analytics platform, including functional, integration, regression, performance, and security testing. Validate threat detection accuracy, false positive rates, and incident response workflows

Build & Maintain Test Automation for Security Systems: Create robust, scalable test automation frameworks for security analytics, threat detection pipelines, and AI-powered security agents. Implement CI/CD pipelines that catch vulnerabilities and quality issues before they reach production

Validate Threat Detection & Analytics Accuracy: Design and execute validation tests for threat intelligence data, security event processing, and analytics outputs. Verify that our AI models correctly identify threats, vulnerabilities, and anomalies across diverse attack scenarios and security contexts

Test AI/ML Security Models: Develop specialized testing approaches for AI-driven cybersecurity features, including model accuracy validation, adversarial testing, bias detection, and output verification. Ensure our security AI agents perform reliably against real-world attack patterns

Data Pipeline & ETL Testing: Validate the integrity, accuracy, and timeliness of security data pipelines processing logs, alerts, and threat intelligence from multiple sources. Test data transformations, aggregations, and enrichment processes for security analytics

Performance & Scale Testing: Conduct performance testing for high-volume security event processing. Validate system behavior under attack scenarios, load spikes, and large-scale data ingestion to ensure reliability during critical security incidents

Security & Vulnerability Testing: Perform security testing on the platform itself, including API security, authentication/authorization, data encryption, and secure data handling. Identify and validate fixes for security vulnerabilities in collaboration with the security team

Partner with Cross-Functional Teams: Collaborate with security researchers, data engineers, ML engineers, and product teams to understand threat scenarios, security requirements, and edge cases. Integrate quality checks throughout the development lifecycle

Produce Actionable Quality Metrics: Create detailed test reports, security quality dashboards, and documentation that provide clear visibility into product health, detection accuracy, and system reliability. Track defect trends and security issue patterns to drive continuous improvement

Champion Security Quality Culture: Mentor team members on security testing best practices, advocate for quality-first development in cybersecurity products, and establish testing standards that scale as the team grows

Qualification

Test AutomationCybersecurity KnowledgeProgramming SkillsPerformance TestingSQL SkillsAPI TestingData Pipeline TestingSecurity Testing ToolsCollaboration SkillsMentoring Skills

Required

5-7 years minimum of hands-on experience in quality assurance, test automation, or software testing, preferably in cybersecurity, security analytics, or related domains

Experience testing security products (SIEM, XDR, TVM, threat intelligence platforms, or security analytics tools)

Strong programming skills in Python, Java, or similar languages for test automation

Experience with test automation frameworks, CI/CD pipelines, and testing methodologies (e.g., Pytest, Selenium, TestNG, Jenkins)

Knowledge of cybersecurity concepts: threat detection, vulnerability management, security events, attack patterns, and security frameworks (MITRE ATT&CK, NIST, etc.)

Experience testing REST APIs, microservices, and distributed systems

Strong SQL skills and experience with database testing, data validation tools (e.g., Great Expectations), and ETL testing

Understanding of data pipeline architectures and security data processing

Familiarity with security testing tools (Burp Suite, OWASP ZAP) and secure coding practices