TDI (Tetrad Digital Integrity) · 1 month ago
Cybersecurity Ethics and LLM Evaluation Specialist
Tetrad Digital Integrity (TDI) is a leading-edge cybersecurity firm with a mission to safeguard and protect our customers from increasing threats and vulnerabilities in this digital age. They are seeking a highly skilled and experienced Cybersecurity Ethics & LLM Evaluation Specialist to contribute to a cutting-edge project focused on testing and evaluating a Large Language Model's ability to make sound ethical decisions in cybersecurity contexts.
Cyber SecurityNetwork SecuritySecurity
Responsibilities
Crafting complex ethical dilemmas encountered in real-world cybersecurity practices to meticulously evaluate an model's capability against industry best practices, legal frameworks, and established ethical guidelines
Design and write nuanced, realistic ethical dilemma questions and scenarios specifically tailored to penetration testing and ethical hacking. These scenarios should probe the LLM's understanding of reasoning through complex cyber constraints and ethical quandaries
Develop effective prompts and responses based on the developed scenarios to elicit detailed responses from the LLM while adhering to relevant cybersecurity industry standards (e.g., NIST, ISO 27001)
Establish ethical guidelines and codes of conduct for cybersecurity professionals (e.g., from SANS, (ISC)², CREST, EC-Council)
Qualification
Required
Bachelor's degree in Cybersecurity, Computer Science, or a related field
5+ years in penetration testing, ethical hacking, or security consulting
Certifications: Certified Ethical Hacker (CEH), Offensive Security Certified Professional (OSCP)
Strong understanding of ethical hacking methodologies, experience with vulnerability assessment tools, and knowledge of legal and ethical considerations in cybersecurity
Demonstrable, in-depth understanding and practical experience with: industry standards (e.g., NIST Cybersecurity Framework, OWASP Top 10, PTES)
Relevant laws and regulations pertaining to cybercrime, data privacy, and computer misuse
Ethical guidelines and codes of conduct for cybersecurity professionals
Proven ability to conceptualize and articulate complex technical and ethical scenarios in a clear and understandable manner
Ability to write clear, concise, and well-structured prompts, evaluations, and reports
Familiarity with a range of historical and contemporary cyber incidents and the ethical dilemmas they presented
Foundational understanding of what Large Language Models are, how they generate responses, and their general capabilities and limitations