Cybersecurity Ethics and LLM Evaluation Specialist jobs in United States
info-icon
This job has closed.
company-logo

TDI (Tetrad Digital Integrity) · 1 month ago

Cybersecurity Ethics and LLM Evaluation Specialist

Tetrad Digital Integrity (TDI) is a leading-edge cybersecurity firm with a mission to safeguard and protect our customers from increasing threats and vulnerabilities in this digital age. They are seeking a highly skilled and experienced Cybersecurity Ethics & LLM Evaluation Specialist to contribute to a cutting-edge project focused on testing and evaluating a Large Language Model's ability to make sound ethical decisions in cybersecurity contexts.

Cyber SecurityNetwork SecuritySecurity
check
Growth Opportunities
badNo H1BnoteU.S. Citizen Onlynote

Responsibilities

Crafting complex ethical dilemmas encountered in real-world cybersecurity practices to meticulously evaluate an model's capability against industry best practices, legal frameworks, and established ethical guidelines
Design and write nuanced, realistic ethical dilemma questions and scenarios specifically tailored to penetration testing and ethical hacking. These scenarios should probe the LLM's understanding of reasoning through complex cyber constraints and ethical quandaries
Develop effective prompts and responses based on the developed scenarios to elicit detailed responses from the LLM while adhering to relevant cybersecurity industry standards (e.g., NIST, ISO 27001)
Establish ethical guidelines and codes of conduct for cybersecurity professionals (e.g., from SANS, (ISC)², CREST, EC-Council)

Qualification

Penetration testingEthical hackingCertified Ethical Hacker (CEH)Offensive Security Certified Professional (OSCP)NIST Cybersecurity FrameworkOWASP Top 10Vulnerability assessment toolsEthical guidelinesLarge Language Models understandingTechnical writing

Required

Bachelor's degree in Cybersecurity, Computer Science, or a related field
5+ years in penetration testing, ethical hacking, or security consulting
Certifications: Certified Ethical Hacker (CEH), Offensive Security Certified Professional (OSCP)
Strong understanding of ethical hacking methodologies, experience with vulnerability assessment tools, and knowledge of legal and ethical considerations in cybersecurity
Demonstrable, in-depth understanding and practical experience with: industry standards (e.g., NIST Cybersecurity Framework, OWASP Top 10, PTES)
Relevant laws and regulations pertaining to cybercrime, data privacy, and computer misuse
Ethical guidelines and codes of conduct for cybersecurity professionals
Proven ability to conceptualize and articulate complex technical and ethical scenarios in a clear and understandable manner
Ability to write clear, concise, and well-structured prompts, evaluations, and reports
Familiarity with a range of historical and contemporary cyber incidents and the ethical dilemmas they presented
Foundational understanding of what Large Language Models are, how they generate responses, and their general capabilities and limitations

Company

TDI (Tetrad Digital Integrity)

twittertwittertwitter
company-logo
For over 20 years, TDI’s one and only passion has been delivering cybersecurity solutions to effectively manage the business of cyber.

Funding

Current Stage
Growth Stage

Leadership Team

leader-logo
Paul Innella
CEO
linkedin
Company data provided by crunchbase