Apply on Employer Site

Innodata Inc. · 2 days ago

Generative AI Associate - Red Teaming Specialist

Canada

Contract

Remote

Entry Level

CAD$20/hr - CAD$20/hr

1+ years exp

Innodata Inc. is a leading data engineering company specializing in AI technology solutions. They are seeking a Red Teaming Specialist to test generative AI and large language models for robustness and reliability, crafting scenarios to uncover vulnerabilities and improve AI system resilience.

AnalyticsArtificial Intelligence (AI)Enterprise SoftwareInformation TechnologyInternetMachine Learning

Responsibilities

Complete extensive training on AI/ML, LLMs, Red Teaming, and jailbreaking, as well as specific project guidelines and requirements

Craft clever and sneaky prompts to attempt to bypass the filters and guardrails on LLMs, targeting specific vulnerabilities defined by our clients

Collaborating closely with language specialists, team leads, and QA leads to produce the best possible work

Assist our data scientists to conduct automated model attacks

Adapt to the dynamic needs of different projects and clients, navigating shifting guidelines and requirements

Keep up with the evolving capabilities and vulnerabilities of LLMs and help your team’s methods evolve with them

Hit productivity targets, including for number of prompts written and average handling time per prompt

Qualification

AI/MLLarge Language ModelsRed TeamingEnglish proficiency (C1/C2)GrammarSyntax understanding

Required

A Bachelor's degree or Associates degree with minimum 1 year of relevant industry experience

Advanced degrees are strongly preferred (Master's or PhD)

Professional or Expert level proficiency (C1/C2) in English

Strong understanding of grammar, syntax, and semantics – knowing what 'proper' English rules are, as well as when to violate them to better test AI responses