Intelligenic · 11 hours ago
Prompt Engineer
San Francisco Bay Area
Full-time
Remote
Mid Level
Maximize your interview chancesArtificial Intelligence (AI)Software
Hiring Manager
Payge Corrick
Insider Connection @Intelligenic
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
Design, develop, and refine prompts (including zero-shot, few-shot, and chain-of-thought approaches) to maximize the accuracy, relevance, and usability of AI-generated responses.
Conduct rigorous A/B testing and performance benchmarking of prompt variations, using both quantitative metrics and qualitative feedback.
Work closely with software engineers, UX designers, and product managers to understand user requirements and translate them into effective prompt strategies.
Stay up-to-date with the latest advancements in NLP, large language models (e.g., OpenAI GPT series, Azure OpenAI Service), and prompt engineering techniques. Incorporate new methodologies, best practices, and tooling (e.g., LangChain, vector databases) into the prompt development lifecycle.
Create clear documentation of prompt engineering processes, patterns, and guidelines. Lead workshops or training sessions to elevate the team’s expertise in prompt engineering.
Issue Resolution: Diagnose and troubleshoot issues related to AI output quality, latency, or alignment. Use a systematic approach to identify root causes and deploy iterative fixes.
Quality Assurance: Collaborate with QA and product teams to ensure that prompts deliver consistent and high-quality user experiences across various platforms and use cases.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Bachelor’s or Master’s degree in Computer Science, Linguistics, Data Science, Computational Linguistics, or a related field.
Strong foundation in NLP and machine learning concepts, with proven hands-on experience.
Proficiency in Python and relevant ML/NLP libraries (e.g., Transformers, spaCy, Hugging Face).
Familiarity with large language models (e.g., OpenAI GPT, Azure OpenAI) and their APIs or SDKs.
Demonstrated ability to design, iterate, and optimize prompts for language models.
Excellent ability to analyze model outputs, identify gaps, and systematically improve prompt quality.
Strong written and verbal communication abilities, capable of explaining complex technical concepts to both technical and non-technical stakeholders.
Preferred
Experience with vector search solutions, Microsoft Azure AI services, and MLOps frameworks.
Familiarity with prompt templates, prompt chaining, and advanced prompting techniques.
Experience using evaluation metrics (e.g., BLEU, ROUGE, human evaluation).
Experience or interest in user experience design and human-computer interaction.
Company
Intelligenic
Artificial Intelligence
Founded in 2023
2-10 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase
