West Monroe · 3 weeks ago
Senior Prompt Engineer, NYC
New York, NY
Full-time
Hybrid
Senior Level
$137K/yr - $162K/yrWest Monroe is seeking an innovative and detail-oriented Senior Prompt Engineer to support use case development for an Agentic AI platform on Google Cloud Platform (GCP). This role will focus on preparing and structuring input data, designing and refining prompts, and tuning extraction and reasoning behavior to ensure the AI agent produces accurate outputs.
Business DevelopmentConsultingInformation ServicesInformation TechnologyService Industry
Responsibilities
Collect, curate, and structure input data and contextual information required for the AI agent to perform effectively
Develop strategies to optimize the quality and relevance of input data, ensuring it aligns with specific use case requirements
Collaborate with data engineers and domain experts to ensure data sources are clean, consistent, and appropriately formatted for use in AI prompts
Design, test, and refine prompts and schemas to guide the AI agent's behavior and outputs
Create modular and reusable prompt templates that can be adapted across different use cases
Work closely with solution architects and stakeholders to align prompts with business goals and desired outcomes
Experiment with various prompt structures, wording, and configurations to achieve optimal agent performance
Fine-tune the AI agent's extraction and reasoning capabilities to ensure outputs are accurate, consistent, and aligned with expectations
Develop strategies for improving the agent's ability to handle ambiguity, incomplete data, and complex reasoning tasks
Use feedback loops and iterative testing to continuously improve the agent's performance and reliability
Ensure outputs are auditable, providing clear traceability of how the agent arrived at its conclusions
Conduct rigorous testing of prompts and agent behavior to identify and resolve issues such as bias, inconsistencies, or inaccuracies
Develop automated testing frameworks to validate the agent's outputs across various scenarios and edge cases
Document findings and provide actionable recommendations to improve the agent's performance
Collaborate with cross-functional teams, including data scientists, engineers, and business stakeholders, to align on use case requirements and objectives
Act as a subject matter expert on prompt engineering and provide guidance on best practices for leveraging AI agents
Communicate results, challenges, and improvements to technical and non-technical audiences
Qualification
Required
Prompt Engineering: Strong experience designing, refining & optimizing prompts & system instructions for large language models (e.g., GPT, PaLM, or similar) to drive reliable reasoning and task performance
Context Design & Patterns: Expertise in structuring & managing context using patterns such as RAG, prompt chaining, memory windows & schema-driven context alignment
AI/ML & NLP Foundations: Strong understanding of NLP, reasoning models & LLM behavior to inform prompt strategy and failure mitigation
Data Structuring & Preprocessing: Expertise in preparing and transforming input data, including text preprocessing, schema design, and grounding strategies
Google Cloud Platform (GCP): Experience with GCP services such as Vertex AI, BigQuery, and related GCP AI/ML services to deploy and evaluate prompt-driven systems
Programming & Automation Skills: Proficiency in Python or similar programming languages for prototyping, testing, evaluation harnesses and prompt automation
Strong analytical and problem-solving skills to fine-tune agent behavior and resolve inconsistencies
Experience with testing frameworks and methodologies to validate AI outputs across diverse scenarios
Ability to identify and mitigate issues related to bias, ambiguity, or incomplete reasoning in AI agents
Excellent communication skills to explain technical concepts and results to both technical and non-technical stakeholders
Proven ability to work collaboratively in cross-functional teams, including data scientists, engineers, and business users
Strong documentation skills to ensure transparency and reproducibility of prompt engineering processes
Preferred
Experience working with large language models (LLMs) such as OpenAI's GPT, Google's PaLM, or similar
Familiarity with MLOps practices and tools for managing the AI lifecycle
Knowledge of ethical AI principles and techniques for ensuring fairness, transparency, and accountability
Google Cloud certifications (e.g., Professional Machine Learning Engineer, Professional Data Engineer)
Benefits
Employees (and their families) are covered by medical, dental, vision, and basic life insurance.
Employees are able to enroll in our company’s 401k plan.
Employees can purchase shares from our employee stock ownership program.
Employees are eligible to receive annual bonuses.
Employees will also receive unlimited flexible time off.
Employees will receive ten paid holidays throughout the calendar year.
Eligibility for ten weeks of paid parental leave will also be available upon hire date.
Company
West Monroe
West Monroe offers digital transformation, analytics, cloud, cyber security, business advisory, and management consulting services.
Founded in 2002
1001-5000 employees
H1B Sponsorship
West Monroe has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (4)
2024 (2)
2023 (2)
2022 (10)
2021 (7)
Funding
Current Stage
Late StageTotal Funding
unknownKey Investors
MSD Partners
2021-10-15Series Unknown
2020-01-07Acquired
Leadership Team
Gil Mermelstein
Chief Executive Officer
Kevin McCarty
Co-Founder & Executive Chairman of West Monroe
Recent News
Company data provided by crunchbase