New York Technology Partners · 1 day ago
LLM / AI Prototyping Specialist
Collegeville, PA
Contract
Hybrid
Mid, Senior Level
2+ years expNew York Technology Partners is seeking a LLM / AI Prototyping Specialist to help stand up and scale early-stage LLM and agent-based solutions as part of a Life Sciences Cloud transformation program. The role focuses on rapid prototyping and maturation of AI-powered assistants, translating business needs into LLM behaviors, and collaborating with various stakeholders to deliver impactful AI capabilities.
ConsultingSoftwareHuman ResourcesInformation TechnologyStaffing Agency
Hiring Manager
Jay Doshit
Responsibilities
Design, prototype, and iterate on LLM-powered assistants for training, hypercare, and operational enablement use cases
Convert loosely defined requests (e.g., "how-do-I assistant” or knowledge companion) into clear conversational flows, system prompts, and grounding strategies
Build and tune RAG pipelines over unstructured document sets, including:
Document chunking strategies
Metadata and tagging design
Vector search relevance tuning
Ensure retrieval logic, prompt design, and response behavior are tuned holistically
Take prototypes from proof-of-concept to more robust, enterprise-ready solutions by:
Designing evaluation datasets and test cases
Iterating to improve accuracy, consistency, and latency
Partner with training, product, and field stakeholders to operationalize content and prioritize high-value use cases
Collaborate effectively with platform and data engineers within an enterprise application ecosystem
Focus on pragmatic, "base-hit” AI use cases that measurably improve day-to-day workflows for end users
Qualification
Required
2–3+ years of hands-on experience with GPT-class models or equivalent LLMs
Strong expertise in prompt engineering, system prompt design, and grounding strategies
Practical experience building retrieval-augmented generation (RAG) systems over unstructured content
Clear understanding of how chunking, retrieval, and prompting interact as a system
Experience embedding LLM capabilities into enterprise applications (e.g., Salesforce, ServiceNow, Dynamics, SAP, or custom internal platforms)
Experience working in or adjacent to regulated environments (life sciences, healthcare, or financial services preferred)
Ability to operate independently in a fast-moving, prototype-driven environment
Strong communication skills and comfort working directly with non-technical stakeholders
Mid-to-senior level individual contributor profile
Preferred
Familiarity with Salesforce AI capabilities, including AgentForce or Einstein
Prior work on training assistants, hypercare tools, or knowledge-based AI companions
Familiarity with AWS fundamentals (e.g., S3, Lambda) and data pipelines
Life sciences, pharma, or other highly regulated industry experience
Company
New York Technology Partners
New York Technology Partners is an information technology company that provides IT and engineering services.
201-500 employees
H1B Sponsorship
New York Technology Partners has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (52)
2024 (74)
2023 (59)
2022 (104)
2021 (74)
2020 (115)
Funding
Current Stage
Growth StageLeadership Team
Amy Reynolds
Senior Talent Acquisition Partner
Hetal Shah
Technical Recruiter at New York Technology Partners
Company data provided by crunchbase