The University of North Carolina at Chapel Hill · 3 weeks ago
AI/LLM Developer/Engineer
North Carolina, United States
Full-time
Onsite
Mid, Senior Level
$26.04/hr - $33.85/hr
3+ years expThe University of North Carolina at Chapel Hill is a global leader in higher education, known for its commitment to innovative teaching and research. They are seeking an AI/LLM Developer/Engineer to join their AI research team, focusing on leveraging Large Language Models and clinical data analysis to improve healthcare delivery.
EducationHigher EducationUniversities
Responsibilities
Design, fine-tune, and evaluate large language models (LLMs) tailored to domain-specific applications using techniques such as transfer learning, LoRA, and reinforcement learning with human feedback (RLHF)
Build intelligent applications powered by LLMs, including chatbots, virtual agents, clinical decision tools, or document analyzers, using frameworks like LangChain, LlamaIndex, or semantic search pipelines
Develop scalable LLM pipelines and infrastructure, including data ingestion, preprocessing, model serving (via GPU / TPU), and continuous performance monitoring
Integrate commercial and open-source LLMs (e.g., OpenAI GPT, Claude, Mistral, LLaMA) via APIs or local deployment into digital health or enterprise systems
Craft and iterate prompts using advanced prompt engineering and chain-of-thought strategies to improve output relevance, tone, factuality, and task completion
Implement retrieval-augmented generation (RAG) architectures to enhance context awareness using vector databases (e.g., Pinecone, FAISS, Weaviate)
Evaluate LLM performance using automated and human-in-the-loop methods to assess accuracy, hallucination, safety, and user satisfaction
Collaborate across disciplines with data scientists, UX designers, domain experts, and MLOps to ensure usability, performance, and alignment with real-world needs
Monitor and optimize system performance, including latency, throughput, token usage, and model cost-effectiveness across deployment environments
Stay current with advancements in generative AI, contributing to the internal knowledge base and driving adoption of best practices for ethical and responsible LLM use
Qualification
Required
Bachelor's degree in Computer Science, Electrical Engineering, or related fields
Expertise in Retrieval-Augmented Generation (RAG), Natural Language Processing (NLP), deep learning frameworks
Proficiency in Python and frameworks such as PyTorch, TensorFlow, Hugging Face Transformers, or LangChain
Familiarity with clinical or healthcare data (e.g., EHRs, clinical notes, structured claims data)
Proven research record with peer-reviewed publications in relevant fields
Strong problem-solving skills and the ability to work in a collaborative environment
Preferred
Distributed parallel training and parameter-efficient tuning
Familiarity with multi-modal foundation models, HITL techniques, and prompt engineering
Experience with LLM fine-tuning, prompt engineering, or retrieval-augmented generation (RAG)
Experience deploying large-scale machine learning models in cloud environments
Benefits
Professional training opportunities for career growth, skill development and lifelong learning
Exclusive perks that include numerous retail and restaurant discounts
Savings on local child care centers
Special rates for performing arts events
Company
The University of North Carolina at Chapel Hill
Carolina’s vibrant people and programs attest to the University’s long-standing place among leaders in higher education since it was chartered in 1789 and opened its doors for students in 1795 as the nation’s first public university.
10001+ employees
H1B Sponsorship
The University of North Carolina at Chapel Hill has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (165)
2024 (143)
2023 (100)
2022 (133)
2021 (83)
2020 (89)
Funding
Current Stage
Late StageTotal Funding
$48.57MKey Investors
SECU FoundationCDA FoundationNorth Carolina Biotechnology Center
2024-07-19Grant· $1M
2024-03-18Grant
2023-02-16Grant· $0.11M
Leadership Team
Judith Cone
Retired Vice Chancellor for Innovation, Entrepreneurship and Innovation as of April 1, 2021
Michael Williams
Network SEcurity Team Lead
Recent News
Morningstar.com
2025-09-20
Company data provided by crunchbase