TEKsystems · 2 days ago
Generative AI Engineer
Charlotte, NC
Contract
Hybrid
Senior Level, Lead/Staff
$65/hr - $85/hr
10+ years expTEKsystems is a leading provider of business and technology services, and they are seeking a Generative AI Engineer with expertise in operationalizing and monitoring LLM and RAG-powered applications. The role involves implementing guardrails and observability for these applications while leveraging LLMs as Judges and Specialized Models to measure various metrics.
Information Technology
Responsibilities
Implement guardrails and observability for various RAG and LLM applications across enterprise. This includes application like content summarizer, conversational and etc
Set up GenAI Ops workflows to continuously monitor inference latency, throughput, quality, and safety metrics
Define, track, and analyze RAG guardrail metrics using LLMs as Judges and SLMs(e.g., attribution, grounding, prompt injection, tone, PII leakage)
Implement annotation, structured feedback loops, fine-tuning, and alignment methods to calibrate judge models
Use LangChain to orchestrate guardrail checks, manage prompt versioning, and integrate judge model scoring workflows
Work with OpenShift to deploy, scale, and monitor containerized GenAI services
Build observability dashboards and alerts (Grafana or equivalent) for AI reliability
Contribute to emerging agentic evaluation and guardrails as autonomous AI workflows expand
Ability to lead cross-functional work and motivate cross-functional teams to achieve business objectives and process improvements
Qualification
Required
Bachelor's or master's degree in Data Science, Computer Science, MIS, related field, or equivalent experience
Proven hands-on experience in GenAI Ops — implementing LLM and RAG applications in production
Strong hands-on experience with the LangChain framework
Experience specifically with the OpenAI API, chat completions, embeddings, etc
Have a solid awareness on TensorRT and VLLM implementation
Strong proficiency in Python and data science libraries (NumPy, Pandas, Scikit-learn, PyTorch/TensorFlow)
Proven experience applying guardrails and observability to LLM or RAG-powered applications
Experience with LLMs as Judges and SMLs for evaluation (attribution, adherence, bias, PII, etc.)
Hands-on experience with OpenShift (or Kubernetes) for containerized AI workloads
Experience measuring and optimizing inference latency
Strategic and innovative thinker, able to solve complex problems and develop solutions incorporating data/research to support recommendations and risk/reward tradeoffs
Ability to lead and drive change and deliver results in a heavily matrixed environment
Demonstrated ability to influence a wide variety of stakeholders including executives
Self-starter with an exceptional drive for results and success; conveys a sense of urgency to achieve outcomes and exceed expectations; persists despite obstacles, setbacks and competing influences
Outstanding communication and presentation skills (verbal and written) across all management levels. Must be able to concisely summarize key observations, clearly articulate considerations, propose solutions
Solution design - demonstrates expertise in solution design across multiple technologies; can identify opportunities for technical training and coaching across the organization
Demonstrated expertise in AI strategies and tools
Can identify opportunities for technical training and coaching across the organization
10+ years of experience designing and developing AI solution architectures to scale
Design and develop new proof of concept projects to enhance current AI systems to handle increased traffic and larger datasets with cutting edge
Experience in Agile frameworks and Agile at scale
Ability to provide input for financial planning, tracking, and managing budget variances
Benefits
Medical, dental & vision
Critical Illness, Accident, and Hospital
401(k) Retirement Plan – Pre-tax and Roth post-tax contributions available
Life Insurance (Voluntary Life & AD&D for the employee and dependents)
Short and long-term disability
Health Spending Account (HSA)
Transportation benefits
Employee Assistance Program
Time Off/Leave (PTO, Vacation or Sick Leave)
Company
TEKsystems
At TEKsystems, they understand people. Every year they deploy over 80,000 IT professionals at 6,000 client sites across North America,
10001+ employees
H1B Sponsorship
TEKsystems has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (46)
2024 (52)
2023 (33)
2022 (22)
2021 (36)
2020 (53)
Funding
Current Stage
Late StageLeadership Team
Ryan Skains
Vice President, TEKsystems Global Services
Recent News
2025-11-19
2025-10-29
Company data provided by crunchbase