CDW · 2 hours ago
Senior AI Engineer
Illinois, United States
Full-time
Onsite
Mid, Senior Level
$124K/yr - $175K/yr
5+ years expCDW is a leading multi-brand provider of information technology solutions. They are seeking a Senior AI Engineer to transition AI capabilities from prototype to production, focusing on architecting robust Agentic Systems and collaborating with various teams to deliver high-value AI agents.
AnalyticsArtificial Intelligence (AI)Cyber SecurityGraphic DesignHardwareInformation TechnologySoftware
Responsibilities
Agentic Engineering & Orchestration
Workflow Design: Architect complex, multi-agent workflows using Microsoft AI tech stack. Design, Develop and Deploy agents to handle loops, interruptions, and human-in-the-loop interventions
Tool Use & Function Calling: Build reliable "tool layers" that allow LLMs to safely interact with internal APIs, databases, and third-party SaaS platforms (e.g., SalesForce, Workday, ServiceNow etc.)
State Management: Design persistence layers to manage agent memory, conversational history, and context windows efficiently
Advanced Data & RAG Strategy
Retrieval Pipelines: Build production-grade data retrieval and integration systems. Optimize vector indexing, document chunking, and re-ranking algorithms to ensure high-precision context retrieval
Data Quality: Collaborate with Data Engineers to curate "Golden Datasets" for agent consumption
LLMOps, Evaluation & Quality
Automated Evaluation: Build CI/CD pipelines for AI that include "LLM-as-a-Judge" testing. Leverage frameworks to score agent outputs for accuracy, hallucination, and safety before deployment
Observability: Instrument applications with tracing tools to visualize agent reasoning chains, monitor latency, and debug failures in production
Cost Optimization: Monitor token usage and latency, optimizing prompt density and caching strategies to maintain high performance at sustainable costs
Innovation & Collaboration
Prototyping to Production: Rapidly validate new ideas using state-of-the-art models, then refactor successful prototypes into maintainable, tested production code
Standards Adoption: Stay ahead of the curve by evaluating emerging technologies to standardize agent connectivity
Qualification
Required
Bachelor's degree and 5 years of software engineering experience, with exposure to AI/ML applications OR 9 years of software engineering experience, with exposure to AI/ML applications
2+ years specifically building with LLMs, with deep familiarity in: Orchestration: LangChain, LangGraph, or similar state-based frameworks
2+ years specifically building with LLMs, with deep familiarity in: Vector DBs: Pinecone, Weaviate, or pgvector
2+ years specifically building with LLMs, with deep familiarity in: Prompt Engineering: Advanced techniques (Chain-of-Thought, ReAct, Few-Shot)
Experience not just building demos, but operating them. You know how to handle rate limits, context window overflows, and non-deterministic errors
Ability to explain 'probabilistic software' to non-technical stakeholders—managing expectations that agents are never 100% accurate, but can be 100% useful
Excellent communication skills, with experience in documenting technical designs, sharing insights, and enabling team knowledge transfer
Company
CDW
At CDW, we know how to make technology work so people can do great things.
10001+ employees
H1B Sponsorship
CDW has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (59)
2024 (49)
2023 (37)
2022 (86)
2021 (44)
2020 (19)
Funding
Current Stage
Public CompanyTotal Funding
$58.74M2015-08-01Post Ipo Equity· $58.74M
2013-06-27IPO
2008-07-31Series Unknown
Leadership Team
Christine Leahy
President & CEO
Sanjay Sood
Chief Technology Officer
Recent News
Government Technology US
2026-01-16
2026-01-05
2025-12-24
Company data provided by crunchbase