CDW · 23 hours ago
Senior AI Engineer
United States
Full-time
Remote
Mid, Senior Level
$124K/yr - $175K/yr
5+ years expCDW is a leading multi-brand provider of information technology solutions, and they are seeking a Senior AI Engineer to transition their AI capabilities from prototype to production. The role involves architecting robust Agentic Systems, collaborating with various teams, and delivering high-value AI agents that solve real-world problems across the enterprise.
AnalyticsArtificial Intelligence (AI)Cyber SecurityGraphic DesignHardwareInformation TechnologySoftware
Responsibilities
Architect complex, multi-agent workflows using Microsoft AI tech stack
Design, Develop and Deploy agents to handle loops, interruptions, and human-in-the-loop interventions
Build reliable "tool layers" that allow LLMs to safely interact with internal APIs, databases, and third-party SaaS platforms (e.g., Salesforce, Workday, ServiceNow etc.)
Design persistence layers to manage agent memory, conversational history, and context windows efficiently
Build production-grade data retrieval and integration systems
Optimize vector indexing, document chunking, and re-ranking algorithms to ensure high-precision context retrieval
Collaborate with Data Engineers to curate "Golden Datasets" for agent consumption
Build CI/CD pipelines for AI that include "LLM-as-a-Judge" testing
Leverage frameworks to score agent outputs for accuracy, hallucination, and safety before deployment
Instrument applications with tracing tools to visualize agent reasoning chains, monitor latency, and debug failures in production
Monitor token usage and latency, optimizing prompt density and caching strategies to maintain high performance at sustainable costs
Rapidly validate new ideas using state-of-the-art models, then refactor successful prototypes into maintainable, tested production code
Stay ahead of the curve by evaluating emerging technologies to standardize agent connectivity
Qualification
Required
Bachelor's degree and 5 years of software engineering experience, with exposure to AI/ML applications OR 9 years of software engineering experience, with exposure to AI/ML applications
2+ years specifically building with LLMs, with deep familiarity in: Orchestration: LangChain, LangGraph, or similar state-based frameworks
2+ years specifically building with LLMs, with deep familiarity in: Vector DBs: Pinecone, Weaviate, or pgvector
2+ years specifically building with LLMs, with deep familiarity in: Prompt Engineering: Advanced techniques (Chain-of-Thought, ReAct, Few-Shot)
Experience not just building demos, but operating them. You know how to handle rate limits, context window overflows, and non-deterministic errors
Ability to explain 'probabilistic software' to non-technical stakeholders—managing expectations that agents are never 100% accurate, but can be 100% useful
Excellent communication skills, with experience in documenting technical designs, sharing insights, and enabling team knowledge transfer
Company
CDW
At CDW, we know how to make technology work so people can do great things.
10001+ employees
H1B Sponsorship
CDW has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (59)
2024 (49)
2023 (37)
2022 (86)
2021 (44)
2020 (19)
Funding
Current Stage
Public CompanyTotal Funding
$58.74M2015-08-01Post Ipo Equity· $58.74M
2013-06-27IPO
2008-07-31Series Unknown
Leadership Team
Christine Leahy
President & CEO
Sanjay Sood
Chief Technology Officer
Recent News
Government Technology US
2026-01-16
2026-01-05
2025-12-24
Company data provided by crunchbase