Capco · 10 hours ago
AI Technical Architect
Charlotte, NC
Full-time
Hybrid
Senior Level, Lead/Staff
10+ years expCapco is a leading consultancy dedicated to the financial services industries, offering innovative solutions and technology integration. As an AI Technical Architect, you will design and implement next-generation AI systems, focusing on generative AI and agentic systems, while guiding cross-functional teams from conception to deployment.
ConsultingFinanceFinancial ServicesInsurance
Responsibilities
Define and evolve the enterprise-wide architectural vision and strategy for Generative AI and agentic systems, aligning with overall business goals and technology roadmaps
Lead the design of modular, reusable, and scalable architectural patterns for GenAI and agentic applications across various domains
Design and implement robust, secure solution patterns that can be operationalized across enterprise environments
Deep expertise in various foundation models (e.g., LLMs, vision models, multimodal models) including their architectures, strengths, limitations, and fine-tuning techniques
Evaluate, select, and integrate appropriate foundation models for specific use cases, considering factors like performance, cost, and ethical implications
Develop strategies for model pre-training, fine-tuning, and continuous improvement
Architect and implement intelligent agentic AI systems using frameworks like LangChain, LangGraph, CrewAI, AutoGen, or similar
Design complex agentic workflows, including planning, reasoning, tool integration, memory management, and human-in-the-loop interactions
Lead the integration of agentic AI solutions with existing enterprise systems and define integration standards (e.g., RESTful APIs, microservices)
Apply advanced prompt engineering techniques to optimize AI model performance and steer outputs towards desired outcomes, minimizing bias and hallucinations
Oversee orchestration of AI components and services, including LLM APIs, vector databases, and external tools
Develop and implement Retrieval Augmented Generation (RAG) based solutions for enhanced contextual understanding and factual accuracy
Design and build cloud-native, containerized infrastructure (e.g., Kubernetes, ECS, EKS on AWS, Azure, GCP) for deploying GenAI models and agentic systems at scale
Implement robust MLOps pipelines for the continuous integration, delivery, deployment, monitoring, and management of AI models in production
Ensure AI solutions comply with regulatory requirements, data privacy, and ethical AI standards
Stay abreast of the latest advancements in AI, machine learning, deep learning, and agentic systems, and apply this knowledge to drive innovation
Rapidly develop Proofs of Concept (PoCs) and iterate solutions using an agile, experimental approach without compromising architectural integrity or long-term scalability
Serve as a technical expert and mentor to junior AI engineers and architects, fostering a culture of continuous learning and improvement
Contribute to internal workshops, knowledge sharing, and external forums as a thought leader
Collaborate effectively with cross-functional teams including product managers, data scientists, software engineers, security, and business stakeholders
Articulate complex technical concepts to diverse audiences, both technical and non-technical
Maintain detailed architectural documentation and operational playbooks
Qualification
Required
Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Machine Learning, or a related quantitative field
10+ years of progressive experience in software architecture, with at least 2-3 years specifically focused on Generative AI and Machine Learning
Demonstrated expertise in designing and implementing AI architectures with a strong focus on Generative AI and Agentic AI technologies
Profound understanding of various foundation models (LLMs, vision models, multimodal models) and their underlying architectures (e.g., Transformers)
Hands-on experience with agentic AI frameworks such as LangChain, LangGraph, CrewAI, AutoGen, or similar
Strong programming skills in Python is essential, with experience in relevant AI/ML frameworks (e.g., TensorFlow, PyTorch)
Experience with cloud platforms (AWS, Azure, GCP) and their AI/ML services (e.g., Amazon SageMaker, Azure Machine Learning, Google Cloud AI Platform, Vertex AI)
Familiarity with MLOps principles and tools for deploying, monitoring, and managing AI models and agentic systems in production (e.g., MLflow, Kubeflow)
Experience with vector databases (e.g., Pinecone, Weaviate, FAISS, Azure AI Search) and techniques for processing and ingesting unstructured data
Excellent communication, interpersonal, and leadership skills, with the ability to influence and drive technical decisions
Strong analytical and problem-solving abilities
Willingness to work in the Charlotte office 3 days per week
Benefits
Medical, dental, and vision insurance
A 401(k) plan
Tuition reimbursement
Company
Capco
Capco is a technology and management consulting firm that provides consulting for the financial services and energy industries.
5001-10000 employees
H1B Sponsorship
Capco has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (10)
2024 (5)
2023 (8)
2022 (15)
2021 (2)
2020 (14)
Funding
Current Stage
Late StageTotal Funding
$80MKey Investors
Thomas Weisel Partners
2021-03-04Acquired
2000-05-24Private Equity· $80M
Leadership Team
Anne-Marie Rowland
Chief Executive Officer
Andrew McGinn
Partner - Digital, Data & Technology
Recent News
Company data provided by crunchbase