Guidehouse · 21 hours ago
AI Solutions Architect
Huntsville, AL
Full-time
Onsite
Senior Level, Lead/Staff
8+ years expGuidehouse is seeking an AI Solutions Architect / Technical Lead to join their Technology / AI and Data team, supporting mission-critical initiatives for Defense and Security clients. The role involves serving as the principal architect for advanced AI platforms and providing technical leadership to ensure compliance with federal standards while delivering innovative solutions for data-driven decision-making.
AdviceConsultingManagement Consulting
No H1B
Security Clearance RequiredU.S. Citizen Only
Responsibilities
Serves as the principal technical architect for the FBI adjudication AI platform, responsible for end-to-end architecture spanning ingestion, RAG, LLM inference, structured scoring, continuous learning loops, and analyst-facing mission workflows
Leads a dual-path LLM strategy that supports self-hosted open‑weight LLMs in AWS GovCloud as well as FedRAMP High managed model endpoints, ensuring secure, scalable, compliant, and mission‑aligned model operations
Provides architectural governance across backend services, model pipelines, data engineering, DevSecOps, and UI/UX components to ensure coherence, performance, and SEAD‑4 adjudication alignment
Ensures platform architecture conforms to FedRAMP High, RMF, NIST 800‑53, and FBI ATO requirements, including boundary definition, logging standards, and continuous monitoring readiness
Define the complete technical architecture for document ingestion, long‑document processing, embedding generation, vector search, anomaly detection, LLM inference, and adjudication memo generation components
Architect scalable infrastructure for 200M+ tokens/month processing volumes, supporting GPU‑based inference clusters, model routers, caching layers, and workflow orchestration services
Establish architectural standards for both self‑hosted GPU clusters and managed model endpoints, defining patterns for batching, KV‑cache utilization, parallel inference, and latency optimization
Produce architectural diagrams, sequence flows, integration contracts, and service interaction models to guide all development teams and maintain architectural consistency
Oversee design of AI/ML workflows supporting entity extraction, evidence linkage, SEAD‑4 scoring, anomaly detection, summarization, and document reasoning
Define fine‑tuning strategies using SFT, LoRA/QLoRA, dataset curation, evaluation pipelines, drift monitoring, and regression testing for consistent model quality
Establish standards for retrieval‑augmented generation (RAG), including embedding selection, retrieval indexing, chunking strategies, context assembly, and chain‑of‑thought management
Build monitoring patterns to detect hallucinations, scoring inconsistencies, bias, and model performance degradation across adjudicative domains
Ensure architecture supports FedRAMP High and RMF controls across data governance, encryption, access management, logging, segmentation, and monitoring
Author ATO documentation including SSPs, boundary diagrams, data flow diagrams, control implementation statements, and continuous monitoring artifacts
Embed secure‑by‑design engineering practices across APIs, data pipelines, LLM workflows, inference gateways, and audit logging layers
Define end‑to‑end auditability standards capturing prompts, model outputs, retrieval contexts, scoring rationales, and analyst overrides
Provide senior engineering guidance to FBI leadership, translating complex model architecture, system behavior, and design tradeoffs into mission‑relevant insights
Guide sprint planning, backlog prioritization, code review practices, engineering QA, and decision analysis across AI/ML, backend, cloud, and security teams
Mentor senior engineers and ensure adherence to best practices for LLM integration, microservices development, and secure cloud operations
Collaborate directly with adjudicators, policy SMEs, mission stakeholders, and IT partners to ensure platform capabilities meet operational requirements
Identify and evaluate new technologies—including multimodal LLMs, knowledge graphs, retrieval fusion methods, and reasoning verification tools—to improve mission outcomes and analyst efficiency
Develop long‑term modernization strategies around learning loops, evidence provenance tracking, justification generation, and adaptive adjudication workflows
Support Guidehouse AI strategy, whitepapers, proposals, and federal AI modernization initiatives through technical leadership and domain expertise
Qualification
Required
An ACTIVE and MAINTAINED 'TOP SECRET' Federal or DoD security clearance
8+ years of experience designing secure, scalable cloud architectures using container orchestration, distributed systems, workflow automation, microservices, and GPU-accelerated workloads
Deep expertise in AWS GovCloud, Kubernetes/EKS, GPU workloads, distributed systems, workflow orchestration, and microservice architecture
Proven experience architecting AI/ML or LLM-enabled platforms
Experience working within FedRAMP High, RMF or similar compliance frameworks
Ability to lead multi-disciplinary engineering teams and define end-to-end system architectures
Preferred
An ACTIVE and MAINTAINED 'TOP SECRET' Federal or DoD security clearance
Once onboard with Guidehouse, new hire MUST be able to OBTAIN and MAINTAIN a Federal or DoD 'TOP SECRET/SCI (TS/SCI)' security clearance
AWS GovCloud services (EC2, S3, EKS, Lambda, KMS, API Gateway, etc.)
Kubernetes/EKS specifically (vs. generic container orchestration)
Step Functions / EventBridge / Bedrock
Vector DB experience (FAISS, pgvector, Milvus)
LLM serving frameworks (vLLM, TGI, Sagemaker)
Experience with SEAD‑4 adjudication, personnel vetting, continuous vetting, or investigative review workflows
Experience fine‑tuning open‑weight LLMs in secure or air‑gapped environments using LoRA/QLoRA or SFT
Experience with knowledge graphs, entity resolution pipelines, reasoning verification, or explainability frameworks
AWS Solutions Architect Professional, Security, or Machine Learning certifications
Benefits
Medical, Rx, Dental & Vision Insurance
Personal and Family Sick Time & Company Paid Holidays
Position may be eligible for a discretionary variable incentive bonus
Parental Leave and Adoption Assistance
401(k) Retirement Plan
Basic Life & Supplemental Life
Health Savings Account, Dental/Vision & Dependent Care Flexible Spending Accounts
Short-Term & Long-Term Disability
Student Loan PayDown
Tuition Reimbursement, Personal Development & Learning Opportunities
Skills Development & Certifications
Employee Referral Program
Corporate Sponsored Events & Community Outreach
Emergency Back-Up Childcare Program
Mobility Stipend
Company
Guidehouse
Guidehouse offers consulting services for public and commercial markets with expertise in management, technology, and risk consulting.
10001+ employees
Funding
Current Stage
Late StageTotal Funding
$0.75MKey Investors
Mission Daybreak
2023-11-06Acquired
2023-02-16Grant· $0.75M
Leadership Team
Scott McIntyre
Chairman and CEO
Alicia Harkness
Partner
Recent News
Washington Technology
2026-01-09
Washington Technology
2025-11-20
Company data provided by crunchbase