ICF · 1 day ago
On-Call AI Solutions Specialist - REMOTE
ICF is seeking a technically skilled On-Call AI Solutions Specialist for Child Welfare Information Gateway, a service of the Children’s Bureau. The role involves leading the development, testing, and deployment of customized large language models within the AWS ecosystem, focusing on prompt engineering and model optimization.
ConsultingInformation TechnologyProfessional Services
Responsibilities
Design, test, and refine prompts to optimize LLM outputs for accuracy, relevance, and tone across diverse use cases
Train and fine-tune LLMs using proprietary datasets and prompt engineering techniques
Embed AI prompts into applications and software to automate complex or repetitive tasks
Monitor performance data to optimize outputs and fine tune strategies. Support the integration of AI-powered chatbots into team workflows and enterprise platforms
Monitor AI system performance, analyze output quality, and iterate based on feedback and metrics
Measure SEO and adjust strategies to improve performance on key terms
Collaborate with domain subject matter experts, product, engineering, and UX teams to align AI behavior with user expectations and business goals
Maintain documentation of prompt libraries, model behaviors, and integration strategies
Qualification
Required
Bachelor's degree in Computer Science, AI/ML, Computational Linguistics, or related field
2+ years of experience in prompt engineering, LLM fine-tuning, or NLP model development
Preferred
Master's degree in Computer Science, AI/ML, Computational Linguistics, or related field
Experience with Retrieval-Augmented Generation (RAG) using Amazon Kendra or OpenSearch
Familiarity with vector databases and embedding models hosted on AWS
Knowledge of IAM roles, security best practices, and cost optimization in AWS environments
Experience integrating AI into CI/CD pipelines using AWS CodePipeline or CodeBuild
Demonstrated experience (1-3 years) providing technical assistance to federal partners
Hands-on experience with Amazon SageMaker, Amazon Bedrock, and AWS Glue
Proficiency in Python and experience with AI/ML libraries
Familiarity with deploying serverless applications using AWS Lambda and Step Functions
Experience with chatbot development using Amazon Lex or similar frameworks
Strong understanding of prompt evaluation, model behavior tuning, SEO, and web performance metrics (GA4)
Programming skills in Python or JavaScript, with experience in AI/ML libraries
Company
ICF
ICF is a global consulting and technology services provider focused on making big things possible for our clients.
H1B Sponsorship
ICF has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (29)
2024 (31)
2023 (35)
2022 (29)
2021 (31)
2020 (38)
Funding
Current Stage
Public CompanyTotal Funding
$59MKey Investors
New York State Department of TransportationU.S. Environmental Protection Agency
2023-02-13Grant· $29M
2021-03-15Grant· $30M
2006-09-28IPO
Leadership Team
Recent News
2026-02-10
2026-02-05
2026-02-03
Company data provided by crunchbase