Pantheon Data · 1 day ago
Senior Data Engineer (AI/ML and AWS Cloud)
Pantheon Data is a private small business based in the Washington, DC area, specializing in various service offerings including technology and program management. They are seeking a Senior Data Engineer to design and optimize data foundations for Generative AI applications, focusing on data pipelines and AWS integration.
Cyber SecurityConsultingInformation Technology
Responsibilities
LLM Data Pipelines: Design and implement scalable data ingestion and transformation pipelines specifically for RAG (Retrieval-Augmented Generation) architectures
AWS Bedrock Integration: Operationalize LLM workflows using AWS Bedrock, managing model invocations, and embedding generation
Data Enrichment & Quality: Develop advanced Python-based processing jobs to clean and enrich unstructured data with metadata to improve LLM retrieval accuracy
Vector Database Management: Architect and maintain vector stores (e.g., OpenSearch Serverless or Postgressql pgvector) to support efficient semantic search
Cloud Architecture: Leverage core AWS services (S3, Glue, Lambda, Step Functions) to build resilient, automated data workflows
DevSecOps Collaboration: Work with the security team to ensure all data handling meets stringent compliance standards (e.g., FedRAMP/DISA STIGs) through Infrastructure as Code
Qualification
Required
Expert-level Python programming with experience in libraries such as Pandas and LLM orchestration frameworks like LangChain or LlamaIndex
Hands-on experience with AWS Bedrock and Amazon SageMaker
Proven track record with AWS Glue (ETL), Athena, and Redshift
Must hold a recognized Data Science Certification (e.g., AWS Certified Data Engineer, Databricks Certified Data Scientist)
Proficiency in both SQL and NoSQL, with specific experience in Vector Databases
Ability to work effectively remotely in cross-functional teams
Ability to meet deadlines and produce quality work
Proficient in Microsoft Suite software including Outlook, Word, Excel, SharePoint, and PowerPoint
Bachelor's Degree
U.S. Citizenship with the ability to obtain and maintain a DoD Secret clearance
Benefits
SmartBenefits through the Washington Metro Area Transportation Authority
Tuition assistance may be available for continuing education expenses and certifications related to their position
Company
Pantheon Data
Pantheon Data is an IT firm that offers cyber security, system engineering, and consulting services.
Funding
Current Stage
Late StageRecent News
2025-08-13
Seattle TechFlash
2025-05-17
Company data provided by crunchbase