SIGN IN
Senior Data Engineer (AI/ML and AWS Cloud) jobs in United States
info-icon
This job has closed.
company-logo

Pantheon Data · 1 day ago

Senior Data Engineer (AI/ML and AWS Cloud)

Pantheon Data is a private small business based in the Washington, DC area, specializing in various service offerings including technology and program management. They are seeking a Senior Data Engineer to design and optimize data foundations for Generative AI applications, focusing on data pipelines and AWS integration.
Cyber SecurityConsultingInformation Technology
badNo H1BnoteSecurity Clearance RequirednoteU.S. Citizen Onlynote

Responsibilities

LLM Data Pipelines: Design and implement scalable data ingestion and transformation pipelines specifically for RAG (Retrieval-Augmented Generation) architectures
AWS Bedrock Integration: Operationalize LLM workflows using AWS Bedrock, managing model invocations, and embedding generation
Data Enrichment & Quality: Develop advanced Python-based processing jobs to clean and enrich unstructured data with metadata to improve LLM retrieval accuracy
Vector Database Management: Architect and maintain vector stores (e.g., OpenSearch Serverless or Postgressql pgvector) to support efficient semantic search
Cloud Architecture: Leverage core AWS services (S3, Glue, Lambda, Step Functions) to build resilient, automated data workflows
DevSecOps Collaboration: Work with the security team to ensure all data handling meets stringent compliance standards (e.g., FedRAMP/DISA STIGs) through Infrastructure as Code

Qualification

Python MasteryAWS AI/ML EcosystemData Engineering FoundationsDatabase ExpertiseData Science CertificationDeadline managementMicrosoft Suite proficiencyCross-functional teamwork

Required

Expert-level Python programming with experience in libraries such as Pandas and LLM orchestration frameworks like LangChain or LlamaIndex
Hands-on experience with AWS Bedrock and Amazon SageMaker
Proven track record with AWS Glue (ETL), Athena, and Redshift
Must hold a recognized Data Science Certification (e.g., AWS Certified Data Engineer, Databricks Certified Data Scientist)
Proficiency in both SQL and NoSQL, with specific experience in Vector Databases
Ability to work effectively remotely in cross-functional teams
Ability to meet deadlines and produce quality work
Proficient in Microsoft Suite software including Outlook, Word, Excel, SharePoint, and PowerPoint
Bachelor's Degree
U.S. Citizenship with the ability to obtain and maintain a DoD Secret clearance

Benefits

SmartBenefits through the Washington Metro Area Transportation Authority
Tuition assistance may be available for continuing education expenses and certifications related to their position

Company

Pantheon Data

twittertwitter
company-logo
Pantheon Data is an IT firm that offers cyber security, system engineering, and consulting services.

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Alex Richardson, PMP
Chief Operating Officer
linkedin
Company data provided by crunchbase