Apply on Employer Site

Ad Hoc LLC · 1 month ago

Evergreen: AI Platform & Data Engineer

United States

Full-time

Remote

Senior Level

7+ years exp

Ad Hoc is a technology company that empowers organizations to deliver scalable, impactful digital services. The Senior AI Platform & Data Engineer will design and implement AI/ML infrastructure, mentor team members, and drive improvements in data processes while contributing to the program’s data strategy.

ComputerData ManagementSoftware

Culture & Values

Responsibilities

Design, build, and operationalize a scalable AI/ML infrastructure to support multi-agent AI systems

Implement the Model Control Plane (MCP) for model lifecycle management. Provide reusable AI services and data foundations

Researching and integrating AI agent frameworks (e.g., LangChain). Designing the MCP for model registry and lineage tracking

Developing shared foundational services like a managed vector database (for RAG) and distributed caching. Integrating Human-in-the-Loop (HITL) workflows for safe agent operation

Strong influential skills to propose and evaluate multiple approaches to technical and process problems

Serves as a mentor to individuals within the team

May leads small, less critical, or temporary team structures and projects

Presents design documents, system diagrams, etc. to clients, stakeholders, partners, and other engineers

Fully understands and consistently implements data engineering best practices

Generates data architecture recommendations and demonstrates the ability to implement them

Diagnoses and effectively resolves issues with the systems they own, using incidents to inform educational opportunities and system improvements

Actively mentors and assists more junior engineers in the development of their skills

Effectively communicates technical issues and developments with team members and clients

Participates in technical interviews with new candidates

Qualification

AI/ML infrastructureData ingestion systemsCloud database servicesAI/ML workflowsPythonSQLSpark/DatabricksKubernetes/ECSOpenAPIData architecture recommendationsTechnical mentoringEffective communication

Required

Bachelor's degree and 7+ years of experience

Relevant years of experience may be substituted for education

Demonstrates expert-level knowledge in at least one family of data ingestion systems, cloud database services, and visualization software

Expertise in key data concepts including constructing databases, processing big data, improving data accuracy, etc

Preferred

Strong experience with data engineer in the cloud

Expertise in AI/ML workflows, model deployment, and observability (latency, throughput)

Ability to design for data privacy and implement technical AI guardrails

Python (primary language), SQL, Spark/Databricks (for large-scale data processing), Kubernetes/ECS, OpenAPI (for API documentation), experience with vector databases and feature stores