ShelterZoom · 3 days ago
AI Engineer (Go & Python)
United States
Full-time
Remote
Mid, Senior LevelShelterZoom is a deep tech company recognized by Gartner as a market leader in cybersecurity and digital content ownership. They are seeking an AI Engineer with expertise in Go and Python to build, deploy, and operate production-grade LLM-powered systems, focusing on reliability, scalability, and performance.
Artificial Intelligence (AI)BlockchainDocument ManagementEducationFinancial ServicesGovernmentHealth CareLegalReal EstateSaaS
Responsibilities
Design, build, and maintain production-ready LLM and RAG-based systems with a strong focus on reliability, scalability, and performance
Architect and implement Retrieval-Augmented Generation (RAG) pipelines, including hybrid search (dense + sparse), re-ranking, and retrieval validation
Design and manage LLM memory layers, including:
Short-term memory (context windows)
Long-term memory (vector databases)
Structured memory (key-value stores and relational databases)
Integrate and optimize LLMs and embeddings for real-world use cases, including chunking, indexing, and retrieval strategies
Develop and orchestrate AI agents, including multi-agent systems (planner–executor, supervisor–worker patterns)
Implement robust guardrails and hallucination mitigation techniques using validation, constraints, and monitoring
Build observability and evaluation pipelines for LLM systems (quality, latency, cost, and safety)
Optimize systems for latency, cost efficiency, and throughput, including async inference, streaming, caching, and prompt compression
Collaborate closely with product, security, and infrastructure teams to deliver secure, enterprise-grade AI solutions
Contribute to system design, code reviews, testing, and continuous improvement of engineering best practices
Qualification
Required
Design and implementation of RAG systems, including: Hybrid search (dense + sparse), Re-ranking strategies
LLM memory design: Short-term (context window), Long-term (vector databases), Structured memory (KV / relational databases)
Embeddings & chunking strategies: text-embedding-3, BGE, E5, Sliding window and semantic chunking
Evaluation frameworks: RAGAS, TruLens, DeepEval
Experience with agent frameworks: LangChain, LangGraph, MCP (Model Context Protocol), Multi-agent orchestration patterns
Prompt engineering: System prompts, Few-shot learning, Structured outputs
Guardrails & hallucination mitigation: Retrieval validation, Output constraints
Observability & monitoring: Langfuse, OpenTelemetry, custom tracing
Cost optimization: Token budgeting, Caching strategies, Prompt compression
Latency optimization: Async inference, Parallel calls, Streaming responses
Strong proficiency in Python and Go
Go runtime internals: Concurrency model (goroutines, channels), Garbage collection, Core data structures, Profiling and performance tuning, Testing practices
Preferred
Strong understanding of software design principles: SOLID, Clean Architecture, GoF patterns
Idiomatic Go project layout
Networking fundamentals: TCP/IP and core Internet concepts
Knowledge Graphs / GraphRAG
Data systems fundamentals: OLTP vs OLAP, ACID, CAP theorem, Index structures
Databases: PostgreSQL, MySQL, MongoDB (internal principles and components)
Infrastructure & DevOps: Kubernetes, Prometheus, CI/CD, AWS
Distributed systems: Redis, Elasticsearch, Kafka
Microservices and high-availability systems
Exposure to additional technologies beyond the core stack
Russian language proficiency (nice to have, not required)
Benefits
Competitive salary
Learning and development opportunities to support individual growth
Flexible, remote work with a strong focus on work–life balance and wellbeing
Open-minded, collaborative, and diverse culture
Clear career growth path in a company with a one-of-a-kind, category-defining product
Equal opportunities in a respectful, fair, and socially conscious environment
A people-first culture built on respect and open communication
Dynamic and flexible international team
Opportunity to work on cutting-edge AI-driven cybersecurity and digital resilience platforms with proven market recognition
Company
ShelterZoom
ShelterZooms stops wire fraud, data breaches, prevents ransomware and enables unprecedented document control via a 1-click solution
Founded in 2017
51-200 employees
Funding
Current Stage
Growth StageTotal Funding
$31.11M2025-07-22Series Unknown· $6M
2024-05-08Series Unknown· $2.43M
2023-03-30Series Unknown· $6M
Leadership Team
Chao Cheng-Shorland
Co-Founder and CEO
Allen Alishahi
Co-Founder & President
Recent News
2025-12-09
FinTech Global
2025-07-25
2025-07-24
Company data provided by crunchbase