iTeckSoft Inc. · 2 days ago
Platform Engineer
iTeckSoft Inc. is seeking an Agentic Platform Engineer to build core platform capabilities used by agents in Cloud Studio. The role involves implementing orchestration runtime, shared memory, evaluation tools, and collaborating with various engineering squads to enhance platform usability and performance.
Responsibilities
Implement the agent orchestration engine used by all squads:
Graph / state machine / DAG of agents and tools
Routing, retries, timeouts, parallel execution, fallbacks
Build and maintain the internal Agent SDK:
Base classes and interfaces for agents, tools, and workflows
Standard patterns for error handling, logging, and configuration
Integrate the agent runtime with cloud-native infrastructure:
Docker images, Kubernetes/OpenShift/Fargate workloads
CI/CD pipelines (build, test, deploy) for agent services
Ensure the platform supports multi-LLM and multi-cloud configurations
Implement the shared memory layer:
Integrate vector stores, search, and other storage mechanisms
Define APIs for agents to read/write context safely and consistently
Build reusable retriever components:
Chunking, embedding, metadata strategies
Domain-specific retrievers (code, configs, schemas, documents) in collaboration with squads
Work closely with the Foundations Lead to refine context schemas and best practices
Implement evaluation tooling for agents:
Harnesses to run test sets, capture outputs, compare against expected behaviors
Metrics and dashboards for quality, reliability, and performance
Implement basic guardrails:
Output validation, constraints on actions, policy checks, and sanity checks
Build observability hooks:
Structured logging, traces, metrics (latency, cost, error types, memory hit rates, etc.)
Dashboards for monitoring agent workflows in dev/test and pilot environments
Partner with Cloud Migration, App Modernization, and Data Modernization engineers to:
Understand their use cases and friction points
Evolve the platform to remove friction and improve reuse
Help domain squads adopt and correctly use the Agent SDK, memory, and evaluation tools
Contribute to internal documentation, examples, and best-practice guides (“how to build an agent in Cloud Studio”)
Qualification
Required
Hands-on experience integrating LLMs (OpenAI / Azure OpenAI / others) into applications
Experience with at least one LLM/agent framework (LangChain, LangGraph, LlamaIndex, custom)
Solid understanding of prompt design and context construction
Familiarity with tool-using agents and basic multi-agent flows (task decomposition, handoff, etc.) is a strong plus
5–8+ years of software engineering experience, ideally in backend/platform roles
Strong proficiency in Python and at least one of: TypeScript, Java, Go, or .NET
Experience building APIs, services, and libraries consumed by other teams
Solid understanding of cloud-native environments: Docker, Kubernetes/OpenShift
CI/CD pipelines (GitHub Actions, Argo CD, etc.)
Comfortable with distributed systems concepts (latency, retries, backpressure, idempotency)
Experience working with databases and search/retrieval technologies
Familiarity with vector databases (e.g., Pinecone, Qdrant, pgvector, Weaviate) or search engines
Understanding of RAG patterns: chunking, embedding, metadata, retrieval tuning
Experience building testing or evaluation harnesses for complex systems (not necessarily only AI)
Familiar with metrics/logging stacks (e.g., Prometheus, Grafana, ELK, OpenTelemetry, etc.)
Understanding of basic safety and validation patterns for AI output (schema checks, constraints, domain rules)
Enjoys building platforms and tools that other engineers rely on daily
Comfortable in a fast-paced R&D environment with iteration and ambiguity
Strong communication skills; can explain platform features clearly and help others adopt them
Collaborative mindset; happy to jump on calls with domain squads and debug issues end-to-end
Preferred
Experience with one of the domain areas (cloud migration, app modernization, data engineering)
Exposure to event-driven architectures and message buses (Kafka, etc.)
Prior work on developer platforms, SDKs, or internal frameworks
Company
iTeckSoft Inc.
iTeckSoft Inc., located in Alpharetta, GA, was formed by a team of highly experienced software architects, managers, and technology professionals who have successfully implemented numerous projects for Fortune 50 companies.
H1B Sponsorship
iTeckSoft Inc. has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2)
2024 (1)
2023 (1)
Funding
Current Stage
Early StageCompany data provided by crunchbase