Innovare Strategy Group · 2 months ago
Senior AI/ML + Full-Stack Engineer (Contract) – Cloud-Native Systems
New York, NY
Full-time, Contract
Onsite
Senior Level, Lead/Staff
$15,000/mo - $17,000/mo
8+ years expInnovare Strategy Group is a nimble mid-market firm building an in-house AI platform to transform data utilization for better decision-making and operational efficiency. They are seeking a Senior AI/ML + Full-Stack Engineer to architect multi-agent systems, develop evaluation frameworks, and manage cloud-native environments while mentoring in-house engineers.
Information Technology & Services
Responsibilities
Architect Multi-Agent Systems: Design and implement orchestration patterns for LLM agents and tool integrations, ensuring robust handoffs and context management
Build Retrieval-Augmented Workflows: Define strategies for document chunking, embeddings, and retrieval diagnostics to maximize precision, recall, and groundedness
Develop Evaluation Frameworks: Create offline and online evaluation harnesses for precision, recall, F1 score, consistency, and latency. Integrate golden datasets and adversarial tests into CI/CD pipelines
Data Strategy & Quality: Lead dataset curation and labeling workflows; propose prompt optimizations, fine-tuning or parameter-efficient approaches where justified
Implement Guardrails: Design defenses against prompt injection and enforce output validation for compliance and trust
Observability & LLMOps: Instrument dashboards for model metrics, retrieval quality, and cost/latency tracking. Establish versioning and lineage for prompts, datasets, and configurations
End-to-End Development: Build and deploy web applications, APIs, and dashboards for AI workflows
Cloud Infrastructure: Design and manage cloud-native environments (AWS/GCP/Azure), including containerization (Docker/Kubernetes) and CI/CD pipelines
Frontend & Backend: Implement user interfaces (React, Vue, or similar) and backend services (Python/FastAPI, Node.js) for AI integration
Mentor & Multiply: Guide our in-house engineers, set standards, and deliver durable architectural documentation
Qualification
Required
8+ years in applied ML/AI systems, including production-grade LLM or multi-agent architectures
Experience at top-tier tech companies (FAANG, equivalent startups, or enterprise AI teams) delivering production-grade AI systems
Proven experience with RAG systems, evaluation design, and improving precision/recall/F1 in real-world deployments
Hands-on experience with LangChain, LlamaIndex, MCP, and orchestration frameworks for multi-agent systems
Expertise in designing evaluation datasets, adversarial tests, and regression suites
Full-Stack Expertise: Strong proficiency in modern frontend frameworks (React, Angular, or Vue) and backend development (Python, Node.js)
Cloud & DevOps: Hands-on experience with AWS/Azure/GCP, container orchestration (Kubernetes), and infrastructure-as-code (Terraform/CDK)
API Design: Ability to build RESTful and GraphQL APIs for AI services
Preferred
Experience in financial modeling (e.g. converting Excel financial models to Python)
Familiarity with compliance frameworks (e.g., SOC 2) and model risk governance
Background in fine-tuning strategies and human-in-the-loop labeling
Startup or entrepreneurial experience
Company
Innovare Strategy Group
We help executive teams scale product, growth, and org strategy — drawing on experience leading product teams at Meta, Microsoft, Reddit, and Yahoo.
2-10 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase