Galent · 1 day ago
Gen AI Architect
Jersey City, NJ
Full-time
Onsite
Senior Level, Lead/Staff
10+ years expGalent is seeking a Gen AI Architect to lead the architecture and development of enterprise web applications that integrate Generative AI. The role involves defining scalable architectural patterns and ensuring production readiness while collaborating with various teams to align business and technical goals.
Computer Software
Hiring Manager
Manish Kumar
Responsibilities
Lead architecture and development of enterprise web applications with integrated Generative AI
Define scalable, secure architectural patterns and implementation standards
Work closely with product, AI/ML, DevOps, security, and network teams to align business and technical goals
Drive full-stack development best practices across backend, frontend, and infrastructure
Architect and integrate LLMs, embeddings, RAG pipelines, and vector databases into production systems
Ensure production readiness—security, networking, monitoring, performance, and compliance
Qualification
Required
10+ years in ML/Engineering
At least 5 years in architecture roles
Proven experience delivering production-grade solutions on Azure
Hands-on ownership of end-to-end application lifecycle—from design to deployment
Deep experience designing cloud-native, microservices and event-driven architectures
Expertise with Azure App Services, AKS, Functions, API Management, Event Grid, Service Bus, Storage, and Key Vault
Strong understanding of subscription design, resource hierarchy, and environment isolation
Hands-on experience with VNETs, subnets, private endpoints, service endpoints
Hands-on experience with NSGs, ASGs, routing, firewalls, and VPN/ExpressRoute connectivity
Hands-on experience with whitelisting, IP restrictions, certificates, TLS, and enterprise-grade authentication flows
Experience implementing Zero Trust, RBAC, managed identities, and secure secrets handling
Expertise in caching (Redis/CDN), async processing (RabbitMQ/Kafka), load balancing, auto-scaling, and performance tuning
Hands-on experience with Azure OpenAI, RAG patterns, embeddings, prompt engineering, vector search (Azure AI Search, PostgreSQL extensions)
Experience orchestrating LLM pipelines in real-world production environments
Strong REST API design (versioning, throttling, API gateways)
Expert in PostgreSQL/MongoDB, data modeling, query optimization
Experience with OAuth2, SSO, and secure coding aligned to GDPR/SOC2
Preferred
Preference from Finance industry
Company
Galent
Galent is an AI-native digital engineering firm at the forefront of the AI revolution, dedicated to delivering unified, enterprise-ready AI solutions that transform businesses and industries.
501-1000 employees
Funding
Current Stage
Late StageCompany data provided by crunchbase