Evinova ยท 1 day ago
Generative AI Cloud Operations Engineer - Evinova
Evinova, a global health tech business under AstraZeneca, is focused on transforming patient care through technology and innovation. The Generative AI Cloud Operations Engineer will lead the development and management of AI operations systems for clinical trial optimization, collaborating closely with AI Engineers to transition projects into production-grade capabilities.
AppsArtificial Intelligence (AI)Health CareSaaSSoftwareTask Management
Responsibilities
Drive the creation of proactive capability and process enhancements that ensures enduring value creation and analytic compounding interest
Design and implement resilient cloud Genereative AI agent operational capabilities to maximize our system A-bilities (Learnability, Flexibility, Extendibility, Interoperability, Scalability)
Drive precision and systemic cost efficiency, optimized system performance, and risk mitigation with a data-driven strategy, comprehensive analytics, and predictive capabilities at the tree-and-forest level of our Generative AI-based systems, workloads and processes
Develop and manage GenAI Ops systems for clinical trial design, planning and operational optimization
Integrate LLM proxies/routers including LiteLLM Proxy/Router or other solutions
Ensure proper RAG pipeline optimization and scaling
Integration of token usage, latency, response quality, and hallucination detection tools at a platform level
Partner closely with AI Engineers and data scientists to shepherd projects from embryonic research stages into production-grade agentic Generative AI capabilities
Leverage and teach modern tools, libraries, frameworks and best practices to design, validate, deploy and monitor Generative AI agents in production (including LangChain, LangGraph, Google ADK, Langfuse, DSPy, Arize Phoenix, Pinecone, Weaviate, Splunk, Grafana, Prometheus, Xray, and more)
Enhance system scalability, reliability, and performance through effective infrastructure and process management
Ensure that any prediction we make is backed by deep exploratory data analysis and evidence, interpretable, explainable, safe, and actionable
Leverage Vertex AI, Azure Foundry, OpenAI, Anthropic, and other foundation model platforms to provide reliable and stable access to LLMs
Qualification
Required
HS Diploma or GED
Minimum of 2 years deploying and maintaining Generative AI agents or GenAI-based workflows/applications in production
Deep understanding of challenges in deploying Generative AI applications and agents
Closely follows frontier developments in Generative AI and GenAI tooling, techniques, and technologies
Deep understanding of the Data Science Lifecycle (DSLC) and the ability to shepherd data science projects from inception to production within the platform architecture
Expert in evals tools for LLMs using tools such as Arize Phoenix, Langfuse, Braintrust, Freeplay, or similar
Expert in CDK for python and/or TypeScript
Strong software engineering abilities in Python/TypeScript
Expert in AWS services and containerization technologies like Docker and Kubernetes
Experience deploying GenAI agents using frameworks such as LangChain, LangGraph, LlamaIndex, Google ADK, or Strands Agents
Ability to collaborate effectively with engineering, design, product, and science teams
Strong written and verbal communication skills for reporting and documentation
Proven track record of deploying algorithms and machine learning models into production environments
Demonstrated ability to work closely with cross-functional teams, particularly data scientists
Benefits
Short-term incentive bonus opportunity
Equity-based long-term incentive program (salaried roles)
Retirement contribution (hourly roles)
Commission payment eligibility (sales roles)
Qualified retirement program [401(k) plan]
Paid vacation and holidays
Paid leaves
Health benefits including medical, prescription drug, dental, and vision coverage
Company
Evinova
Evinova delivers digital tools for clinical trials, including patient apps, site portals, eConsent, eCOA, telemedicine, and data integration
H1B Sponsorship
Evinova has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
Funding
Current Stage
Growth StageRecent News
Company data provided by crunchbase