Apply on Employer Site

Franklin Templeton · 3 days ago

Senior AI Engineer

New York, NY

Full-time

Hybrid

Senior Level

$170K/yr - $230K/yr

7+ years exp

Franklin Templeton is a leading global equity manager with over $180 billion in assets under management. They seek a Senior AI Engineer to design, build, and productionize AI systems that improve investment and enterprise workflows.

Financial ServicesHedge FundsProfessional ServicesWealth Management

H1B Sponsor Likely

Responsibilities

Ship AI features and internal applications from discovery to POC to production with clear success criteria and telemetry

Architect LLM solutions including retrieval augmented generation, tool use, agentic flows, and structured output pipelines

Integrate and govern ChatGPT Enterprise, Perplexity Enterprise, and Wand.ai. Implement SSO and SCIM, usage analytics, cost controls, and data scoping

Own build versus buy. Run vendor pilots, compare to internal builds, quantify TCO, lock in risk, compliance posture, and speed to value. Present recommendations and rollout plans

Implement LLMOps. Version prompts and configs, stand up evaluation datasets and harnesses, run offline and online tests, monitor latency, quality, safety, and cost, and maintain rollback strategies

Engineer reliable retrieval over access-controlled content. Design chunking, embeddings, reranking, and output validation aligned to entitlements, PII, retention, and audit needs

Convert low code prototypes into maintainable services where appropriate. Keep core logic in tested code with APIs, workers, and queues

Partner with stakeholders to frame problems, map processes, and quantify ROI. Produce concise design docs, run demos, and publish runbooks

Collaborate with security, risk, and compliance to define guardrails, incident playbooks, and monitoring for prompt injection and data leakage

Coordinate with developers, QA, and UAT to move solutions through environments with CI and automated checks

Qualification

LLM engineeringPythonAzureAPIsData engineeringEnterprise AI integrationCommunicationTypeScriptSQLMicrosoft ecosystemFrontend developmentOrchestration tools

Required

7 to 10 years in software or ML engineering shipping production systems, including 2 or more years building with LLMs in production

Strong coding in Python or TypeScript. Experience with APIs, workers, queues, and event driven services

Proven integrations with enterprise AI platforms. Expertise in SSO, SCIM, tenant isolation, data scoping, usage analytics, and cost management

LLM solution patterns. Retrieval design, chunking, embeddings, reranking, tool calling, structured output validation, and evaluation

Azure fluency. Azure OpenAI, Copilot Studio, App Services or AKS, identity and access, Key Vault, storage, networking basics

Data skills. SQL and pragmatic data engineering for operational systems

Excellent communication. Ability to run discovery, write sharp specs, and present tradeoffs to senior stakeholders

Preferred

Asset management or broader financial services experience

Microsoft ecosystem experience. Power Platform, Copilot Studio, Graph, Teams, SharePoint

Vector databases such as Azure AI Search, Redis, Pinecone, or pgvector

Orchestration tools such as Semantic Kernel, LangChain, guidance libraries, or simple custom state machines

Frontend for internal tools. React or Power Apps

Familiarity with process mining and business process optimization

Benefits

Health, wellness and risk benefits to protect employees and their families

Retirement savings, stock purchase and other incentive programs to help employees plan for the future

Holiday, paid-time-off and other employee programs that support work-life balance

Support for pursuing certifications, external education and degree programs

Learning, development and career advancement opportunities

Ways to get involved in, and give back to, our communities, including paid time off for volunteering and charitable donation matching

Company

Franklin Templeton

Glassdoor3.9

Franklin Templeton is a investment firm that offers mutual funds for individuals and institutions.

Founded in 1947

San Mateo, California, USA

5001-10000 employees

http://www.franklintempleton.com

H1B Sponsorship

Franklin Templeton has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (1)