AI Systems Engineer (Model Routing, RAG Optimization), Financial Services jobs in United States
cer-icon
Apply on Employer Site
company-logo

BIP · 3 days ago

AI Systems Engineer (Model Routing, RAG Optimization), Financial Services

positionNYC Metro Area
timeFull-time
remoteHybrid
senioritySenior Level, Lead/Staff
money$120K/yr - $200K/yr
date8+ years exp

BIP is Europe’s fastest growing digital consulting company, expanding its presence in the US with a focus on Financial Services and Capital Markets. They are seeking AI Systems Engineers to support model routing, RAG optimization, and advanced AI workflow orchestration, ensuring reliable and scalable AI offerings across multiple business units.

ConsultingInformation TechnologyLegal
badNo H1Bnote
Hiring Manager
Christopher Morgan
linkedin

Responsibilities

Develop and scale model routing frameworks to efficiently support diverse business unit use cases
Optimize RAG pipelines, including embeddings, retrieval layers, chunking strategies, and latency reduction
Enhance vector database integrations, search performance, and embedding workflows
Build reliable retrieval and inference pathways across on-prem and cloud AI environments
Implement AI-specific testing frameworks and validation harnesses to ensure safety, robustness, and compliance
Support multi-model orchestration, load management, and fallback logic
Collaborate with security and governance teams to enforce enterprise AI standards
Contribute to quick-win initiatives that demonstrate value and platform scalability

Qualification

PythonAI/ML infrastructureVector databasesRAG optimizationAI governanceAzure AIOpenAI APIsGPU workloadsSoft skills

Required

8+ years of engineering experience with Python, plus specialization in AI/ML infrastructure
Direct experience with vector databases (Pinecone, FAISS, Milvus, Vespa, PostgreSQL pgvector)
Strong knowledge of embeddings, LLM pipelines, inference APIs, and RAG patterns
Experience optimizing model latency, throughput, and reliability
Familiarity with Azure AI, OpenAI APIs, or enterprise LLM orchestration
Strong understanding of AI governance, permissioning, and secure deployment

Preferred

Experience with GPU/accelerator-based workloads is a plus

Benefits

Choice of medical, dental, vision insurance.
Voluntary benefits.
Short- and long-term disability.
HSA and FSAs.
Matching 401k.
Discretionary performance bonus.
Employee referral bonus.
Employee assistance program.
11 public holidays.
20 days PTO.
7 Sick Days.
PTO buy and sell program.
Volunteer days.
Paid parental leave.
Remote/hybrid work environment support.

Company

BIP

twittertwittertwitter
Glassdoor4.0
company-logo
BIP is an international consulting company that specializes in business integration services.
dateFounded in 2003
location
Milano, Lombardia, ITA
people-size5001-10000 employees
web-link
https://www.bip-group.com

Funding

Current Stage
Late Stage
Total Funding
$143.71M
2025-06-09Debt Financing· $68.54M
2024-06-13Debt Financing· $75.16M
2021-05-31Acquired

Recent News

ION Analytics
European outbound M&A into Brazil set for boost if trade accord lands – Dealspeak EMEA
2025-10-03
The Indian Express
Exclusive: Amit Shah asks MHA to recommend action on lesser-known messaging apps like Zangi, BiP used by terror groups
2025-09-26
inventure.com.ua
BIP to Develop Ukraine’s First Underground Industrial Park
2025-08-09
Company data provided by crunchbase