Apply on Employer Site

interface.ai · 2 days ago

Staff Core AI Engineer - LLM expert

San Francisco / Palo Alto (In-Office)

Full-time

Onsite

Senior Level, Lead/Staff

$200K/yr - $240K/yr

2+ years exp

Interface.ai is a company focused on reimagining banking through innovative AI solutions. They are seeking a Staff Core AI Engineer with expertise in LLMs to design and scale intelligent automation systems for financial institutions, ensuring compliance and security while driving innovation in AI technologies.

Enterprise SoftwareFinTech

H1B Sponsor Likely

Responsibilities

Model Evolution: Building fine-tuning pipelines, exploring open-weight models, and benchmarking their performance against proprietary LLMs

Inference Optimization: Driving high-throughput, low-latency inference strategies across GPUs, TPUs, and distributed inference clusters

Safety & Guardrails: Designing data-safe pipelines with encryption for model I/O, and implementing automated PII detection and masking at both prompt and response layers

RL-Based Learning: Applying Reinforcement Learning (RLHF/RLAIF), reward modeling, and policy optimization to continuously improve model performance

Speech-to-Speech and Multimodal AI: Exploring speech model architectures (ASR/TTS) and building adaptive pipelines for natural, real-time conversational intelligence

POCs & Experimentation: Rapidly prototyping emerging models, toolchains, and optimization methods to maintain a competitive edge

Framework Leadership: Collaborating with research and backend teams to evolve our custom AI orchestration layer — combining multiple specialized models, memory systems, and evaluation tools

Lead Fine-Tuning and Experimentation: Create fine-tuning workflows using LoRA, PEFT, and instruction-tuning pipelines; manage large-scale training datasets

Drive Auto-Prompt Optimization: Build self-evolving prompt evaluation loops using reinforcement learning, reward modeling, and continuous evaluation frameworks

Accelerate Inference Throughput: Optimize model inference through quantization, batching, caching, and high-performance serving strategies

Implement Encrypted Inference: Develop novel encryption and key management techniques for model-level data protection during inferencing

Design Guardrail Systems: Implement policy layers that enforce safety, prevent hallucinations, and ensure compliance (SOC2, GDPR)

Integrate Speech Models: Develop and optimize speech-to-speech pipelines, managing end-to-end latency, transcription accuracy, and model adaptation

Run Advanced Evals: Establish evaluation harnesses that measure factual accuracy, latency, cost-efficiency, and safety compliance in production environments

Research and Publish: Explore the latest advancements in open-source LLMs and reinforcement learning for agents, driving our internal AI innovation roadmap

Qualification

LLM ExpertiseReinforcement LearningInference EngineeringData Security in AIModern AI ToolingPrompt OptimizationSpeech-to-Speech ModelsAI Evaluation FrameworksFinancial Data ComplianceOpen-source Contributions

Required

Strong LLM Expertise: 2+ years of experience working directly with transformer architectures and LLM fine-tuning (e.g., Llama, Mistral, GPT, Mixtral, Gemma, Falcon, Claude)

Applied Reinforcement Learning: Hands-on experience with RLHF/RLAIF, reward modeling, and multi-objective optimization for generative models

Prompt Optimization & Evaluation: Deep knowledge of auto-prompting, chain-of-thought evaluation, and self-improving agent loops

Inference Engineering: Experience improving throughput, quantization, and token efficiency on GPUs or specialized inference hardware

Data Security in AI: Knowledge of PII masking, data encryption, and secure model pipelines in production settings

Modern AI Tooling: Experience with frameworks such as PyTorch, Transformers, Deep Speed, Hugging Face, LangChain, or vLLM

Preferred

Experience with speech-to-speech or multimodal models (ASR, TTS, embeddings)

Understanding of AI evaluation frameworks (e.g., Evals, Llama Index Benchmarks, or custom metrics)

Familiarity with financial data compliance and AI observability tools

Exposure to low-level inference optimization (CUDA kernels, model parallelism)

Contributions to open-source LLM or RL research projects

Benefits

100% paid health, dental & vision care

401(k) match & financial wellness perks

Discretionary PTO + paid parental leave

Mental health, wellness & family benefits

Company

interface.ai

Glassdoor3.2

interface.ai is an award-winning out-of-the-box Intelligent Virtual Assistant(IVA) for Banks & Credit Unions.

Founded in 2019

San Francisco, California, USA

51-200 employees

https://interface.ai

H1B Sponsorship

interface.ai has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (3)