Upstart · 5 hours ago
Senior Software Engineer, AI Platform
United States
Full-time
Remote
Senior Level
$164K/yr - $226K/yr
6+ years expUpstart is the leading AI lending marketplace partnering with banks and credit unions to expand access to affordable credit. As a Senior Software Engineer on Upstart's Core GenAI Platform team, you will help design and build a unified interface for securely interacting with large language models, enabling engineers to use best-in-class LLMs through clean APIs and intuitive tooling.
Artificial Intelligence (AI)AutomotiveConsumer LendingCreditFinancial ServicesFinTechLendingMachine LearningPersonal Finance
Responsibilities
Build the Core GenAI platform powering generative AI use cases across all of Upstart Engineering
Design and implement reliable, observable infrastructure for model inference, prompt orchestration, and data workflows
Drive cross-functional adoption of AI tooling by delivering reusable components and intuitive interfaces
Increase developer productivity through automation, metrics dashboards, and streamlined GenAI integrations
Set the technical roadmap for platform capabilities, balancing innovation with reliability and compliance
Partner with ML researchers, product engineers, and design to bridge experimentation and production
Ensure the platform adheres to emerging standards of security, fairness, and explainability for LLM systems
Qualification
Required
6+ years of experience in object-oriented software engineering, with a strong systems engineering background
Proven experience independently leading impactful, cross-functional, multi-quarter projects with mid-large teams
Proficiency in backend development with Python (leveraging frameworks like FastAPI, Flask, or similar), microservices architecture, and infrastructure tools like Kubernetes, Docker, and Terraform
Hands-on experience building ML platforms or infrastructure supporting LLMs or inference systems
Familiarity with observability tools (e.g., Prometheus, Grafana, Datadog) and data processing pipelines
Strong written and verbal communication skills and a collaborative approach to cross-functional work
Strong stakeholder management skills
Preferred
Full Stack development skills including hands on experience with React or similar
Proficiency with Kotlin or Java and the Spring framework ecosystem
Experience with LLM toolchains such as LangChain, LlamaIndex, or OpenAI APIs
Deep understanding of model inference optimization (e.g., quantization, ONNX, streaming)
Exposure to retrieval-augmented generation (RAG), vector databases (e.g., FAISS, Pinecone), or prompt engineering
Experience operationalizing LLMs in production, including latency management and prompt versioning
Ability to influence platform direction and drive alignment across multiple engineering teams
Awareness of LLM-specific risk domains, including hallucinations, fairness, and data privacy
Benefits
Comprehensive medical, dental, and vision coverage with Health Savings Account contributions from Upstart
Generous 401(k) plan with Upstart matching $2 for every $1 contributed, up to $15,000 per year
Employee Stock Purchase Plan (ESPP)
Life and disability insurance
Generous holiday, vacation, sick and safety leave
Supportive parental, family care, and military leave programs
Annual wellness, technology & ergonomic reimbursement programs
Social activities including team events and onsites, all-company updates, employee resource groups (ERGs), and other interest groups such as book clubs, fitness, investing, and volunteering
Catered lunches + snacks & drinks when working in offices
Company
Upstart
Upstart (NASDAQ: UPST) is a leading AI lending marketplace partnering with banks and credit unions to expand access to affordable credit.
1001-5000 employees
H1B Sponsorship
Upstart has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (68)
2024 (67)
2023 (85)
2022 (85)
2021 (42)
2020 (15)
Funding
Current Stage
Public CompanyTotal Funding
$3.36BKey Investors
CastlelakeProgressiveRakuten
2025-11-06Post Ipo Debt· $1.5B
2025-09-05Post Ipo Debt· $320M
2025-08-12Post Ipo Debt· $600M
Leadership Team
Dave Girouard
Founder & CEO
Paul Gu
Co-Founder
Recent News
The Motley Fool
2026-01-03
The Motley Fool
2026-01-01
2025-12-17
Company data provided by crunchbase