PLUM AI · 4 months ago
Senior Data Scientist
PLUM AI is a fintech company empowering financial institutions with AI-driven software. They are seeking a Senior Data Scientist to lead the development of scalable Generative AI pipelines, collaborating across teams to shape the GenAI platform and enhance their products.
FinanceFinancial ServicesFinTechReal Estate
Responsibilities
Design and architect end-to-end Generative AI pipelines using LLMs to process and generate context-aware results
Integrate open-source and proprietary LLMs (e.g., GPT, LLaMA) via APIs and custom orchestration
Build and optimize workflows using frameworks such as LangChain
Design and implement RAG (Retrieval-Augmented Generation) architecture to inject relevant, contextual data into generation prompts
Develop robust methods to evaluate and compare LLM outputs based on relevance, personalization, and factual accuracy
Build automated and scalable LLM evaluation pipelines using embedding-based similarity, scoring metrics, and human-in-the-loop feedback
Implement monitoring, observability, and logging for GenAI workflows to ensure reliability in production
Collaborate with cross-functional teams to integrate generative outputs into client-facing applications
Qualification
Required
Master's degree in Computer Science, Engineering, Physics, or a related technical field or equivalent work experience
3+ years of experience developing and deploying machine learning pipelines in production
1+ years of experience building Generative AI or LLM-based applications
Strong programming skills in Python, with hands-on experience in ML/AI frameworks (e.g., LangChain, Transformers, LLM APIs)
Deep understanding of LLM evaluation, prompt engineering, and text generation quality metrics
Experience designing and implementing RAG architectures
Hands-on experience with Databricks, MLflow, or similar platforms
Experience with cloud infrastructure (AWS preferred) and MLOps practices for deploying and maintaining models in production
Strong problem-solving skills and ability to lead through ambiguity
Excellent communication and documentation habits
Preferred
Prior experience using Generative AI in Fintech, Sales Tech, or Marketing Tech domains
Experience with agentic frameworks such as LangGraph, AutoGPT, or CrewAI
Familiarity with fine-tuning or custom instruction tuning of LLMs
Understanding of data privacy and compliance implications when working with client data and GenAI systems
Benefits
A fast-paced, collaborative startup culture with high visibility
Autonomy, flexibility, and a flat corporate structure that gives you the opportunity for your direct input to be realized and put into action.
Opportunity to make a meaningful impact in building a company and culture.
Equity in a financial technology startup.
Generous health, dental, and vision coverage for employees and family members + 401K
Eleven paid holidays and unlimited discretionary vacation days
Competitive compensation and bonus potential
Company
PLUM AI
Formed in 2015, Plum Lending is revolutionizing commercial real estate lending, combining the world of data science with traditional lending.