Software Engineer, Professional (Gen AI Data Scientist) jobs in United States
cer-icon
Apply on Employer Site
company-logo

Freddie Mac · 2 months ago

Software Engineer, Professional (Gen AI Data Scientist)

Freddie Mac is a leader in making home possible for families across the country, and they are seeking a Software Engineer, Professional - Gen AI (Data) Scientist to lead the development of innovative AI solutions. This role focuses on creating AI Agents and applications that solve complex business problems, requiring expertise in Generative AI and collaboration with cross-functional teams.

FinanceFinancial ServicesRisk Management
check
H1B Sponsor Likelynote

Responsibilities

Design and implement scalable AI Agents, Agentic Workflows and GenAI applications to address diverse and complex business use cases
Evaluate and adapt models such as Claude (Anthropic), Azure OpenAI, and open-source alternatives for business use cases
Train, Fine-tune, optimize and Test lightweight Large Language Models (LLMs) to address diverse and complex business use cases
Design and deploy Retrieval-Augmented Generation (RAG) and Graph RAG systems using vector databases and knowledge bases
Curate enterprise data using connectors integrated with AWS Bedrock's Knowledge Base/Elastic
Implement solutions leveraging MCP (Model Context Protocol) and A2A (Agent-to-Agent) communication
Build and maintain Jupyter-based notebooks using platforms like SageMaker and MLFlow/Kubeflow on Kubernetes (EKS)
Collaborate with cross-functional teams of UI and microservice engineers, designers, and data engineers to build full-stack Gen AI experiences
Integrate GenAI solutions with enterprise platforms via API-based methods and GenAI standardized patterns
Establish and enforce validation procedures with Evaluation Frameworks, bias mitigation, safety protocols, and guardrails for production-ready deployment
Design & build robust ingestion pipelines that extract, chunk, enrich, and anonymize data from PDFs, video, and audio sources for use in LLM-powered workflows—leveraging best practices like semantic chunking and privacy controls
Orchestrate multimodal pipelines using scalable frameworks (e.g., Apache Spark, PySpark) for automated ETL/ELT workflows appropriate for unstructured media
Implement embeddings drives—map media content to vector representations using embedding models, and integrate with vector stores (AWS Knowledge Base/Elastic/Mongo Atlas) to support RAG architectures

Qualification

Generative AI expertiseLarge Language ModelsAWS SageMakerPrompt EngineeringMachine LearningData SciencePython programmingAI governanceAnalytical skillsAPI integrationData managementCollaborationContinuous learning

Required

Bachelor's in data science/computer science with Machine Learning focus, Business Analytics
2-4 years of experience in Data Science, Computer Science with focus on Machine Learning and Business Analytics
Experience training and testing Machine/Deep Learning, Natural Language Models
Proven experience with AI development on AWS SageMaker, Bedrock, ML Flow on EKS
Strong programming skills in Python and ML libraries (Transformers, Lang Chain, etc.)
Deep understanding of Gen AI system patterns and architectural best practices, Evaluation Frameworks
Demonstrated ability to work in cross-functional agile teams
Deep expertise in prompt engineering, fine-tuning, RAG, Graph RAG, vector databases (e.g., AWS Knowledge Base / Elastic), and multi-modal models
Hands-on experience with enterprise AI governance and ethical deployment frameworks
Familiarity with CI/CD practices for ML Ops and scalable inference APIs

Preferred

Advanced studies/degree preferred
At least 2 years in applied Gen AI or LLM-based solutions preferred
Published contributions or patents in AI/ML/LLM domains

Benefits

Freddie Mac offers a comprehensive total rewards package to include competitive compensation and market-leading benefit programs.
This position is eligible to participate in the annual incentive program.

Company

Freddie Mac

company-logo
Freddie Mac is a public government-sponsored enterprise that provides mortgage capital to lenders.

H1B Sponsorship

Freddie Mac has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (181)
2024 (119)
2023 (100)
2022 (134)
2021 (112)
2020 (71)

Funding

Current Stage
Public Company
Total Funding
$3.58B
Key Investors
DLP Capital
2025-12-30Post Ipo Debt· $108.4M
2025-10-28Post Ipo Debt· $343.2M
2025-09-09Post Ipo Debt· $707M

Leadership Team

leader-logo
Dennis G. Hermonstyne
Senior Vice President and Chief Compliance Officer
linkedin
leader-logo
Peter Lillestolen
Vice President - MF Production and Sales, Targeted Affordable Housing
linkedin
Company data provided by crunchbase