Senior RAG Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Wipfli · 7 hours ago

Senior RAG Engineer

Wipfli is building the next generation of AI‑powered solutions that transform how our professionals deliver value to clients. As a Senior RAG Engineer, you will play a pivotal role in advancing our AI‑driven functional requirements documentation platform, an enterprise application used across the firm to automate the creation of complex project documentation.

AccountingConsultingInformation Technology
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Design, develop, and optimize full‑stack applications using RAG for high‑accuracy retrieval and generation
Build and maintain APIs and microservices with monitoring and logging for reliability and performance
Implement vector databases and semantic search; fine‑tune retrieval for strong precision and recall
Optimize chunking, embeddings, and retrieval parameters tailored to professional services content
Evaluate LLM architectures and maintain prompt‑engineering frameworks to improve response quality
Build ETL pipelines and integrate with firm platforms such as document management, CRM, and engagement systems
Ensure data quality, security, and compliance, including role‑based access, encryption, audit logging, and confidentiality
Partner across teams—engagement, data science, and ML—to deliver capabilities and mentor junior engineers
Stay current on emerging AI/ML technologies and assess applicability to enterprise use cases

Qualification

RAG methodologiesAI applications developmentFull stack developmentDocument processingMachine learningTeam collaborationMentoringCommunication

Required

Bachelor's degree in Computer Science, Information Management, Data Science, or AI related field
3-5 years of experience in data science and AI roles
7-10 years of experience software development roles
Demonstrated track record of building production-grade AI applications from conception to deployment
Demonstrated deep understanding of RAG methodologies and practical application. Experience with frameworks such as LangChain, LlamaIndex, or Haystack is considered an additional asset
Experience with document processing and OCR technologies, including integration and deployment within enterprise environments

Preferred

Master's degree or advanced certification in Data Science or AI
4+ years of full stack development experience with modern frameworks (React, Vue, or Angular; Node.js, Python, or similar; .NET experience)

Benefits

8 health plan options (both HMO & PPO plans)
Dental and vision coverage
Opportunity to enroll in HSA with potential Firm contribution
Employee Assistance Program
Firm-sponsored basic life and short and long-term disability coverage
A 401(k) savings plan & profit share as well as Firm matching contribution
Well-being incentive
Education & certification assistance
Flexible time off
Family care leave
Parental leave
Family formation benefits
Cell phone reimbursement
Travel rewards
Critical illness & accident insurance
Hospital indemnity insurance
Legal
Long-term care
Pet insurance
ID theft protection
Supplemental life/AD&D

Company

Wipfli LLP is one of the top 20 accounting and consulting firms.

H1B Sponsorship

Wipfli has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (5)
2024 (3)
2023 (5)
2022 (6)
2021 (7)
2020 (6)

Funding

Current Stage
Late Stage
Total Funding
unknown
Key Investors
New Mountain Capital
2025-08-01Private Equity

Leadership Team

leader-logo
Ryan Risley
Partner and Chief Technology Officer - Business Solutions Group
linkedin
leader-logo
Jeff Greeneway
Retired
linkedin
Company data provided by crunchbase