Wells Fargo · 7 hours ago
Principle Engineer - GPU and LLM Infrastructure
CONCORD, CA
Full-time
Hybrid
Senior Level, Lead/Staff
$159K/yr - $305K/yr
7+ years expWells Fargo is seeking a Principal Engineer – GPU & LLM Infrastructure to lead the end-to-end strategy and operations of their enterprise GPU platforms within the AI Capability Engineering group. The role involves designing GPU architecture, guiding POCs through production readiness, and ensuring the security and scalability of GenAI platforms for enterprise-grade AI workloads.
BankingFinancial ServicesFinTechInsurancePayments
No H1B
Responsibilities
Act as an advisor to leadership to develop or influence GPU buildout for highly complex business and technical needs across multiple groups
Lead the strategy and resolution of highly complex and unique challenges requiring in-depth evaluation across multiple areas or the enterprise, delivering solutions that are long-term, large-scale and require vision, creativity, innovation, advanced analytical and inductive thinking
Translate advanced technology experience, an in-depth knowledge of the organizations tactical and strategic business objectives, the enterprise technological environment, the organization structure, and strategic technological opportunities and requirements into technical engineering solutions
Provide vision, direction and expertise to leadership on implementing innovative and significant business solutions
Maintain knowledge of industry best practices and new technologies and recommends innovations that enhance operations or provide a competitive advantage to the organization
Strategically engage with all levels of professionals and managers across the enterprise and serve as an expert advisor to leadership
Design and implement GPU cluster topologies (H100/H200, NVLink/NVSwitch), networking, and storage paths for high-throughput inferencing; publish sizing and performance baselines
Qualification
Required
7+ years of Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
Preferred
1+ years of experience with NVIDIA GPU and CUDA ecosystems, including CUDA, cuDNN, NVLink/NVSwitch, MIG, NCCL, GPU profilers, and performance tuning for H100/H200 architectures
1+ years of experience with LLM/SLM runtimes, such as vLLM, TensorRT‑LLM, and Triton; hands-on work with model quantization (FP8, INT4 AWQ/GPTQ), KV‑cache optimization strategies, and disaggregated prefill/decode pipelines
1+ years of experience in orchestration and GPU workload management, including GPU resource managers (collections/departments/projects/workloads), OCP/GKE administration, quota management, preemption and fair‑share enforcement, GPU scheduling and timeslicing, Helm/Kustomize, upgrade validation, and admission controls
1+ years of experience with API and gateway platforms, including Apigee authentication/authorization, quota and rate-limit configuration, OpenAPI specifications, SDK generation, SLA operations, and API versioning/deprecation workflows
1+ years of experience in observability and evaluation tooling, including Arize‑like systems for tracing and evaluations, SLO development, alerting design, retention/export workflows, and dashboard creation
1+ years of experience in performance engineering, including throughput and latency modeling (token/sec, batch shaping, cache policies) and cost/performance optimization strategies for LLM/SLM workloads
Benefits
Health benefits
401(k) Plan
Paid time off
Disability benefits
Life insurance, critical illness insurance, and accident insurance
Parental leave
Critical caregiving leave
Discounts and savings
Commuter benefits
Tuition reimbursement
Scholarships for dependent children
Adoption reimbursement
Company
Wells Fargo
Wells Fargo & Company is a financial services firm that provides banking, insurance, investments, and mortgage services.
10001+ employees
Funding
Current Stage
Public CompanyTotal Funding
unknown1978-10-06IPO
Leadership Team
Charlie Scharf
CEO
Fernando Rivas
CEO of Corporate & Investment Banking
Recent News
2026-01-23
Business – Latest Financial & Stock Market News | New York Post
2026-01-22
Company data provided by crunchbase