(USA) Senior Manager, Data Engineering jobs in United States
cer-icon
Apply on Employer Site
company-logo

Walmart Canada · 9 hours ago

(USA) Senior Manager, Data Engineering

Walmart Canada is a part of Walmart Inc., one of the world's largest retailers. They are seeking a Senior Engineering Manager for Agentic Data to lead the evolution of their data ecosystem into a Semantic & Contextual Layer, enabling AI agents to operate autonomously. The role involves architecting data pipelines, managing a team, and ensuring data engineering excellence to support AI-driven initiatives.

DeliveryRetailShopping

Responsibilities

Architect the Semantic Future: Define the technical vision for a unified semantic layer that transforms structured, semi-structured, and unstructured data into context-aware representations (Embeddings, Knowledge Graphs, and Metadata) consumable by LLMs and multi-agent workflows
Real-Time Agentic Intelligence: Own the streaming architecture that feeds our agents. You will leverage Kafka to build low-latency event-driven pipelines, ensuring agents have access to "up-to-the-second" member context and environmental state
Champion Data Fundamentals: Ensure the bedrock of our AI strategy is built on elite Data Engineering principles. You will oversee the design of scalable schemas, partitioning strategies, and high-performance indexing that make petabyte-scale data accessible to reasoning models
Build Agent-Ready Ecosystems: Lead the design of "Agentic Data" pipelines—ensuring that data provided to AI agents is high-fidelity, optimized for retrieval, and enriched with the necessary business logic to prevent hallucinations
Strategic Leadership: Manage and mentor a high-performing team of engineers. You will bridge the gap between AI/ML Research, Product, and Platform Engineering to align data roadmaps with long-term autonomous decision-making goals
Innovate Retrieval Systems: Own the strategy for Retrieval-Augmented Generation (RAG) at scale, optimizing how our agents discover and interact with Sam's Club’s vast proprietary knowledge base across both batch and streaming sources
Establish Operational Excellence: Define standards for "Agentic Observability"—implementing telemetry, lineage, and auditability patterns specifically for autonomous and regulated AI workflows

Qualification

Data EngineeringKafkaCloud PlatformsData ModelingAI/ML IntegrationPythonJavaScalaLeadershipTeam ManagementCommunicationProblem Solving

Required

Bachelor's degree in Computer Science and 5 years' experience in software engineering or related field
7 years' experience in software engineering or related field
Master's degree in Computer Science and 3 years' experience in software engineering or related field
4 years' experience in data engineering, database engineering, business intelligence, or business analytics
1 year's supervisory experience
7–10+ years in Data Engineering, building and operating large-scale, distributed, fault-tolerant data platforms, with at least 3+ years in a leadership role
Deep-rooted expertise in Data Fundamentals
Expert in data modeling (Star/Snowflake, Data Vault), storage formats (Parquet, Avro), and distributed computing concepts (sharding, replication, and CAP theorem)
Deep experience with Kafka and event-driven architectures
Understanding of how to manage state, schema evolution, and consistency in streaming environments (Kafka Streams, Flink, or Spark Streaming)
Deep familiarity with the modern AI stack—specifically Vector Databases (Pinecone, Milvus), Knowledge Graphs, and framework orchestration (LangChain, LlamaIndex, CrewAI)
Proven track record in GCP or Azure, utilizing BigQuery, Dataflow, and Pub/Sub to handle petabyte-scale workloads
Expert-level understanding of how schema choices, latency, and context window management impact AI reasoning and retrieval quality
Fluency in Python, Java, or Scala, with a deep engineering mindset around testability, maintainability, and high-performance system design

Preferred

Data engineering, database engineering, business intelligence, or business analytics, ETL tools and working with large data sets in the cloud
Master's degree in Computer Science or related field and 5 years' experience in software engineering or related field
Background in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly
Knowledge of accessibility best practices and Walmart's accessibility standards and guidelines for supporting an inclusive culture

Benefits

Incentive awards for your performance
401(k) match
Stock purchase plan
Paid maternity and parental leave
PTO
Multiple health plans
Medical, vision and dental coverage
Company-paid life insurance
Paid time off benefits including sick leave, parental leave, family care leave, bereavement, jury duty, and voting
Short-term and long-term disability
Company discounts
Military Leave Pay
Adoption and surrogacy expense reimbursement
Live Better U is a Walmart-paid education benefit program for full-time and part-time associates in Walmart and Sam's Club facilities

Company

Walmart Canada

company-logo
Walmart Canada is a subsidiary of Walmart that operates a chain of more than 400 stores nationwide. It is a sub-organization of Walmart.