(USA) Staff, Data Assurance Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Walmart Canada · 2 days ago

(USA) Staff, Data Assurance Engineer

Walmart Inc. is seeking a skilled Data Engineer to design, develop, and maintain data pipelines for processing and analyzing large-scale datasets. This role will focus on orchestrating data workflows in a containerized environment, primarily using Python, to build scalable ETL solutions and support analytics and decision-making for the cybersecurity team.

DeliveryRetailShopping

Responsibilities

You will design, develop, and maintain scalable data pipelines to process and analyze log data, leveraging workflow orchestration tools in a containerized environment
Using your advanced expertise in Python and SQL, you will build and optimize ETL processes for efficient log parsing, transformation, and storage
You will work with distributed computing frameworks; integrate with both on-prem, and cloud infrastructure to support high-volume data ingestion
Additionally, you will work closely with data scientists, security analysts, and engineers to provide clean, structured data that supports analytics and decision-making
You will have the opportunity to protect the data of millions of customers, associates, and Walmart’s ever-expanding infrastructure across the globe

Qualification

PythonSQLETL processesData modelingCI/CD pipelinesDistributed computingData workflow orchestrationGitHubMachine learning conceptsTechnical documentation

Required

Advanced SQL knowledge and experience working with relational and NoSQL databases
Strong programming skills in Python for data processing and analytics
Experience with data modeling, data integration, and ETL processes
Experience with CI/CD (Continuous Integration/Continuous Deployment) pipelines
Proficiency in working with large-scale data sets and distributed computing platform like Kubernetes
Familiarity with the use of GitHub for collaborative code management, tracking changes, and code review
Proficiency in writing comprehensive technical documentation
Experience with data workflow orchestration (e.g., Apache Airflow, Argo Workflows)

Preferred

Experience with machine learning and data science concepts is a plus

Benefits

Competitive pay
Performance-based bonus awards
Medical, vision and dental coverage
401(k)
Stock purchase
Company-paid life insurance
PTO (including sick leave)
Parental leave
Family care leave
Bereavement
Jury duty
Voting
Short-term and long-term disability
Company discounts
Military Leave Pay
Adoption and surrogacy expense reimbursement
Live Better U is a Walmart-paid education benefit program

Company

Walmart Canada

company-logo
Walmart Canada is a subsidiary of Walmart that operates a chain of more than 400 stores nationwide. It is a sub-organization of Walmart.