Be an early applicantLess than 25 applicants

Company

Original Job Post

Visa · 2 days ago

Manager, Data Engineering

Foster City, CA

Full-time

Hybrid

Mid, Senior Level

$119K/yr - $192K/yr

5+ years exp

Wonder how qualified you are to the job?

Maximize your interview chances

BankingFinance

Actively Hiring

Comp. & Benefits

Insider Connection @Visa

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Establish data processes and automations, based upon business and technology requirements, leveraging Visa’s supported data platforms and tools

Deliver small to large data engineering projects either individually or as part of a project team

Develop and maintain data models and schema designs for efficient data storage and retrieval, with a strong understanding of best practices in data modeling and data architecture

Design and implement data pipelines to extract, transform, and load data from various sources into the data warehouse, with a strong focus on reusability, performance, scalability and cost efficiency

Collaborate with cross-functional teams to understand data requirements and ensure data quality, with a focus on implementing data validation and data quality checks at various stages of the pipeline

Provide expertise in data warehousing, ETL, and data modeling to support data-driven decision making, with a strong understanding of best practices in data pipeline design and performance optimization

Extract and manipulate large datasets using standard tools such as Hadoop (Hive), SQL, Spark, Python (pandas, NumPy) and Presto

Provide ongoing production support for monthly Scorecard publishing and TRUTH dashboard updates

Communicate complex concepts in a clear and effective manner

Stay up-to-date with the latest data engineering trends and technologies to ensure the company's data infrastructure is always state-of-the-art and following best practices

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

SQLPythonRelational DatabasesData EngineeringData WarehousingETLData ModelingData ArchitectureData GovernanceData ValidationData Quality ChecksSparkScheduling ToolsData DictionariesData Validation AlertsData PipelinesVisualization SoftwareTableauPowerBIProblem-SolvingEffective CommunicationAttention to DetailTeam Player

Required

5 or more years of relevant work experience with a Bachelors Degree or at least 2 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 0 years of work experience with a PhD

Preferred

6+ years of analytics experience with a focus on data engineering

Strong experience with SQL, Python, and relational databases

Advanced knowledge of SQL (e.g., understands subqueries, self-joining tables, stored procedures, can read an execution plan, sql tuning, etc.)

Solid understanding of best practices in data warehousing, ETL, data modeling, and data architecture.

Strong understanding of best practices in data governance, data validation and data quality checks

Experience in Python, Spark, and exposure to scheduling tools like Tuber/Airflow is preferred.

Able to create data dictionaries, setup and monitor data validation alerts, and execute periodic jobs to maintain data pipelines for completed projects

Experience with visualization software (e.g., Tableau, PowerBI) is a plus.

Strong problem-solving and analytical skills

Effective communicator of statuses, issues, and risks

Extremely high sense of quality standards and attention to detail

A team player and collaborator, able to work well with a diverse group of individuals in a matrixed environment