Principal Data Engineering Lead jobs in United States
cer-icon
Apply on Employer Site
company-logo

Visa · 14 hours ago

Principal Data Engineering Lead

Visa is a world leader in payments technology, facilitating transactions globally. The Principal Data Engineering Lead is responsible for guiding the design and optimization of Visa’s data platforms while mentoring teams and driving best practices in data engineering.

BankingFinanceFinancial ServicesInformation TechnologyMobile PaymentsPayments
check
Comp. & Benefits
check
H1B Sponsor Likelynote

Responsibilities

Lead the architecture and delivery of large-scale, high-performance data pipelines and processing frameworks across Hadoop and multi-cloud environments
Design scalable data models, lakehouse structures, and distributed data processing solutions that support analytics, machine learning, and real-time data needs
Provide technical leadership to Senior and Staff Data Engineers, conducting design reviews, guiding implementation decisions, and ensuring engineering excellence
Partner with cross-functional teams to translate business and product requirements into robust technical designs and data solutions
Develop and improve engineering best practices for data governance, quality, observability, testing, and cloud resource optimization
Drive adoption of cloud-native data technologies, automation frameworks, and reusable components that improve development velocity and system reliability
Lead complex data modernization efforts, including cloud migration, data lake/lakehouse consolidation, and performance optimization of critical pipelines
Evaluate new tools and technologies, influencing platform evolution within the scope of assigned domains or product areas
Collaborate with product, analytics, and platform teams to ensure alignment on data strategy and architectural roadmaps
Mentor engineers at all levels, providing technical coaching and fostering a culture of continuous improvement

Qualification

HadoopSparkCloud data solutionsData modelingPySparkScalaPythonSQLDatabricksProblem-solvingTechnical leadershipMentoring

Required

10+ years of relevant work experience with a Bachelor's Degree or at least 7 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 4 years of work experience with a PhD, OR 13+ years of relevant work experience

Preferred

12 or more years of relevant work experience with a Bachelor's Degree or at least 7 or more years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 4 years of work experience with a PhD, OR 13 or more years of relevant work experience
Advanced expertise in building and optimizing large-scale distributed data systems using Hadoop, Spark, and modern lakehouse architectures
Strong programming proficiency in PySpark, Scala, and Python with experience implementing scalable, production-grade data applications
Deep experience designing and tuning RDBMS, NoSQL, and distributed SQL systems
Mastery of SQL and distributed query engines such as Presto, Trino, Hive, and SparkSQL
Strong knowledge of data modeling, ETL/ELT design, and data warehousing methodologies
Proven experience architecting and operating data solutions on AWS, GCP, and Azure, including cloud data lakes, orchestration tools, and cost-effective storage/compute designs
Advanced proficiency in Databricks, including: Expert in building and optimizing notebooks and production jobs, Expert in Delta Lake design and optimization, Expert in Cluster configuration and workspace administration, Expert in CI/CD integration for data workloads, Expert in performance tuning for large distributed jobs
Expert in demonstrated ability to lead technical initiatives, communicate architectural decisions, and influence engineering direction across multiple teams
Strong problem-solving skills with the ability to troubleshoot complex data and performance issues

Benefits

Medical
Dental
Vision
401 (k)
FSA/HSA
Life Insurance
Paid Time Off
Wellness Program

Company

Visa is a multinational financial services company that facilitates electronic payment systems throughout the world.

H1B Sponsorship

Visa has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (459)
2024 (424)
2023 (416)
2022 (515)
2021 (351)
2020 (407)

Funding

Current Stage
Public Company
Total Funding
unknown
Key Investors
TNB Financial Services
2016-09-10Post Ipo Equity
2008-03-19IPO

Leadership Team

leader-logo
Ryan McInerney
Chief Executive Officer
linkedin
leader-logo
Chris Suh
EVP & Chief Financial Officer
linkedin
Company data provided by crunchbase