Data Lakehouse Engineering Lead jobs in United States
cer-icon
Apply on Employer Site
company-logo

U.S. Bank · 1 day ago

Data Lakehouse Engineering Lead

U.S. Bank is on a mission to help customers and businesses make smarter financial decisions. The Data Lakehouse Engineering Lead will design, build, and optimize enterprise-scale data platforms using Databricks, focusing on creating a modern data ecosystem for advanced analytics and real-time processing.

BankingFinancial ServicesInsuranceMortgageWealth Management
check
H1B Sponsor Likelynote

Responsibilities

Define and execute the technical roadmap for Databricks-based data platforms, ensuring alignment with enterprise architecture and business priorities
Design and implement robust ETL/ELT pipelines using PySpark and Spark SQL. Optimize cluster performance, job orchestration, and resource utilization for efficiency and cost control
Implement data governance policies, enforce access controls, and ensure compliance with regulatory standards using tools like Unity Catalog
Integrate Databricks with AWS/Azure services (e.g., S3, EC2, Glue) and manage DBU consumption through autoscaling and cost optimization strategies
Champion Agile methodologies and ensure disciplined use of Jira for backlog management, sprint planning, and progress tracking
Stay ahead of emerging technologies and Databricks features. Lead proof-of-concepts for new capabilities and drive automation for data workflows
Guide and mentor engineering teams, conduct code reviews, and enforce best practices. Foster collaboration and continuous improvement across cross-functional teams
Excellent stakeholder management and communication skills
Ability to lead large-scale, cross-functional projects in an Agile environment
Familiarity with Unity Catalog, Delta Live Tables, and advanced Databricks features

Qualification

DatabricksPySparkSpark SQLAWSAzureData architectureData governanceCI/CD toolsInfrastructure-as-codeAgile methodologiesStakeholder managementCommunication skills

Required

8+ years in data engineering or related roles, with 3+ years in Databricks platform leadership
Expertise in PySpark, Spark SQL, and cloud services (AWS/Azure)
Strong understanding of data architecture, governance, and security frameworks
Hands-on experience with CI/CD tools (GitLab, Jenkins) and infrastructure-as-code (Terraform)

Benefits

Healthcare (medical, dental, vision)
Basic term and optional term life insurance
Short-term and long-term disability
Pregnancy disability and parental leave
401(k) and employer-funded retirement plan
Paid vacation (from two to five weeks depending on salary grade and tenure)
Up to 11 paid holiday opportunities
Adoption assistance
Sick and Safe Leave accruals of one hour for every 30 worked, up to 80 hours per calendar year unless otherwise provided by law

Company

U.S. Bank

company-logo
At U.S.

H1B Sponsorship

U.S. Bank has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (20)

Funding

Current Stage
Public Company
Total Funding
$991M
Key Investors
U.S. Department of the TreasuryMitsubishi UFJ Financial Group
2023-09-29Post Ipo Debt· $55M
2023-08-03Post Ipo Debt· $936M
1978-01-13IPO

Leadership Team

leader-logo
John C Stern
CFO
linkedin
leader-logo
Daniel Crozier
Senior Vice President Operations
linkedin
Company data provided by crunchbase