Lead Databricks Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Perficient · 9 hours ago

Lead Databricks Data Engineer

positionUnited States
timeFull-time
remoteRemote
senioritySenior Level, Lead/Staff
money$73K/yr - $150K/yr
date8+ years exp

Perficient is a global AI-first consultancy that partners with innovative enterprises to deliver business results through AI. They are seeking a Lead Databricks Data Engineer to lead development teams and create scalable data solutions, collaborating with architects and infrastructure teams.

ConsultingInformation TechnologyInternetMarketing
check
H1B Sponsor Likelynote

Responsibilities

Design and develop scalable data solutions
Build high-performance ETL pipelines using Spark/PySpark
Implement CI/CD pipelines and orchestrate Databricks workflows
Monitor production jobs and troubleshoot issues
Participate in Agile ceremonies

Qualification

PythonDatabricksAWS servicesETL platformsSQLDevOpsUnix/LinuxAgile developmentAI toolsClient-facing experienceCommunication skillsProblem-solving skills

Required

Passionate developer with 8+ years of data engineering experience, with at least 3 years in a lead or senior data engineer role
Minimum 5 years of hands-on Teradata and Databricks experience using (Delta Lake, Notebooks, Pipelines, cluster management)
Experience in AWS services (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, CloudWatch)
DevOps experience with Databricks CI/CD (Git, Jenkins, Artifactory)
Experience with Unix/Linux shell scripting and administration
Experience with SQL (Teradata SQL, Hive SQL, Spark SQL)
Experience with Job scheduling tools (CA7 Enterprise Scheduler)
Demonstrated ability to leverage AI tools to enhance productivity, streamline workflows, and support data-informed task execution
A solid understanding of AI capabilities and limitations including ethical considerations is expected
Flexible and adaptable attitude, disciplined to manage multiple responsibilities and adjust to varied environments
Ability to produce high quality products within deadlines
Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field

Preferred

Certification in Databricks, Spark, AWS, Azure or other cloud platform
Master's degree in Computer Science or related field
Client-facing or consulting experience is highly preferred

Company

Perficient

twittertwittertwitter
Glassdoor3.9
company-logo
Perficient is an IT consulting firm that helps companies adapt their systems to third party software products that use internet.
dateFounded in 1998
location
St Louis, Missouri, USA
people-size5001-10000 employees
web-link
http://www.perficient.com

H1B Sponsorship

Perficient has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (154)
2024 (147)
2023 (156)
2022 (196)
2021 (175)
2020 (223)

Funding

Current Stage
Public Company
Total Funding
$65.3M
2024-05-05Acquired
2024-01-17Post Ipo Equity· $4.44M
2022-10-17Post Ipo Equity· $5.18M

Leadership Team

leader-logo
Ed Hofffman
Senior Vice President, North America Business Operations
linkedin
leader-logo
Hari Madamalla
Vice President
linkedin

Recent News

MarTech Series
Perficient Named a Major Player in Three IDC MarketScapes For AI-First Approach to Customer Experience
2025-12-13
Precedence Research
Healthcare Business Intelligence Market Size to Reach USD 37.56 Billion by 2034
2025-11-10
Dallas Innovates
Richardson-Based Salesforce Consulting Partner Kelley Austin Acquired by St. Louis’ Perficient
2025-10-11
Company data provided by crunchbase