Deloitte · 8 hours ago
Databricks Data Engineer - Senior Consultant
Deloitte is a leading professional services firm, and they are seeking a Senior Data Engineer to oversee the design, deployment, and optimization of data engineering solutions using Databricks. This role focuses on leading innovation in big data architecture and analytics while ensuring data solutions align with business objectives.
AccountingConsultingFinancial ServicesLegalProfessional ServicesRisk Management
Responsibilities
Lead the development, implementation, and scaling of advanced data engineering solutions using Databricks across AWS, Azure, or GCP environments
Establish, document, and promote best-in-class approaches for data architecture, integration, and modelling
Oversee the design, development, and maintenance of robust data pipelines and data architectures that support large-scale, enterprise data needs
Initiate and manage efforts to improve data quality, operational efficiency, and process scalability
Evaluate, pilot, and integrate new big data and analytics technologies, ensuring the organization remains at the cutting edge
Consult on, design, and implement governance, security, and compliance strategies tailored to modern cloud data ecosystems
Lead, coach, and develop teams of data engineers and architects, fostering technical growth and effective project delivery
Communicate technical concepts and business value to diverse stakeholders, including executives, business leads, and technology teams
Oversee the implementation of CI/CD practices with tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell for streamlined deployments and operations
Qualification
Required
Bachelor's or Master's degree in Computer Science, Engineering, or a related field (Master's preferred)
5+ years of hands-on experience in data engineering with a strong focus on Databricks, deployed on any major cloud (AWS, Azure, GCP)
Minimum of 5 years Technical Proficiency:
Expertise with cloud-native databases, storage solutions, and distributed compute platforms
Deep understanding of Lakehouse architecture, Apache Spark, Delta Lake, and related big data technologies
Advanced skills in data warehousing, 3NF, dimensional modeling, and enterprise-level data lakes
Experience with Databricks components including Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, and orchestration tools (e.g., Apache Airflow)
Expertise in designing and supporting incremental data loads and building metadata-driven ingestion/data quality frameworks using PySpark
Hands-on experience with Databricks Unity Catalog and implementing fine-grained security and access control
Proven track record in deploying code and solutions via automated CI/CD pipelines
A minimum of 1 year experience leadership in managing complex, cross-functional data projects and technical teams
Experience with performance optimization of Data engineering pipelines, code, compute resources
Ability to travel up to 50%, on average, based on the work you do and the clients and industries/sectors you serve
Limited immigration sponsorship may be available
Preferred
Comprehensive knowledge of the AWS, Azure, and GCP cloud ecosystems and associated big data stacks is strongly preferred
Demonstrated skill in performance tuning and optimization within Databricks/Apache Spark environments
Stays current with the latest Databricks feature releases and platform enhancements
Exceptional communication and stakeholder management abilities, including comfort interfacing with executive leadership
Experience with Databricks Lakeflow is plus
Experience in AI/ML is plus
Benefits
Discretionary annual incentive program
Company
Deloitte
Deloitte is a business consulting company that offers audit, consulting, financial advisory, and tax services.
H1B Sponsorship
Deloitte has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (6871)
2024 (4911)
2023 (5604)
2022 (8090)
2021 (5993)
2020 (10388)
Funding
Current Stage
Late StageLeadership Team
Recent News
2026-01-08
Company data provided by crunchbase