Be an early applicantLess than 25 applicants
This job has closed.
Booz Allen Hamilton · 2 days ago
Databricks Data Engineer
Atlanta, GA
Full-time
Hybrid
Senior Level
$76K/yr - $172K/yr
8+ years exp
Wonder how qualified you are to the job?
Maximize your interview chancesConsultingCyber Security
Insider Connection @Booz Allen Hamilton
Responsibilities
Design, build, and maintain robust data pipelines within an organization.
Create and optimize end-to-end data flows, handle ETL processes, and design data models.
Ensure data security and compliance, collaborate with cross-functional teams, and continuously improve performance and scalability.
Bridge the gap between raw data and actionable insights, enabling efficient data processing and analytics across the business.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
8+ years of experience designing and developing ETL processes and managing data pipelines
3+ years of experience with Databricks, including building and optimizing data pipelines using Databricks notebooks and clusters
Experience using Azure data services, including Azure Data Factory, Azure SQL service, Azure Blob Storage, or Azure Synapse Analytics
Experience designing, developing, and maintaining ETL pipelines, including data extraction, transformation, and loading processes
Experience with Azure Data Catalog for managing metadata, schema definitions, and data lineage
Experience monitoring ETL job runs, identifying bottlenecks, and troubleshooting issues, including use of Azure Monitor
Knowledge of performance optimization techniques for ETL jobs such as partitioning, bucketing, and caching
Ability to write Python code for ETL scripts and custom transformations
Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
Bachelor’s degree
Preferred
Experience creating and maintaining Data Factory pipelines
Experience integrating machine learning models into data pipelines
Experience with stream processing frameworks such as Apache Kafka, Azure Event Hub, and cloud-native compute services such as Azure Functions
Experience leveraging serverless architectures for data processing
Experience ensuring data quality, privacy, and security
Knowledge of Databricks Delta Lake
Knowledge of data governance practices, data lineage, and compliance requirements such as NIST
Knowledge of tools such as Apache Atlas, Azure Data Catalog, DVSum, or Collibra, for managing metadata, data lineage, and cataloging data assets
Ability to design and implement data models, define schemas, optimize data structures for efficient querying and analytics, and troubleshoot and improve query performance
Benefits
Health Savings Account (HSA) contributions
Paid holidays
Paid parental leave
401(k) match
Flexible schedules
Remote and hybrid work options
Company
Booz Allen Hamilton
Booz Allen Hamilton is a consulting firm that specializes in analytics, technology, and engineering.
10,001+ employees
H1B Sponsorship
Booz Allen Hamilton has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Trends of Total Sponsorships
2023 (14)
2022 (31)
2021 (29)
2020 (38)
Funding
Current Stage
Public CompanyTotal Funding
$2.38B2023-08-01Post Ipo Debt· $650M
2020-08-13Post Ipo Debt· $700M
2015-02-02Post Ipo Secondary· $340.32M
Leadership Team
Horacio Rozanski
President and Chief Executive Officer
Karen Dahut
Executive Vice President
Recent News
2024-05-26
The Motley Fool
2024-05-26
2024-05-13
Company data provided by crunchbase
