Databricks SME jobs in United States
cer-icon
Apply on Employer Site
company-logo

CACI International Inc · 3 weeks ago

Databricks SME

CACI International Inc is seeking a highly skilled and experienced Databricks SME to join their BEAGLE Agile Solution Factory Team supporting the Customs and Border Protection client in Northern Virginia. The role involves modernizing the data warehouse environment, optimizing data pipelines, and applying innovative solutions to complex data challenges.

Information TechnologyService IndustrySoftware
check
Comp. & Benefits
badNo H1BnoteU.S. Citizen Onlynote

Responsibilities

Modernize the data warehouse environment by migrating the platform to Databricks
Work with database developers and administrators across multiple product teams
Serve as a data and technology expert across a broad and diverse set of mission critical applications
Design, develop, and maintain robust and scalable data warehouse architectures and ETL/ELT data pipelines using Databricks or a similar cloud-based platform
Evaluating existing data sets and reporting architectures to identify strategic gaps and apply modern technologies to creatively achieve superior mission outcomes
Analyze project-related problems and create innovative solutions involving technology, analytic methodologies, and advanced solution components
Optimize and troubleshoot data pipelines and warehouse performance to ensure efficient and reliable data processing
Create or augment business and operational intelligence tools using languages such as SQL, Spark, and Python to detect trends, patterns, and non-obvious relationships in large, complex, and disparate data sets
Actively participate in Agile Scrum sprint planning, artifact creation, sprint testing, regression testing, demonstrations, retrospectives and solution releases

Qualification

DatabricksData architectureData engineeringCloud platformsPySparkSQLPythonAgile methodologyKafkaCI/CDData modelingDatabase design

Required

Must be a U.S. Citizen with the ability to pass CBP background investigation, criteria includes but is not limited to:
3 year check for felony convictions
1 year check for illegal drug use
1 year check for misconduct such as theft or fraud
7+ years of professional experience working on complex data challenges in the areas of data architecture and engineering
Proven experience as an Oracle DBA, with specific expertise in managing Oracle databases on Amazon RDS
3-5 years of Databricks experience. Alternative/equivalent technologies: Significant experience with Snowflake, Google BigQuery, or Microsoft Azure Synapse Analytics will also be considered
Experience building and optimizing data pipelines for batch and/or streaming data
Proven expertise with Databricks, including extensive hands-on experience with PySpark, Python, SQL, Kafka, and Databricks notebooks. Strong experience with data modeling techniques (e.g., dimensional modeling, data vault) and database design
Experience with cloud platforms (e.g., AWS, Azure, GCP) and services related to data storage and processing (e.g., S3, ADLS)
Experience automating ELT data pipelines using CI/CD tools and technologies
Database skillset for AWS RDS concepts, and understanding of database principles used by tools such Oracle, and Informatica ETL
Strong software development background using Agile or DevOps methods and deep familiarity with cloud-native technologies

Preferred

5-10 years of DHS, DoD, or IC experience working in complex data environments, including the architecture and optimization of data schemas, terabyte-scale ETL, etc
5-10 years of experience applying a range of analytical techniques including statistical, geospatial, link, temporal, and predictive analysis, for DHS, DoD, or IC agencies
3-5 years of experience building and implementing artificial intelligence, neural networks, deep learning, or machine learning capabilities in software applications in a national security or academic environment
Exposure to Continuous integration, Continuous Deployment (CI/CD) and DevOps processes and tools
Exposure to implementing or migrating to Cloud environments like Amazon Web Services (AWS) or Microsoft Azure
Previous experience as an Enterprise-level Data Architect, Data Engineer, Data Scientist, or Data Analyst
Ability to apply advanced principles, theories, and concepts, and contribute to the development of innovative principles and ideas

Benefits

Healthcare
Wellness
Financial
Retirement
Family support
Continuing education
Time off benefits

Company

CACI International Inc

company-logo
At CACI International Inc (NYSE: CACI), our 25,000 talented and dynamic employees are ever vigilant in delivering distinctive expertise and technology to meet our customers’ greatest challenges in national security.

Funding

Current Stage
Public Company
Total Funding
$1B
2025-05-21Post Ipo Debt· $1B
2003-01-10IPO

Leadership Team

leader-logo
John Mengucci
President & CEO
linkedin
leader-logo
Darryl W Burke
Senior Vice President / Air Force Client Executive
linkedin
Company data provided by crunchbase