Sr. Databricks Consultant jobs in United States
cer-icon
Apply on Employer Site
company-logo

ECS · 1 month ago

Sr. Databricks Consultant

ECS is a leading mid-sized provider of technology services to the United States Federal Government. They are seeking a Sr. Databricks Consultant to work remotely, responsible for consulting with customers to optimize their Databricks environments for advanced data analytics and machine learning.

Artificial Intelligence (AI)Cloud InfrastructureComplianceConsultingCyber SecurityInformation TechnologyMachine LearningSecuritySoftware
badNo H1BnoteSecurity Clearance RequirednoteU.S. Citizen Onlynote

Responsibilities

Design, build, and maintain scalable ETL/ELT pipelines in Databricks
Optimize workflows and clusters for performance and cost efficiency
Integrate Databricks with cloud platforms (AWS, Azure, or GCP)
Implement data governance, security, and compliance standards
Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets and insights
Troubleshoot issues and drive continuous improvement in data infrastructure

Qualification

DatabricksPythonApache SparkETL/ELT pipelinesCloud data platformsData lakehouse architectureData modelingCI/CD pipelinesMachine learning pipelinesDelta LakeData visualization toolsInfrastructure as codeData securityDevOps/MLOps practicesProject management

Required

Proven experience working with Databricks in production environments
Strong proficiency in Python and/or SQL for data engineering
Experience with Apache Spark for distributed data processing
Knowledge of data lakehouse architecture and best practices
Experience with cloud data platforms (AWS S3, Azure Data Lake, or GCP Storage)
Hands-on experience building and managing ETL/ELT pipelines
Strong understanding of data modeling, data quality, and performance tuning
Familiarity with CI/CD pipelines and version control (Git)
Able and willing to obtain a US Security Clearance
Ability to travel, as needed, to customer sites
Must be a US Citizen per contract
Bachelor's degree; preferably in Computer Science, Information Security, or a related field. Will consider experience in lieu of a degree

Preferred

Master's degree or PhD in Computer Science, Data Science, or a related field
Experience with machine learning pipelines in Databricks (MLflow)
Knowledge of Delta Lake and Unity Catalog for governance
Familiarity with streaming technologies (Kafka, Kinesis, or Event Hubs)
Exposure to data visualization tools (Tableau, Power BI, or Looker)
Experience with Terraform, ARM, or CloudFormation for infrastructure as code
Background in data security and compliance (HIPAA, FedRAMP, SOC2, etc.)
Strong understanding of DevOps/MLOps practices
Prior consulting or customer-facing experience
Skills in project management and familiarity with methodologies like Agile can be beneficial, particularly in managed service environments

Company

ECS is a fast-growing 4,000-person, $1.2B provider of advanced technology solutions for federal civilian, defense, intelligence, and commercial customers.

Funding

Current Stage
Late Stage
Total Funding
unknown
2018-01-31Acquired
2015-04-10Private Equity

Leadership Team

leader-logo
Keith McCloskey
VP / Chief Technology Officer
linkedin
leader-logo
Ryan Garner
Chief Financial Officer
linkedin
Company data provided by crunchbase