Databricks DevOps Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

ECS · 9 hours ago

Databricks DevOps Engineer

ECS is a leading mid-sized provider of technology services to the United States Federal Government, and they are seeking a talented Databricks DevOps Engineer to join their dynamic data team supporting the Department of Homeland Security. The role involves managing and implementing use cases within the Databricks platform, maintaining a robust data sharing platform, and collaborating with a cross-functional team to enhance data capabilities for federal customers.

Artificial Intelligence (AI)Cloud InfrastructureComplianceConsultingCyber SecurityInformation TechnologyMachine LearningSecuritySoftware
badNo H1BnoteSecurity Clearance RequirednoteU.S. Citizen Onlynote

Responsibilities

Working closely with the Databricks Architect to manage and implement use cases within the Databricks platform for enterprise use
Configuration management and testing of complex software engineering infrastructures utilized by code development teams
Working closely with architects, developers, technical leads, etc. to collect requirements and design solutions
Using scripting/programming skills to solve problems
Containerization technologies (e.g., Docker/Podman)
Develop and implement CI/CD pipelines for automated deployment and testing of applications and infrastructure
Performing O&M support on applications of various sizes and complexity
Continuously evaluating and recommending best technologies for platform implementation and improvement
Automate repetitive tasks and processes to improve efficiency and reduce manual effort
Monitor system performance, troubleshoot issues, and ensure high availability and reliability of the platform
Being an active and collaborative member of an Agile/Scrum team and following all Agile/Scrum best practices
Collaborating with others as part of a cross-functional team that includes data architects, data scientists, DBAs, security engineers, etc

Qualification

DatabricksCI/CD pipelinesContainerization (Docker/Podman)Linux system administrationPythonCloud environments (AWS/Azure)Infrastructure management toolsDatabase technologies (PostgreSQL)Agile/Scrum practicesBig Data technologiesData lakesWarehousesAI/ML modelsData mesh conceptsCommunication skillsInterpersonal skillsLeadership skills

Required

Must be a US Citizen
Must be able to obtain a Public Trust Clearance
Prior professional services or federal consulting experience; experience supporting DHS preferred
Strong technical skills, including proficiency in programming languages such as Python
Familiar with DevOps and CI/CD processes, methodologies, and philosophies
Experience with Docker/Podman containerization and code management in GitHub or GitLab
Strong background in Linux system administration/shell scripting
Experience with working in cloud environments such as AWS/Azure
Cloud security (AWS/Azure) certifications (e.g., AWS Certified DevOps Engineer - Professional)
Experience with configuration or infrastructure management tools (e.g., Ansible, Terraform)
Excellent communication, interpersonal, and leadership skills
Understanding of modern Big Data technologies
Experience with database technologies such as PostgreSQL
Previous experience in working with data lakes and data warehouses
Document architectures, SOPs, and engineering workflows
Databricks platform performance optimization, monitoring, and reporting
DeltaShare setup, operations and maintenance, and overall management/execution
Experience with Unity Catalog and MLFlow within Databricks
Experience with agentic AI tools such as Databricks' Agent Bricks and Genie

Preferred

Databricks Platform Administrator
Background in computer science, engineering, physics, mathematics, or equivalent
Stay current with Databricks features, observability trends, cloud-native monitoring, and automation patterns
Experience implementing and utilizing AI/ML models
AI/ML tools/repos/techniques and familiarity as applied to serverless workflows
Familiarity with the concepts of a data mesh
AWS Solutions Architect Associate or Solutions Architect Professional Certification
Experience with SnowFlake, Palantir, and/or other large data platforms
Experience with metadata platforms (e.g., Alation, DataHub, Collibra, Unity)

Company

ECS is a fast-growing 4,000-person, $1.2B provider of advanced technology solutions for federal civilian, defense, intelligence, and commercial customers.

Funding

Current Stage
Late Stage
Total Funding
unknown
2018-01-31Acquired
2015-04-10Private Equity

Leadership Team

leader-logo
Keith McCloskey
VP / Chief Technology Officer
linkedin
leader-logo
Ryan Garner
Chief Financial Officer
linkedin
Company data provided by crunchbase