Southern Talent Specialists, Inc. · 9 hours ago
Databricks Administrator
Birmingham, AL
Full-time
Onsite
Senior Level, Lead/Staff
9+ years expSouthern Talent Specialists, Inc. is seeking to hire an experienced Azure Databricks Platform Administrator to join their talented Information Technology team. The role involves overseeing the design, implementation, and maintenance of Databricks clusters, ensuring scalability, performance, and security while collaborating with leadership to align platform capabilities with business goals.
Network HardwareRisk ManagementSoftware EngineeringTelecommunications
Responsibilities
Strong experience with Azure, Databricks and the enterprise tools they interact with (e.g Salesforce, Informatica)
Oversee the design, implementation, and maintenance of Databricks clusters
Ensure the platform’s scalability, performance, and security
Develop and enforce policies and procedures for platform administration
Collaborate with leadership to align platform capabilities with business goals
Provide escalated support and troubleshooting to users
Oversee maintenance of role-based access to data and features in the Databricks Platform using Unity Catalog
Oversee implementation of external access controls for outside teams using service principles, SQL warehouses and Delta Sharing
Knowledge of Databricks development, including Azure Storage Technologies
Support Application integration and security management
Azure Cloud with Network security
Excellent verbal/written communication, collaboration, analytical and presentation skills Job responsibility
Provide operational support as Azure Databricks admin
Responsible for user provisioning, access controls and group administration
Manage –- Databricks clusters and permissions- Azure Data Storage, key vault, Tokens and secrets- Code deployment to production- Linked services, SQL endpoints
Responsible for clusters health and Performance management
Continuously improve processes and systems used to manage infrastructure, users and external access
Lead implementation of service principles and access tokens for external users
Oversee creation of queries and dashboards to monitor critical systems and processes
Review and maintain documentation for users and administrators
Automate common admin tasks using Databricks notebooks
Manage workflow tags, cluster tags, workflow naming convention enforcement
Review clusters health check and best practices implementation
Ensure regular backup and recovery
Oversee privilege reviews on users and resources
Stay current with industry trends and advancements in Databricks and cloud technologies
Lead and mentor a team of Databricks administrators
Provide training to junior members of the team and act as a point of escalation for complex questions and issues
Qualification
Required
9 years of relevant experience required
Bachelor's degree in related field required (combination of education and experience may be considered in lieu of degree)
Strong experience with Azure, Databricks and the enterprise tools they interact with (e.g Salesforce, Informatica)
Oversee the design, implementation, and maintenance of Databricks clusters
Ensure the platform's scalability, performance, and security
Develop and enforce policies and procedures for platform administration
Collaborate with leadership to align platform capabilities with business goals
Provide escalated support and troubleshooting to users
Oversee maintenance of role-based access to data and features in the Databricks Platform using Unity Catalog
Oversee implementation of external access controls for outside teams using service principles, SQL warehouses and Delta Sharing
Knowledge of Databricks development, including Azure Storage Technologies
Support Application integration and security management
Azure Cloud with Network security
Excellent verbal/written communication, collaboration, analytical and presentation skills
Provide operational support as Azure Databricks admin
Responsible for user provisioning, access controls and group administration
Manage – Databricks clusters and permissions, Azure Data Storage, key vault, Tokens and secrets, Code deployment to production, Linked services, SQL endpoints
Responsible for clusters health and Performance management
Continuously improve processes and systems used to manage infrastructure, users and external access
Lead implementation of service principles and access tokens for external users
Oversee creation of queries and dashboards to monitor critical systems and processes
Review and maintain documentation for users and administrators
Automate common admin tasks using Databricks notebooks
Manage workflow tags, cluster tags, workflow naming convention enforcement
Review clusters health check and best practices implementation
Ensure regular backup and recovery
Oversee privilege reviews on users and resources
Stay current with industry trends and advancements in Databricks and cloud technologies
Lead and mentor a team of Databricks administrators
Provide training to junior members of the team and act as a point of escalation for complex questions and issues
Strong understanding of data engineering needs
Strong understanding of Azure infrastructure required by Databricks
Experience with compliance audits/audit documentation
Experience using Databricks APIs with tools like Postman
Understanding of the Databricks workspace and development environment
Experience using Bitbucket to manage source code, and Understand Azure DevOps, managed code deployment and knowledge in CI/CD pipelines
Strong SQL skills for creating admin related queries and dashboards
Strong debugging skills
Ability to do risk analysis for 3rd party integrations with Azure resources
Familiarity with Dynatrace
Proficiency in Spark, Python, SQL, and cloud platforms (AWS, Azure, or GCP)
Strong knowledge with Python, PowerShell, pySpark
Strong in Python and PowerShell scripting
Preferred
Experience with Azure Databricks preferred
Company
Southern Talent Specialists, Inc.
Southern Talent Specialists is located and headquartered in the Birmingham, AL area.
11-50 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase