Infowave Systems, Inc ยท 1 day ago
Azure Databricks Administrator -W2 only
Infowave Systems, Inc is looking for a skilled Azure Databricks Administrator to support and manage enterprise-scale data analytics platforms. This role focuses on platform administration, performance optimization, security, and operational stability, requiring collaboration with data engineering, analytics, and DevOps teams.
Business IntelligenceInformation Technology
Responsibilities
Administer and support Azure Databricks workspaces, clusters, pools, jobs, and notebooks
Configure, monitor, and optimize Databricks cluster and pool performance, availability, and cost
Implement and manage Databricks Unity Catalog for centralized data governance, access control, and lineage tracking
Utilize Databricks Assistant to improve operational efficiency, troubleshoot issues, and support user productivity
Manage Azure infrastructure supporting Databricks including ADLS Gen2, Azure VMs, VNETs, NSGs, Key Vault, and Azure AD
Implement and maintain security best practices including RBAC, workspace access controls, secrets management, and data permissions
Monitor platform health using Azure Monitor, Log Analytics, and Databricks metrics
Troubleshoot Databricks, Spark, and Azure-related issues across environments
Support CI/CD pipelines for Databricks using Azure DevOps or GitHub
Collaborate with data engineers and architects on platform improvements and scaling
Maintain documentation, operational procedures, and support runbooks
Participate in production support and incident resolution as needed
Qualification
Required
Hands-on experience in Azure cloud administration
Hands-on experience administering Azure Databricks, including cluster and pool setup/management
Working knowledge of Databricks Unity Catalog and Databricks Assistant
Strong understanding of Apache Spark architecture and Databricks job orchestration
Experience with Azure storage services (ADLS Gen2, Blob Storage)
Knowledge of Azure networking and security concepts
Experience with Infrastructure as Code (Terraform, ARM templates)
Proficiency with Linux environments
Strong problem-solving and communication skills
Preferred
Azure certifications (AZ-104, AZ-305) or Databricks certification
Experience supporting enterprise or large-scale data platforms
Scripting experience with Python, PowerShell, or Bash
Familiarity with governance, compliance, and data security standards
Company
Infowave Systems, Inc
Infowave Systems is a leading Information Technology Solutions and Services company, providing cutting-edge software solutions to large and mid-market companies for over 20 years in Healthcare, Insurance, and Utilities.