TruStart IT LLC · 1 day ago
Databricks Admin
TruStart IT LLC is seeking an experienced Databricks Administrator to manage, maintain, and optimize their Databricks environment. The ideal candidate will have strong expertise in platform administration, cluster optimization, and security management while collaborating closely with data engineering teams.
ConsultingInformation TechnologySoftware Engineering
Responsibilities
Manage and administer Databricks workspaces, clusters, pools, and notebooks
Monitor cluster performance, optimize auto-scaling, and manage cluster policies
Configure and maintain Unity Catalog, access control lists, and governance policies
Manage workspace-level users, groups, entitlements, secrets, and tokens
Implement security best practices including IAM roles, PAT tokens, secret scopes, OAuth, SCIM provisioning, etc
Configure role-based access control (RBAC) and enforce organizational governance standards
Collaborate with cloud security teams to maintain compliance (HIPAA, SOC2, GDPR, etc., if applicable)
Automate administrative tasks using Databricks CLI, Terraform, REST APIs, and PowerShell/Python scripts
Support CI/CD pipelines for Databricks jobs and workflows
Administer Delta Live Tables, jobs, repos, and scheduled workflows
Monitor performance, usage, and cost optimization within the Databricks environment
Troubleshoot cluster failures, notebook runtime issues, job failures, and workspace errors
Work with cloud teams to resolve compute, networking, and storage-related issues
Manage and configure Databricks on Azure AWS, or GCP (mention your required cloud)
Configure VNet injection, private endpoints, storage accounts, key vaults, IAM roles, etc
Manage integrations with ADLS/S3/GCS, event hubs, Kafka, API gateways, and data engineering tools
Qualification
Required
10 Years of experience
Independent visa only on W2
4–6+ years of hands-on experience as Databricks Admin or Cloud Data Platform Engineer
Strong experience with Azure/AWS/GCP Databricks administration
Good knowledge of Spark clusters, job orchestration, and performance tuning
Experience with Unity Catalog, Lakehouse security, RBAC, ACLs
Hands-on experience with Terraform, Databricks CLI, REST APIs
Strong understanding of Delta Lake, data pipelines, and cloud networking concepts
Familiarity with monitoring tools (Azure Monitor, CloudWatch, Prometheus, Splunk)
Preferred
Experience working with Delta Live Tables and MLflow
Knowledge of data engineering workflows and ETL best practices
Experience in telecom or large-scale enterprise environments
Databricks certification (Admin / Associate Data Engineer / Architect)
Company
TruStart IT LLC
We stay on the cutting edge of technology developments so that you don’t have to.
Funding
Current Stage
Early StageCompany data provided by crunchbase