Intermediate Enterprise Data Platform Engineer (Databricks Platform Administrator) jobs in United States
info-icon
This job has closed.
company-logo

Compu-Vision Consulting Inc. ยท 1 day ago

Intermediate Enterprise Data Platform Engineer (Databricks Platform Administrator)

Compu-Vision Consulting Inc. is seeking an Intermediate Enterprise Data Platform Engineer who will serve as the technical owner and administrator of the Databricks platform. This role is responsible for end-to-end platform operations, security, governance, and performance optimization to support the agency's analytics and AI/ML workloads.

ConsultingInformation TechnologyOutsourcingSoftware
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Administer Databricks accounts and workspaces across SDLC environments, ensuring standardization and operational consistency
Configure and maintain compute resources (clusters, jobs, SQL warehouses, runtimes, repos, libraries)
Implement monitoring, alerting dashboards, and operational runbooks to ensure reliable operations
Support Tier 2/3 incident response, RCA investigations, and preventive remediation
Manage platform upgrades, feature rollouts, configuration changes, and change controls
Enforce least-privilege access using IAM, SCIM, RBAC, and group-based controls
Govern secrets, credential management, audit logging, and compliance evidence collection
Administer Unity Catalog (metastores, schemas, grants, ownership, external storage)
Integrate with AWS (IAM, object storage, networking, monitoring, PrivateLink)
Drive cost optimization through cluster policies, auto-termination, scheduling, and usage insights
Automate configuration and environment promotion using Terraform, CLI, APIs, and CI/CD
Partner with Security, Networking, and Governance teams on lineage, classification, retention, and secure connectivity

Qualification

Databricks AdministrationUnity CatalogIAM SecurityAWS ExpertiseAutomationData GovernanceData Engineering FundamentalsDatabricks CertificationsAWS CertificationsStakeholder CommunicationVendor CoordinationDocumentation Skills

Required

Core Databricks Administration: Workspaces, compute, SQL warehouses, repos, runtimes, jobs, Databricks CLI
Unity Catalog: Metastores, catalogs/schemas, storage credentials, external locations, service principals
IAM Security: SSO, SCIM, RBAC, least-privilege, audit logging
AWS Expertise: IAM, S3, KMS, VPC basics, PrivateLink, CloudWatch/CloudTrail
Automation: Terraform, REST APIs, scripting, CI/CD pipelines
Data Governance: Classification, lineage, metadata, compliance frameworks (FedRAMP, SOC2, HIPAA)
Data Engineering Fundamentals: SQL performance tuning, ETL/ELT understanding, Python/Scala familiarity
Bachelor's degree or comparable experience
7+ years cloud/data platform administration with 4+ years Databricks administration
Strong stakeholder communication and reporting
Vendor coordination (Databricks account team)
Ability to document standards, runbooks, and baselines

Preferred

Databricks Platform Administrator / Architect
Databricks Certified Data Engineer Associate/Professional
AWS Solutions Architect (Associate or Professional)

Company

Compu-Vision Consulting Inc.

twittertwitter
company-logo
Compu-Vision Consulting Inc. is a dynamic IT consulting enterprise.

H1B Sponsorship

Compu-Vision Consulting Inc. has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2024 (2)
2022 (1)
2021 (9)
2020 (12)

Funding

Current Stage
Growth Stage
Company data provided by crunchbase