Resource Logistics Inc. · 1 month ago
Databricks Platform Admin
St. Louis,, MO
Full-time
Onsite
Senior Level, Lead/Staff
10+ years expResource Logistics Inc. is seeking a Databricks Platform Admin to design, implement, and manage scalable Databricks platforms. The role involves collaborating with cross-functional teams to ensure optimal performance and reliability of data pipelines and services.
Information TechnologySoftware
Responsibilities
Design, implement, and manage scalable and secure Databricks platforms to ensure optimal performance and reliability
Create and manage Databricks workspaces and clusters, including right-sizing and lifecycle management of resources
Automate infrastructure provisioning and deployment using Infrastructure-as-Code tools like Terraform, GitLab CI/CD, and scripting languages (Python, Bash, PowerShell)
Monitor platform health, performance, and cost by building dashboards and integrating with monitoring tools
Troubleshoot and resolve issues related to cluster configuration, job failures, and performance bottlenecks within Databricks environments
Collaborate with cross-functional teams including data scientists, ML engineers, and product teams to deploy and maintain data pipelines and services on Databricks
Implement security and governance policies, including user management, access controls, and compliance adherence using Unity Catalog and other Databricks security features
Optimize compute and storage resources for cost efficiency without compromising performance, leveraging features like Delta Lake and Photon
Stay updated with new Databricks features and coordinate with product teams to evaluate and adopt them
Document platform Clienthitecture, best practices, troubleshooting guides, and provide mentorship to junior engineers on platform usage and optimization
Being part of Clienthitect’s forum, interact with application owners and users and provide viable solutions based on their requirement
Coordinate between offshore team and customer stakeholders to ensure the requests are fulfilled on time
Qualification
Required
10+ Yrs. of experience
Required hands-on experience in Clienthitecting, deploying, managing, and supporting Clienture Databricks Platform, Clienture Datalake and related solutions
Required hands-on experience working with Cloud provider tools and Clienthitecture (Clienture)
Required hands-on experience using scripting languages and command-line (CLI) tools such as Ansible, SQL, Terraform, Clienture CLI, Databricks CLI, PowerShell and/or Bash
Preferred
Preferred experience in management and tuning of data platforms like Clienture ADLS storage and Databricks
Knowledge working with and maintaining CI/CD pipelines and versioning tools such as Git preferred
Knowledge with a broad set of data ingestion and data pipeline patterns, and associated tools like (Qlik Replicate, Qlik Compose, Databricks, Kafka, Matillion ELT and Snowflake Services)
Experience with working in an agile product development team
Excellent communication skills and ability to articulate system designs and patterns to varying levels of leadership
Company
Resource Logistics Inc.
Resource Logistics is an information technology company providing ERP, CRM implementation, software solutions, and staffing services.
1001-5000 employees
H1B Sponsorship
Resource Logistics Inc. has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (14)
2024 (19)
2023 (10)
2022 (29)
2021 (35)
2020 (39)
Funding
Current Stage
Late StageCompany data provided by crunchbase