Edward Jones ยท 3 weeks ago
Databricks Platform Engineer
St Louis, MO
Full-time
Hybrid
Mid, Senior Level
$102K/yr - $173K/yr
5+ years expEdward Jones is a Fortune 500 company focused on financial services, seeking an experienced Databricks Platform Engineer to drive their enterprise data modernization strategy. The role involves architecting, implementing, and optimizing the Azure Databricks environment to support analytics projects across multiple business units, enhancing platform reliability and scalability.
DentalHealth CareMedical Device
Responsibilities
Design, implement, and manage scalable, secure Databricks platforms including workspace/cluster provisioning, lifecycle management, and resource optimization using Delta Lake and Photon to ensure performance, reliability, and cost efficiency
Automate provisioning and deployment using Terraform, GitLab CI/CD, and scripting (Python, Bash, PowerShell) while building observability dashboards to monitor platform health, performance, and costs
Implement and enforce security policies, access controls, and compliance requirements using Unity Catalog and Databricks security features to maintain enterprise-grade data protection
Partner with data scientists, ML engineers, and product teams to deploy data pipelines and analytical services while resolving cluster configuration issues, job failures, and performance bottlenecks
Evaluate and adopt emerging Databricks capabilities, document architecture and best practices, mentor junior engineers, and participate in on-call rotation for rapid incident response and platform stability
Participate in the Databricks platform on-call support rotation, providing expert assistance and rapid response for high-priority incidents, escalations, and critical service interruptions
Qualification
Required
Bachelor's degree in Computer Science, Information Systems or another applicable field is preferred
5+ years of experience in Systems Administration
Minimum 3 years hands-on experience designing, deploying, managing, and supporting Azure Databricks, Azure Data Lake Storage (ADLS), and related data solutions as a Platform Engineer/Administrator, with deep knowledge of Azure cloud infrastructure, resource management, security, and networking
Proficiency in automation and scripting tools including Terraform (IaC), Azure CLI, Databricks CLI, PowerShell, Python, REST API, and SQL for infrastructure provisioning, deployment, and platform management
CI/CD and version control expertise with Git, GitHub Actions, and related tools to automate data and infrastructure workflows, ensuring reliable and repeatable deployment processes
Excellent communication skills with the ability to articulate complex system designs, architectural patterns, and technical solutions clearly to stakeholders across all levels of leadership, from technical teams to executives
Preferred
Preferred experience in performance tuning and optimization of Azure ADLS and Databricks clusters, cost optimization strategies, and familiarity with data ingestion tools (Qlik Replicate, Apache Kafka, Matillion ELT, Snowflake)
Agile development experience working collaboratively in cross-functional product teams with exposure to iterative development practices and modern collaboration frameworks
Benefits
Medical and prescription drug
Dental
Vision
Voluntary benefits (such as accident, hospital indemnity, and critical illness)
Short- and long-term disability
Basic life
Basic AD&D coverage
401k retirement plan
Health savings account
Flexible spending account
Ten paid holidays
15 days of vacation for new associates
Sick time
Personal days
A paid day for volunteerism
Bonuses and profit sharing
Employee Assistance Program
Company
Edward Jones
Edward Jones
2-10 employees
H1B Sponsorship
Edward Jones has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2022 (2)
2021 (6)
2020 (1)
Funding
Current Stage
Early StageCompany data provided by crunchbase