Apply on Employer Site

Fractal · 2 days ago

Databricks SRE Platform Engineer

United States

Full-time

Remote

Senior Level

$120K/yr - $145K/yr

6+ years exp

Fractal Analytics is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. The Databricks SRE and Support Engineer will work on operations related to the AI/ML upskilling program on Databricks, ensuring stability, reliability, scalability, and performance.

AnalyticsArtificial Intelligence (AI)Big DataBusiness IntelligenceConsulting

Growth Opportunities

No H1B

Hiring Manager

Ayan Bandyopadhyay

Responsibilities

Provide continuous SRE support to thousands of geographically distributed users on the AI Dojo Databricks platform: respond to tickets, triage support, liaise with customers

Improve existing Infrastructure as Code (IaC) according to best DevOps practices

Develop and maintain monitoring frameworks to timely respond to outages and other service interruptions

Collaborate with internal cybersecurity teams to ensure all systems and operations comply with industry standards and are secure against evolving threats

Forecast and manage capacity requirements for the AI/ML training environment, while identifying opportunities to reduce costs without compromising performance

Qualification

DatabricksInfrastructure as CodeAWSPythonGitHub ActionsTerraformCI/CD toolsSecurity best practicesSupport experience

Required

Bachelor's degree in computer science, information technology, or a related field

6+ years of infrastructure experience: Proven experience working on large-scale, cloud-based, enterprise-level software platforms and deep understanding of Databricks environment

Experience building Github Actions pipelines including composite actions, OIDC federation for cloud provider identity acquisition, and use of environments and deployment controls

Experience building Databricks Asset Bundle and Terraform pipelines to manage and deploy Databricks Platform and Workspace resources

Fluency in Python, experience with the Databricks Python SDK to perform Workspace operations, and familiarity with PySpark and Delta Lake

Deep familiarity with Databricks APIs, and use of the Databricks CLI for use provisioning Workspace identities, filesystem resources, and the querying of account and workspace level Users, Groups, and Service Principals

Strong understanding of security best practices and experience ensuring compliance with relevant regulatory frameworks

3+ years of practical experience in Infrastructure-as-Code and CI/CD tools like Terraform, GitHub Actions, Databricks Asset Bundles, and alike

3+ years of experience working with AWS IaC deployments performing account provisioning, implementing cross-account automation, and building resource and identity policies supporting least-privilege access roles

3+ years of experience working in support teams that are geographically distributed