Databricks Engineer jobs in United States
info-icon
This job has closed.
company-logo

Galaxy i technologies Inc · 12 hours ago

Databricks Engineer

Galaxy i technologies Inc is seeking a Databricks Engineer to manage cloud infrastructure and automate deployment processes. The role involves collaborating with development and operations teams, establishing CI/CD pipelines, and implementing security measures in Azure environments.

Corporate TrainingInformation TechnologySoftwareSoftware Engineering
check
Growth Opportunities
check
H1B Sponsor Likelynote
Hiring Manager
Srinivasan Ragha
linkedin

Responsibilities

Provision and manage infrastructure resources in the cloud using tools like Azure Resource Manager templates or terraform
Establish and manage CICD pipelines to automate the build| test| and deployment processes
Oversee the release process working closely with development and operations teams ensuring deployments and having contingency plans for rollbacks if needed
Implement and maintain tools| like Ansible or Puppet| for uniformity across environments
Establish systems to monitor performance issues or errors in applications proactively
Implement security measures while adhering to industry norms and laws
Investigate and resolve issues related to the application| infrastructure| or deployment pipelines
Collaborate with development| testing| and operations teams for effective communication and smooth workflow
Proven experience as a DevOps Platform Engineer in cloud environments| with a strong focus on Azure
Deep expertise in Azure Databricks| Azure Data Lake Storage| Azure Resource Manager (ARM)| Microsoft Entra| Azure SQL Database.Hands on experience automating Databricks clusters| libraries| jobs| notebooks| and environment promotions via pipelines
Proficiency in Unity Catalog and Databricks data governance
Familiarity with Apache Spark (PySpark| Spark SQL)
Strong IaC skills Terraform| ARM| or Bicep
Scripting (PythonvPowerShell)| and Git (branching strategies| conflict resolution)
Observability with Azure Monitor| Log Analytics pipeline orchestration with Azure Data Factory
Security best practices for cloud (RBAC| managed identities| Key Vault).Excellent problem solving and collaboration across cross functional teams
Create and maintain documentation related to infrastructure| deployment processes| and standard operating procedures
Analyze and estimate resource requirements to ensure optimum performance and scalability of applications
Implement backup and disaster recovery strategies to ensure data protection and business continuity
Identify areas for improvement in the development and deployment processes and implement changes to enhance efficiency and productivity

Qualification

Azure DevOpsAzure Data FactoryDatabricksTerraformApache SparkPythonPowerShellGitAzure MonitorSecurity best practices

Required

10 + years exp
6-8 years in required skills
Azure DevOps and Azure Data factory
Digital: Cloud DevOps
Digital: Databricks
Provision and manage infrastructure resources in the cloud using tools like Azure Resource Manager templates or terraform
Establish and manage CICD pipelines to automate the build| test| and deployment processes
Oversee the release process working closely with development and operations teams ensuring deployments and having contingency plans for rollbacks if needed
Implement and maintain tools| like Ansible or Puppet| for uniformity across environments
Establish systems to monitor performance issues or errors in applications proactively
Implement security measures while adhering to industry norms and laws
Investigate and resolve issues related to the application| infrastructure| or deployment pipelines
Collaborate with development| testing| and operations teams for effective communication and smooth workflow
Proven experience as a DevOps Platform Engineer in cloud environments| with a strong focus on Azure
Deep expertise in Azure Databricks| Azure Data Lake Storage| Azure Resource Manager (ARM)| Microsoft Entra| Azure SQL Database
Hands on experience automating Databricks clusters| libraries| jobs| notebooks| and environment promotions via pipelines
Proficiency in Unity Catalog and Databricks data governance
Familiarity with Apache Spark (PySpark| Spark SQL)
Strong IaC skills Terraform| ARM| or Bicep
Scripting (PythonvPowerShell)| and Git (branching strategies| conflict resolution)
Observability with Azure Monitor| Log Analytics pipeline orchestration with Azure Data Factory
Security best practices for cloud (RBAC| managed identities| Key Vault)
Excellent problem solving and collaboration across cross functional teams

Preferred

Create and maintain documentation related to infrastructure| deployment processes| and standard operating procedures
Analyze and estimate resource requirements to ensure optimum performance and scalability of applications
Implement backup and disaster recovery strategies to ensure data protection and business continuity
Identify areas for improvement in the development and deployment processes and implement changes to enhance efficiency and productivity

Company

Galaxy i technologies Inc

twittertwitter
company-logo
Galaxy i Technologies, Inc is a global consulting and IT services company that is known for its commitment to client satisfaction.

H1B Sponsorship

Galaxy i technologies Inc has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (41)
2024 (18)
2023 (46)
2022 (55)
2021 (28)
2020 (69)

Funding

Current Stage
Growth Stage
Company data provided by crunchbase