Lead AWS Cloud Engineer - Databricks Platform jobs in United States
cer-icon
Apply on Employer Site
company-logo

Greymatter Innovationz · 1 day ago

Lead AWS Cloud Engineer - Databricks Platform

Greymatter Innovationz is a company focused on helping clients stay digitally relevant across various domains and technologies. They are seeking a highly skilled Lead AWS Cloud Engineer with expertise in the Databricks platform to design, deploy, and manage cloud infrastructure while leading a team of engineers in delivering data-driven solutions.

BiotechnologyConsultingInformation TechnologyStaffing Agency
check
H1B Sponsor Likelynote
Hiring Manager
Shailja Sanga
linkedin

Responsibilities

Lead the design, implementation, and optimization of scalable and secure AWS cloud solutions
Utilize AWS services such as EC2, S3, Lambda, RDS, VPC, IAM, and others for building robust cloud-based architectures
Work closely with the architecture team to define infrastructure requirements and recommend suitable AWS technologies
Leverage Databricks for building and managing data pipelines, running Spark-based analytics workloads, and orchestrating machine learning models
Design, optimize, and maintain Databricks clusters and notebooks for data processing, transformation, and analysis
Integrate Databricks with other AWS services (e.g., S3, Redshift, Glue) to build comprehensive end-to-end data solutions
Provide leadership in best practices for working with Databricks to ensure reliability, scalability, and efficiency of data workflows
Lead a team of cloud engineers, guiding them in implementing solutions that align with organizational goals and industry best practices
Mentor junior team members and provide technical guidance on cloud-related projects, Databricks integration, and infrastructure optimization
Facilitate cross-functional collaboration between engineering, data science, and business teams
Automate cloud infrastructure provisioning and management using Infrastructure-as-Code tools (e.g., Terraform, CloudFormation)
Continuously monitor and optimize AWS resources to improve performance and reduce costs
Provide expert-level troubleshooting and support for cloud infrastructure, Databricks platform issues, and production systems
Identify and resolve performance bottlenecks, security risks, and system inefficiencies across AWS and Databricks environments
Document cloud infrastructure, Databricks configurations, and solutions for internal knowledge sharing
Prepare regular reports on system performance, cost management, and the status of cloud initiatives

Qualification

AWS Cloud EngineeringDatabricks PlatformLeadership ExperienceInfrastructure-as-CodeContainerization ToolsData Engineering Best PracticesAgile MethodologiesSecurity Best PracticesCommunication

Required

5+ years of experience in AWS cloud engineering, with a proven track record of delivering cloud-based solutions
3+ years of hands-on experience with Databricks platform, including building and managing data pipelines, notebooks, and Spark-based workloads
2+ years of experience leading or mentoring a team of engineers, with strong leadership and team-building skills
Proficient in AWS cloud services (EC2, S3, Lambda, RDS, VPC, IAM, CloudWatch, etc.)
Strong knowledge of Databricks, Apache Spark, and data engineering best practices
Experience with containerization and orchestration tools (Docker, Kubernetes)
Familiar with Infrastructure-as-Code tools (Terraform, CloudFormation)
Experience with data processing frameworks, data lakes, and analytics pipelines
Strong understanding of security best practices in cloud environments
Ability to manage complex cloud projects with multiple stakeholders
Excellent communication skills, with the ability to explain technical concepts to non-technical stakeholders
Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field (or equivalent experience)

Preferred

AWS Certified Solutions Architect – Professional
Databricks Certified Associate Developer

Benefits

Motivating Work Environment.
Excellent Work Culture.
Help you to upgrade yourself to the next level.
And More!!!

Company

Greymatter Innovationz

twittertwitter
company-logo
Greymatter Innovationz assists clients in navigating the changing technological paradigm.

H1B Sponsorship

Greymatter Innovationz has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (4)

Funding

Current Stage
Early Stage
Total Funding
unknown
Key Investors
SLK Software
2024-12-16Corporate Round

Leadership Team

leader-logo
Malay Verma
Co-Founder and President
linkedin
Company data provided by crunchbase