Greymatter Innovationz · 1 day ago
Lead AWS Cloud Engineer - Databricks Platform
Greymatter Innovationz is a company focused on helping clients stay digitally relevant across various domains and technologies. They are seeking a highly skilled Lead AWS Cloud Engineer with expertise in the Databricks platform to design, deploy, and manage cloud infrastructure while leading a team of engineers in delivering data-driven solutions.
Responsibilities
Lead the design, implementation, and optimization of scalable and secure AWS cloud solutions
Utilize AWS services such as EC2, S3, Lambda, RDS, VPC, IAM, and others for building robust cloud-based architectures
Work closely with the architecture team to define infrastructure requirements and recommend suitable AWS technologies
Leverage Databricks for building and managing data pipelines, running Spark-based analytics workloads, and orchestrating machine learning models
Design, optimize, and maintain Databricks clusters and notebooks for data processing, transformation, and analysis
Integrate Databricks with other AWS services (e.g., S3, Redshift, Glue) to build comprehensive end-to-end data solutions
Provide leadership in best practices for working with Databricks to ensure reliability, scalability, and efficiency of data workflows
Lead a team of cloud engineers, guiding them in implementing solutions that align with organizational goals and industry best practices
Mentor junior team members and provide technical guidance on cloud-related projects, Databricks integration, and infrastructure optimization
Facilitate cross-functional collaboration between engineering, data science, and business teams
Automate cloud infrastructure provisioning and management using Infrastructure-as-Code tools (e.g., Terraform, CloudFormation)
Continuously monitor and optimize AWS resources to improve performance and reduce costs
Provide expert-level troubleshooting and support for cloud infrastructure, Databricks platform issues, and production systems
Identify and resolve performance bottlenecks, security risks, and system inefficiencies across AWS and Databricks environments
Document cloud infrastructure, Databricks configurations, and solutions for internal knowledge sharing
Prepare regular reports on system performance, cost management, and the status of cloud initiatives
Qualification
Required
5+ years of experience in AWS cloud engineering, with a proven track record of delivering cloud-based solutions
3+ years of hands-on experience with Databricks platform, including building and managing data pipelines, notebooks, and Spark-based workloads
2+ years of experience leading or mentoring a team of engineers, with strong leadership and team-building skills
Proficient in AWS cloud services (EC2, S3, Lambda, RDS, VPC, IAM, CloudWatch, etc.)
Strong knowledge of Databricks, Apache Spark, and data engineering best practices
Experience with containerization and orchestration tools (Docker, Kubernetes)
Familiar with Infrastructure-as-Code tools (Terraform, CloudFormation)
Experience with data processing frameworks, data lakes, and analytics pipelines
Strong understanding of security best practices in cloud environments
Ability to manage complex cloud projects with multiple stakeholders
Excellent communication skills, with the ability to explain technical concepts to non-technical stakeholders
Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field (or equivalent experience)
Preferred
AWS Certified Solutions Architect – Professional
Databricks Certified Associate Developer
Benefits
Motivating Work Environment.
Excellent Work Culture.
Help you to upgrade yourself to the next level.
And More!!!
Company
Greymatter Innovationz
Greymatter Innovationz assists clients in navigating the changing technological paradigm.
H1B Sponsorship
Greymatter Innovationz has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (4)
Funding
Current Stage
Early StageTotal Funding
unknownKey Investors
SLK Software
2024-12-16Corporate Round
Recent News
Mexico Business
2024-12-30
Company data provided by crunchbase