GAC Solutions ยท 9 hours ago
AWS Data Architect - Databricks
Maximize your interview chances
Insider Connection @GAC Solutions
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
Strong experience with Databricks on AWS (2+ years).
Proficiency in Apache Spark and distributed data processing.
Hands-on experience with AWS services such as S3, Redshift, EC2, Lambda, Glue, and EMR.
Expertise in Python, SQL, and Scala for data processing.
Experience with Delta Lake and building data lakes.
Familiarity with CI/CD pipelines using tools such as Jenkins, Git, or CodePipeline.
Experience with infrastructure as code (IaC) tools like Terraform or AWS CloudFormation.
Knowledge of data governance, data security, and compliance frameworks.
Strong analytical and problem-solving skills, with the ability to optimize complex data workflows.
Excellent communication skills and the ability to work in a fast-paced, collaborative environment.
Cloud Platforms (broad knowledge of basic utilities and in-depth knowledge of more than one of the cloud platforms)
Implement scalable and sustainable data engineering solutions using tools such as Databricks, Azure, Apache Spark, and Python. The data pipelines must be created, maintained, and optimized as workloads move from development to production for specific use cases.
Architecture Design Experience for Cloud and Non-cloud platforms
Expertise with various ETL technologies and familiar with ETL tools
Scrum Management experience with medium and large-scale projects
Experience to whiteboard enterprise level architectures
Must have extensive Range of knowledge of cloud/on premise tools and architectures
Experience to implement large scale hybrid cloud platform & applications
Knowledge of one or more scripting language
Experience with CI/CD
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Strong experience with Databricks on AWS (2+ years).
Proficiency in Apache Spark and distributed data processing.
Hands-on experience with AWS services such as S3, Redshift, EC2, Lambda, Glue, and EMR.
Expertise in Python, SQL, and Scala for data processing.
Experience with Delta Lake and building data lakes.
Familiarity with CI/CD pipelines using tools such as Jenkins, Git, or CodePipeline.
Experience with infrastructure as code (IaC) tools like Terraform or AWS CloudFormation.
Knowledge of data governance, data security, and compliance frameworks.
Strong analytical and problem-solving skills, with the ability to optimize complex data workflows.
Excellent communication skills and the ability to work in a fast-paced, collaborative environment.
Cloud Platforms (broad knowledge of basic utilities and in-depth knowledge of more than one of the cloud platforms).
Implement scalable and sustainable data engineering solutions using tools such as Databricks, Azure, Apache Spark, and Python. The data pipelines must be created, maintained, and optimized as workloads move from development to production for specific use cases.
Architecture Design Experience for Cloud and Non-cloud platforms.
Expertise with various ETL technologies and familiar with ETL tools.
Scrum Management experience with medium and large-scale projects.
Experience to whiteboard enterprise level architectures.
Must have extensive Range of knowledge of cloud/on premise tools and architectures.
Experience to implement large scale hybrid cloud platform & applications.
Knowledge of one or more scripting language.
Experience with CI/CD.
Company
GAC Solutions
GAC Solutions was designed to help our client partners build winning teams.
H1B Sponsorship
GAC Solutions has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (21)
2022 (14)
2021 (6)
2020 (2)
Funding
Current Stage
Growth StageCompany data provided by crunchbase