Kaizen Analytix ยท 17 hours ago
Cloud (AWS) / Databricks Technical Architect
Maximize your interview chances
AnalyticsInformation Services
H1B Sponsor Likely
Insider Connection @Kaizen Analytix
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
Lead the design and implementation of cloud-based data architectures on AWS, utilizing a wide range of AWS services (e.g., S3, EC2, Lambda, RDS, Redshift, Athena, Glue).
Architect and deploy scalable, secure, and cost-effective Databricks environments to process large volumes of data for analytics, data engineering, and machine learning.
Provide leadership in designing modern data architectures, including real-time data pipelines, ETL/ELT workflows, and big data processing systems using Databricks and AWS technologies.
Define and implement best practices for managing and optimizing data lakes, data warehouses, and data pipelines.
Ensure architecture decisions align with business requirements, security policies, and compliance standards.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
AWS Certification: Maintain and leverage AWS certification to design and implement cloud solutions.
Cloud Architecture: Design and optimize cloud architecture for scalability and efficiency.
Containers & Orchestration: Implement containers and orchestration tools for streamlined application deployment.
Microservices Architecture: Design and manage microservices architecture for flexible and scalable systems.
Cloud Environment Setup and Configurations: Set up and configure cloud environments to meet project requirements.
Security & Access Management: Ensure secure access management and compliance within cloud environments.
SQL, Python, Visualization & Analytical Tools: Use SQL, Python, and analytical tools for data processing and visualization.
API Development & Management: Develop and manage APIs for seamless data integration and functionality.
Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or a related field.
8+ years of experience in cloud architecture, data engineering, or a similar technical role, with at least 5 years of hands-on experience working with AWS and Databricks.
Proven track record in architecting and deploying large-scale data engineering solutions on AWS and Databricks.
Experience working with various data processing frameworks (e.g., Apache Spark, Apache Kafka, Airflow) and cloud-based data storage solutions.
Deep expertise in AWS services, including but not limited to S3, EC2, Lambda, Glue, Redshift, Athena, and RDS.
Strong experience with Databricks, including notebook creation, Spark-based processing, and managing Databricks clusters.
Expertise in data engineering concepts, including ETL/ELT, data lakes, data pipelines, and real-time streaming architectures.
Proficiency in programming languages such as Python, Scala, SQL, or Java for data processing and solution development.
Experience with DevOps practices, CI/CD pipelines, containerization (e.g., Docker, Kubernetes), and infrastructure as code (e.g., Terraform, CloudFormation).
Strong understanding of cloud security best practices, including IAM, encryption, and network security.
Preferred
Experience with big data frameworks (e.g., Hadoop, Spark) and container orchestration platforms (e.g., Kubernetes).
Familiarity with data governance, privacy, and compliance frameworks.
Company
Kaizen Analytix
Kaizen Analytix is an analytics products and services company.
H1B Sponsorship
Kaizen Analytix has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (2)
2022 (7)
2021 (4)
2020 (11)
Funding
Current Stage
Growth StageLeadership Team
Recent News
Company data provided by crunchbase