Horizontal Talent ยท 5 hours ago
AWS Data Engineer
Horizontal Talent is seeking an AWS Data Engineer to innovate and develop scalable AWS-native platforms and data layers. This role involves working on advanced cloud engineering projects and collaborating with cross-functional teams to enhance data storage and processing efficiency.
Business DevelopmentConsultingStaffing Agency
Responsibilities
Design and implement AWS Lakehouse architectures to enhance data storage and processing efficiency
Develop modular, testable Python code for data engineering and production-grade pipelines
Create and manage Bronze, Silver, and Gold data layers using Medallion Architecture
Utilize AWS services like S3, Glue, and Athena for efficient ETL processes
Work closely with cross-functional teams to ensure smooth integration of data solutions
Document processes and communicate effectively with stakeholders throughout project lifecycles
Qualification
Required
Strong proficiency in Python programming tailored for data engineering tasks
Proven experience with AWS services and cloud architecture design
Solid understanding of open table formats such as Apache Iceberg, Delta Lake, or Apache Hudi
Experience with Slowly Changing Dimensions (SCD Type 2) in distributed data systems
Excellent communication and teamwork abilities
Preferred
Familiarity with orchestration tools like EMR on EKS or Argo Workflows
Experience with data visualization tools such as AWS Quicksights, Tableau, or Cognos
Knowledge of best practices for data ingestion, transformation, and curation
Benefits
Medical
Dental
Vision
Retirement