Horizontal Talent · 22 hours ago
AWS Data Engineer
United States
Contract
Remote
Mid LevelHorizontal Talent is seeking an experienced AWS Data Engineer to develop scalable, AWS-native platforms and data layers. This role involves designing and implementing AWS Lakehouse architectures and developing production-grade data pipelines while collaborating with cross-functional teams.
Business DevelopmentConsultingStaffing Agency
Responsibilities
Design and implement AWS Lakehouse architectures, ensuring robust data management and accessibility
Develop and maintain production-grade data pipelines using advanced Python programming
Implement Medallion Architecture, focusing on Bronze, Silver, and Gold data layers
Utilize Open Table Formats like Apache Iceberg for effective data handling and schema evolution
Collaborate with cross-functional teams to ensure alignment on project goals and deliverables
Document processes and communicate effectively with stakeholders to facilitate project success
Qualification
Required
Proficient in Python with a focus on data engineering tasks and modular code development
Strong understanding of AWS services such as S3, Glue, Athena, and Lake Formation
Experience with data architecture principles and best practices, particularly in cloud environments
Solid grasp of Slowly Changing Dimensions (SCD Type 2) in distributed data systems
Preferred
Familiarity with EKS-based orchestration using EMR on EKS or Argo Workflows
Experience with data visualization tools like AWS Quicksights, Tableau, or Cognos
Ability to work independently while also being a team player in a dynamic work environment
Company
Horizontal Talent
Horizontal Talent provides staffing services for IT, digital marketing, and strategic markets.
Founded in 2003
201-500 employees
Funding
Current Stage
Growth StageLeadership Team
Jeremy Langevin
Co-Founder and CEO
Company data provided by crunchbase