Horizontal Talent ยท 1 day ago
Data Engineer
Horizontal Talent is seeking a Data Engineer to transform sustainability data infrastructure and drive impactful environmental innovations. This role involves leading data migration to AWS platforms and collaborating with teams to ensure effective data solutions.
Responsibilities
Lead the migration of critical data infrastructure to modern AWS platforms, ensuring seamless operations
Set up and manage AWS Redshift clusters, AWS Glue, and orchestration platforms to build scalable data pipelines
Collaborate with various teams to understand requirements and ensure data solutions meet operational needs
Document new architecture, ensuring comprehensive coverage of data lineage, dependencies, and monitoring strategies
Implement data quality checks and alerting systems to proactively address potential issues
Qualification
Required
3-6 years of experience in building and maintaining data pipelines in complex enterprise settings
Proficiency in SQL for complex data transformations and performance optimization
Hands-on experience with AWS data services such as Redshift, S3, and Glue
Strong analytical skills for handling large, complex datasets
Excellent communication skills for effective stakeholder management and collaboration
Preferred
Experience with workflow orchestration platforms and dashboard development using QuickSight
Background in large-scale data migrations and familiarity with sustainability metrics
Experience in setting up monitoring and alerting for production data pipelines