IT Labs ยท 2 days ago
Senior Data Engineer
Wonder how qualified you are to the job?
ConsultingDeveloper Platform
Insider Connection @IT Labs
Responsibilities
Craft and execute a technical vision for state-of-the-art AWS-based data pipelines.
Support new product developments and data science initiatives while ensuring systems maintain optimal performance levels.
Build and enhance data lakes and data pipelines, defining and implementing DataOps methodologies.
Write and optimize queries and reports, and support and monitor existing databases.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
At least 7 years in a Data Engineering position
Expert knowledge in Python
Proven experience with AWS technologies for building and managing data pipelines and performing ETL processes
Proficient in using AWS warehousing and analysis tools like Redshift, Quicksight, and Athena
Skilled in utilizing infrastructure-as-code practices, including CloudFormation, CDK, and Serverless frameworks
Expertise in designing and reviewing complex Python programs, ensuring compliance with style and security standards
Demonstrated ability to optimize SQL queries for maximum performance
Hands-on experience with AWS RDS
Ability to empathize with end-users to inform and guide decision-making processes
Excellent analytical thinking and problem-solving capabilities
Superior written and verbal communication skills
Benefits
Collaborative and supportive work environment
Opportunity for growth and learning
Values rooted in Integrity, Excellence, Proactivity, Innovation, and People