IT Labs ยท 2 days ago
Senior Data Engineer
Wonder how qualified you are to the job?
ConsultingDeveloper Platform
Insider Connection @IT Labs
Responsibilities
Craft and execute a technical vision for state-of-the-art AWS-based data pipelines.
Support new product developments and data science initiatives while ensuring optimal performance levels.
Build and enhance data lakes and data pipelines, defining and implementing DataOps methodologies.
Write and optimize queries and reports, and support and monitor existing databases.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
5+ years in a Data Engineering position, preferably within the AWS environment and using Python
Proven experience with AWS technologies for building and managing data pipelines and performing ETL processes
Proficient in using AWS warehousing and analysis tools like Redshift, Quicksight, and Athena
Skilled in utilizing infrastructure-as-code practices, including CloudFormation, CDK, and Serverless frameworks
Expertise in designing and reviewing complex Python programs, ensuring compliance with style and security standards
Demonstrated ability to optimize SQL queries for maximum performance
Hands-on experience with AWS RDS
Strong aptitude for validating concepts through proof of concepts, tests, and external research
Ability to empathize with end-users to inform and guide decision-making processes
Excellent analytical thinking and problem-solving capabilities
Superior written and verbal communication skills
Preferred
Proficiency in infrastructure-as-code and CI/CD systems (such as Terraform, Troposphere, CloudFormation, Jenkins)
Experience in administering Microsoft SQL Server (especially in high-availability setups)
Benefits
Collaborative and supportive work environment
Opportunity for growth and learning