ST Global Tech LLC · 1 month ago
AWS Data Engineer
Responsibilities
Experience in developing reusable Python packages for internal or public usage
Ability to write automating ETL processes and scheduling jobs like Airflow
Advanced SQL skills, including complex joins, CTE’s and subqueries
In depth understanding of AWS S3 for data storage, ECS, IAM including best practices for organization and security
Experience with AWS Lambda for serverless data processing tasks
Proficiency in using Apache Airflow on AWS to design, schedule and monitor complex data flows
Experience in creating complex DBT models including full refresh, incremental models, snapshots, and documentation
Ability to write and maintain DBT macros for reusable code
Familiarity with AWS cloud watch, Data Dog for monitoring the pipelines and setting up alerts for workflow failure
Qualification
Required
Experience in developing reusable Python packages for internal or public usage
Ability to write automating ETL processes and scheduling jobs like Airflow
Advanced SQL skills, including complex joins, CTE's and subqueries
In depth understanding of AWS S3 for data storage, ECS, IAM including best practices for organization and security
Experience with AWS Lambda for serverless data processing tasks
Proficiency in using Apache Airflow on AWS to design, schedule and monitor complex data flows
Experience in creating complex DBT models including full refresh, incremental models, snapshots, and documentation
Ability to write and maintain DBT macros for reusable code
Familiarity with AWS CloudWatch, Data Dog for monitoring the pipelines and setting up alerts for workflow failure
Company
ST Global Tech LLC
ST Global Tech LLC is all about helping you make the right decision about the right technical support for the right fineness in Management utilities at any time in a firm are standing.
Funding
Current Stage
Early StageCompany data provided by crunchbase