Stellar IT Solutions ยท 3 days ago
Data/Software Engineer
Wonder how qualified you are to the job?
Cloud Data ServicesInformation Technology
Insider Connection @Stellar IT Solutions
Responsibilities
Migrating data from Teradata to Redshift using AWS Glue, Hudi, and CDC processes
Utilizing Python, PySpark, and AWS services like S3, EventBridge Scheduler, SQS, and Lambda for data processing and loading
Implementing Change Data Capture strategies and loading data to Amazon Redshift from Apache Hudi
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Senior-level experience in ETL processes using AWS Glue
Proficiency in Python
Advanced knowledge of PySpark
Experience with AWS S3
Working knowledge of AWS EventBridge Scheduler, SQS, and Lambda
Hands-on experience with Apache Hudi, including at least intermediate-level expertise in Hudi and CDC
Advanced knowledge of CDC processes
Experience in loading data from Apache Hudi to Amazon Redshift
Preferred
Knowledge of Spark
Experience in the airline industry
Company
Stellar IT Solutions
Stellar IT Solutions is an IT staff augmentations and tech/implementation services company.
H1B Sponsorship
Stellar IT Solutions has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Trends of Total Sponsorships
2023 (30)
2022 (45)
2021 (59)
2020 (46)
Funding
Current Stage
Growth StageCompany data provided by crunchbase