Select Minds LLC · 3 months ago
Senior AWS Data Engineer
Select Minds LLC is a company focused on delivering profitability through effective communication and interactive solutions. They are seeking an experienced AWS Data Engineer to design and manage scalable data pipelines, ensuring data quality and driving business intelligence across teams.
AnalyticsInformation TechnologyIT InfrastructureSoftware
Responsibilities
Design, build, and maintain scalable ETL pipelines across AWS and SQL-based technologies
Assemble large, complex datasets that meet business and technical requirements
Implement process improvements by re-architecting infrastructure, optimizing data delivery, and automating workflows
Ensure data quality and integrity across multiple sources and targets
Orchestrate workflows with Apache Airflow (MWAA) and support large-scale cloud migration projects
Conduct ETL testing, apply test-driven development (TDD), and participate in code reviews
Monitor, troubleshoot, and optimize pipelines for performance, reliability, and security
Collaborate with cross-functional teams and participate in Agile ceremonies (sprints, reviews, stand-ups)
Qualification
Required
8–12 years of experience in Data Engineering, with deep focus on ETL, cloud pipelines, and Python development
5+ years of hands-on coding with Python (primary), PySpark, and SQL
Proven experience with AWS services: Glue, EMR (Spark), S3, Lambda, ECS/EKS, MWAA (Airflow), IAM
Experience with AuroraDB, DynamoDB, Redshift, and AWS Data Lakes
Strong knowledge of data modeling, database design, and advanced ETL processes (including Alteryx)
Proficiency with structured and semi-structured file types (Delimited Text, Fixed Width, XML, JSON, Parquet)
Experience with ServiceBus or equivalent AWS streaming/messaging tools (SNS, SQS, Kinesis, Kafka)
CI/CD expertise with GitLab or similar, plus hands-on Infrastructure-as-Code (Terraform, Python, Jinja, YAML)
Familiarity with unit testing, code quality tools, containerization, and security best practices
Solid Agile development background, with experience in Agile ceremonies and practices
Benefits
Hybrid
Competitive salary
Opportunity for advancement
Company
Select Minds LLC
Select Minds LLC is a global Information Technology services company providing management consulting, technology and business process outsourcing, quality assurance and staff augmentation services to large corporations across the globe As your trusted partner, we will build a relationship that goes far beyond simply selling you our services or deploying an IT professional to augment your staff.
H1B Sponsorship
Select Minds LLC has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (44)
2024 (40)
2023 (22)
2022 (56)
2021 (33)
2020 (27)
Funding
Current Stage
Growth StageCompany data provided by crunchbase