The Judge Group · 6 hours ago
Amazon S3 Engineer (1117091)
Charlotte, NC
Full-time
Onsite
Senior Level, Lead/Staff
$120K/yr - $130K/yr
10+ years expThe Judge Group is seeking an experienced Senior Amazon Data Engineer to design, develop, and optimize large-scale data pipelines within a cloud-based data platform. The role involves building reliable data solutions and ensuring high data quality while collaborating with cross-functional teams in a big data environment.
E-LearningInformation TechnologyProfessional Services
Responsibilities
Design, develop, and execute end‑to‑end data pipelines and validation test cases to ensure data accuracy, integrity, and quality
Build, implement, and optimize ETL/ELT workflows leveraging Amazon S3 for scalable data storage, retrieval, and processing
Develop scripts and automation for data movement between Amazon S3 and on‑prem or cloud platforms using PySpark, Shell scripting, or similar tools
Utilize Amazon S3 advanced features such as: Versioning, Lifecycle policies, Access control (IAM policies, bucket policies), Server-side encryption
Monitor, troubleshoot, and optimize pipeline performance to ensure high availability and reliability
Collaborate with data engineers, developers, analysts, and business stakeholders to resolve data‑related issues efficiently
Validate and manage HiveQL, HDFS file structures, and data processing within Hadoop/Spark environments
Work within a metadata‑driven ETL framework and batch/job scheduling systems
Create and maintain technical documentation, ensuring adherence to data engineering best practices
Support data governance, data quality checks, and compliance requirements within a regulated banking environment
Qualification
Required
10+ Years of experience
Strong expertise in Amazon S3
AWS Data Engineering
PySpark
SQL
ETL/ELT frameworks
Hands-on experience in banking and payments data domains
Design, develop, and execute end-to-end data pipelines and validation test cases to ensure data accuracy, integrity, and quality
Build, implement, and optimize ETL/ELT workflows leveraging Amazon S3 for scalable data storage, retrieval, and processing
Develop scripts and automation for data movement between Amazon S3 and on-prem or cloud platforms using PySpark, Shell scripting, or similar tools
Utilize Amazon S3 advanced features such as Versioning, Lifecycle policies, Access control (IAM policies, bucket policies), Server-side encryption
Monitor, troubleshoot, and optimize pipeline performance to ensure high availability and reliability
Collaborate with data engineers, developers, analysts, and business stakeholders to resolve data-related issues efficiently
Validate and manage HiveQL, HDFS file structures, and data processing within Hadoop/Spark environments
Work within a metadata-driven ETL framework and batch/job scheduling systems
Create and maintain technical documentation, ensuring adherence to data engineering best practices
Support data governance, data quality checks, and compliance requirements within a regulated banking environment
Primary Skill: Amazon Data Engineering
Secondary Skills: AWS Data Engineering, Amazon S3 (storage, lifecycle management, security, automation), PySpark, SQL, Shell Scripting, Autosys (job scheduling)
Strong hands-on experience with Hadoop, Spark, Hive, and HDFS
Experience working with Oracle databases
Strong understanding of data warehousing concepts, data transformation, and data quality frameworks
Experience in Cloud Storage and AWS ecosystems
Strong analytical and problem-solving skills
Excellent verbal and written communication skills
Ability to collaborate effectively with cross-functional and offshore teams
Detail-oriented with a strong focus on data accuracy and quality
Banking domain experience is required
Preferred
Payments domain experience is preferred
Experience with metadata-driven ETL processes
Exposure to large-scale distributed data processing
Familiarity with enterprise data governance and compliance standards
Company
The Judge Group
Results through the Power of Experience.
1001-5000 employees
H1B Sponsorship
The Judge Group has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2021 (3)
Funding
Current Stage
Public CompanyTotal Funding
unknown1997-02-14IPO
Leadership Team
Charlton Monsanto
Executive Vice President of Integrated Services and Innovation
Recent News
Seattle TechFlash
2025-09-12
2025-08-05
The Judge Group
2025-05-07
Company data provided by crunchbase