Henderson Scott · 23 hours ago
Senior Data Engineer (AWS / Hadoop / Batch ETL)
Charlotte, NC
Full-time
Onsite
Senior Level, Lead/Staff
$120K/yr - $130K/yr
10+ years expHenderson Scott is hiring a Senior Data Engineer to support a large-scale, mission-critical banking data platform within Bank of America. The role focuses on designing and maintaining reliable, high-volume batch data pipelines in a regulated enterprise environment.
RecruitingStaffing Agency
Hiring Manager
Kieran Blair
Responsibilities
Designing, building, and maintaining enterprise grade ETL pipelines
Using Amazon S3 as a core data storage and staging layer within batch workflows
Automating and optimising data movement between S3, Hadoop, Oracle, and downstream platforms
Writing and troubleshooting production code using PySpark, Shell scripting, and SQL
Validating HiveQL queries, HDFS structures, and data processing within a Hadoop/Cloudera environment
Applying S3 best practices including versioning, lifecycle policies, access controls, and encryption
Supporting batch job orchestration and scheduling (Autosys or equivalent)
Partnering with developers, data teams, and business stakeholders to resolve data issues and meet SLAs
Producing clear technical documentation and ensuring audit-ready data processes
Qualification
Required
10+ years of experience in Data Engineering / Big Data / ETL
Strong hands-on experience with Amazon S3 in production environments
Experience building batch pipelines using Spark / PySpark
Solid SQL skills and experience working with Oracle
Background in Hadoop / Hive / HDFS (Cloudera preferred)
Experience with job scheduling frameworks (Autosys strongly preferred)
Strong understanding of data quality, validation, and governance
Experience working in banking or financial services environments
Preferred
Payments or transaction data experience
Metadata-driven ETL frameworks
Experience supporting large, regulated data platforms
Benefits
Excellent benefits
Company
Henderson Scott
Henderson Scott is a global talent partner for Digital, Technology & Commercial Professionals
51-200 employees
Funding
Current Stage
Growth StageTotal Funding
unknown2018-09-04Acquired
Company data provided by crunchbase