NuStar Technologies · 19 hours ago
Amazon S3 Engineer
Charlotte, NC
Full-time
Onsite
Senior Level, Lead/Staff
$120K/yr - $130K/yr
10+ years expNuStar Technologies is seeking an Amazon S3 Engineer to design, develop, and execute data pipelines ensuring data integrity and quality. The role involves optimizing data workflows utilizing Amazon S3 for scalable data storage and management, as well as collaborating with cross-functional teams to resolve data-related issues.
AnalyticsConsultingEnterprise Resource Planning (ERP)IT ManagementStaffing Agency
Responsibilities
Design, develop, and execute Data Pipelines and test cases to ensure data integrity and quality
Develop, implement, and optimize data pipelines that integrate Amazon S3 for scalable data storage, retrieval, and processing within ETL workflows
Leverage Amazon S3 for data storage, retrieval, and management within ETL workflows, including the ability to write scripts for data transfer between S3 and other systems
Utilize Amazon S3's advanced features such as versioning, lifecycle policies, access controls, and server-side encryption to ensure secure and efficient data management
Write, maintain, and troubleshoot scripts or code (using PySpark, Shell, or similar languages) to automate data movement between Amazon S3 and other platforms, ensuring high performance and reliability
Collaborate with cross-functional teams to troubleshoot and resolve data-related issues, utilizing Amazon S3 features such as versioning, lifecycle policies, and access management
Document ETL processes, maintain technical documentation, and ensure best practices are followed for data stored in Amazon S3 environments
Familiarity with Hadoop or Spark is often preferred
Validate HiveQL, HDFS file structures, and data processing within the Hadoop cluster
Strong analytical and troubleshooting skills
Excellent communication for collaborating with developers and stakeholders
Knowledge in Metadata dependent ETL process and batch/job framework
Qualification
Required
Minimum 10 years of experience
Primary Skill: Amazon Data Engineer
Secondary Skills: AWS Data Engineer, Amazon S3, Shell Scripting, Autosys
Design, develop, and execute Data Pipelines and test cases to ensure data integrity and quality
Develop, implement, and optimize data pipelines that integrate Amazon S3 for scalable data storage, retrieval, and processing within ETL workflows
Leverage Amazon S3 for data storage, retrieval, and management within ETL workflows, including the ability to write scripts for data transfer between S3 and other systems
Utilize Amazon S3's advanced features such as versioning, lifecycle policies, access controls, and server-side encryption to ensure secure and efficient data management
Write, maintain, and troubleshoot scripts or code (using PySpark, Shell, or similar languages) to automate data movement between Amazon S3 and other platforms, ensuring high performance and reliability
Collaborate with cross-functional teams to troubleshoot and resolve data-related issues, utilizing Amazon S3 features such as versioning, lifecycle policies, and access management
Document ETL processes, maintain technical documentation, and ensure best practices are followed for data stored in Amazon S3 environments
Strong analytical and troubleshooting skills
Excellent communication for collaborating with developers and stakeholders
Knowledge in Metadata dependent ETL process and batch/job framework
Tools & Skills: Amazon S3, PySpark, SQL, Oracle
Preferred
Familiarity with Hadoop or Spark
Domain: Banking knowledge, Payment's knowledge preferred
Company
NuStar Technologies
NuStar Technologies provides staffing, recruiting, cloud enablement, ERP implementation, analytics, web solution, and managed services.
11-50 employees
H1B Sponsorship
NuStar Technologies has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2024 (1)
2023 (3)
2022 (1)
2020 (3)
Funding
Current Stage
Early StageCompany data provided by crunchbase