Tata Consultancy Services · 19 hours ago
Amazon S3 Engineer
Charlotte, NC
Full-time
Onsite
Senior Level, Lead/Staff
$120K/yr - $130K/yr
10+ years expTata Consultancy Services is seeking an Amazon S3 Engineer to design and optimize data pipelines. The role involves leveraging Amazon S3 for data management and collaborating with teams to ensure data integrity and quality.
Business Information SystemsConsultingInformation TechnologyIT Management
Responsibilities
Design, develop, and execute Data Pipelines and test cases to ensure data integrity and quality
Develop, implement, and optimize data pipelines that integrate Amazon S3 for scalable data storage, retrieval, and processing within ETL workflows
Leverage Amazon S3 for data storage, retrieval, and management within ETL workflows, including the ability to write scripts for data transfer between S3 and other systems
Utilize Amazon S3's advanced features such as versioning, lifecycle policies, access controls, and server-side encryption to ensure secure and efficient data management
Write, maintain, and troubleshoot scripts or code (using PySpark, Shell, or similar languages) to automate data movement between Amazon S3 and other platforms, ensuring high performance and reliability
Collaborate with cross-functional teams to troubleshoot and resolve data-related issues, utilizing Amazon S3 features such as versioning, lifecycle policies, and access management
Document ETL processes, maintain technical documentation, and ensure best practices are followed for data stored in Amazon S3 environments
Familiarity with Hadoop or Spark is often preferred
Validate HiveQL, HDFS file structures, and data processing within the Hadoop cluster
Strong analytical and troubleshooting skills
Excellent communication for collaborating with developers and stakeholders
Knowledge in Metadata dependent ETL process and batch/job framework
Qualification
Required
Minimum 10 years of experience
Primary Skill: Amazon Data Engineer
Secondary Skills: AWS Data Engineer, Amazon S3, Shell Scripting, Autosys
Design, develop, and execute Data Pipelines and test cases to ensure data integrity and quality
Develop, implement, and optimize data pipelines that integrate Amazon S3 for scalable data storage, retrieval, and processing within ETL workflows
Leverage Amazon S3 for data storage, retrieval, and management within ETL workflows, including the ability to write scripts for data transfer between S3 and other systems
Utilize Amazon S3's advanced features such as versioning, lifecycle policies, access controls, and server-side encryption to ensure secure and efficient data management
Write, maintain, and troubleshoot scripts or code (using PySpark, Shell, or similar languages) to automate data movement between Amazon S3 and other platforms, ensuring high performance and reliability
Collaborate with cross-functional teams to troubleshoot and resolve data-related issues, utilizing Amazon S3 features such as versioning, lifecycle policies, and access management
Document ETL processes, maintain technical documentation, and ensure best practices are followed for data stored in Amazon S3 environments
Strong analytical and troubleshooting skills
Excellent communication for collaborating with developers and stakeholders
Knowledge in Metadata dependent ETL process and batch/job framework
Tools & Skills: Amazon S3, PySpark, SQL, Oracle
Preferred
Familiarity with Hadoop or Spark
Domain: Banking knowledge, Payment's knowledge
Company
Tata Consultancy Services
Tata Consultancy Services is a business solutions company that specializes on information technology services and consulting.
10001+ employees
H1B Sponsorship
Tata Consultancy Services has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (7880)
2024 (9690)
2023 (8537)
2022 (11159)
2021 (9813)
2020 (11984)
Funding
Current Stage
Public CompanyTotal Funding
unknown2004-08-25IPO
Leadership Team
K. Krithivasan
Chief Executive Officer & Managing Director
Aarthi Subramanian
President and Chief Operating Officer
Recent News
2026-01-25
Business Standard India
2026-01-25
Company data provided by crunchbase