Hadoop Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Tata Consultancy Services · 7 hours ago

Hadoop Data Engineer

Tata Consultancy Services is a leading global IT services company, and they are seeking a Hadoop Data Engineer. The role involves designing and implementing data pipelines, optimizing data ingestion processes, and collaborating with data scientists to ensure high-quality datasets for machine learning models.

Business Information SystemsConsultingInformation TechnologyIT Management
check
H1B Sponsor Likelynote

Responsibilities

Design and implement scalable batch and/or streaming data pipelines using Hadoop ecosystem tools
Develop and optimize data ingestion processes from multiple sources (RDBMS, files, APIs, logs)
Build and maintain datasets in HDFS/Hive and ensure data quality, lineage, and governance
Perform performance tuning for distributed workloads (partitioning, file formats, resource management)
Create and optimize complex queries, stored procedures, and ETL workflows in MS SQL Server
Collaborate with data scientists/analysts to deliver feature-ready datasets for ML models
Implement monitoring and alerting for pipeline health and data SLAs
Document architecture, workflows, data dictionaries, and operational runbooks
Support production deployments, incident triage, and root cause analysis

Qualification

HadoopBig Data ETL/ELTMS SQL ServerDistributed ProcessingArtificial IntelligenceData ModelingData WarehousingPerformance TuningPython/Scala/Java

Required

Strong hands-on experience with Hadoop components (e.g., HDFS, Hive, YARN, MapReduce/Spark)
Experience with data modeling and data warehousing concepts
Solid proficiency in MS SQL Server (T-SQL, query optimization, indexing, stored procedures)
Experience with ETL/ELT design patterns and job scheduling (e.g., Oozie/Airflow/Control-M)
Strong understanding of distributed computing concepts and performance tuning
Familiarity with Python/Scala/Java for data processing (any one preferred)
Bachelor's degree in Computer Science, Engineering, or equivalent experience
Minimum 10 years of experience

Benefits

Discretionary Annual Incentive.
Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
Family Support: Maternal & Parental Leaves.
Insurance Options: Auto & Home Insurance, Identity Theft Protection.
Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
Time Off: Vacation, Time Off, Sick Leave & Holidays.
Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Company

Tata Consultancy Services

company-logo
Tata Consultancy Services is a business solutions company that specializes on information technology services and consulting.

H1B Sponsorship

Tata Consultancy Services has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (7880)
2024 (9690)
2023 (8537)
2022 (11159)
2021 (9813)
2020 (11984)

Funding

Current Stage
Public Company
Total Funding
unknown
2004-08-25IPO

Leadership Team

leader-logo
K. Krithivasan
Chief Executive Officer & Managing Director
linkedin
leader-logo
Aarthi Subramanian
President and Chief Operating Officer
Company data provided by crunchbase