Tata Consultancy Services · 7 hours ago
Hadoop Data Engineer
Tata Consultancy Services is a leading global IT services company, and they are seeking a Hadoop Data Engineer. The role involves designing and implementing data pipelines, optimizing data ingestion processes, and collaborating with data scientists to ensure high-quality datasets for machine learning models.
Business Information SystemsConsultingInformation TechnologyIT Management
Responsibilities
Design and implement scalable batch and/or streaming data pipelines using Hadoop ecosystem tools
Develop and optimize data ingestion processes from multiple sources (RDBMS, files, APIs, logs)
Build and maintain datasets in HDFS/Hive and ensure data quality, lineage, and governance
Perform performance tuning for distributed workloads (partitioning, file formats, resource management)
Create and optimize complex queries, stored procedures, and ETL workflows in MS SQL Server
Collaborate with data scientists/analysts to deliver feature-ready datasets for ML models
Implement monitoring and alerting for pipeline health and data SLAs
Document architecture, workflows, data dictionaries, and operational runbooks
Support production deployments, incident triage, and root cause analysis
Qualification
Required
Strong hands-on experience with Hadoop components (e.g., HDFS, Hive, YARN, MapReduce/Spark)
Experience with data modeling and data warehousing concepts
Solid proficiency in MS SQL Server (T-SQL, query optimization, indexing, stored procedures)
Experience with ETL/ELT design patterns and job scheduling (e.g., Oozie/Airflow/Control-M)
Strong understanding of distributed computing concepts and performance tuning
Familiarity with Python/Scala/Java for data processing (any one preferred)
Bachelor's degree in Computer Science, Engineering, or equivalent experience
Minimum 10 years of experience
Benefits
Discretionary Annual Incentive.
Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
Family Support: Maternal & Parental Leaves.
Insurance Options: Auto & Home Insurance, Identity Theft Protection.
Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
Time Off: Vacation, Time Off, Sick Leave & Holidays.
Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
Company
Tata Consultancy Services
Tata Consultancy Services is a business solutions company that specializes on information technology services and consulting.
H1B Sponsorship
Tata Consultancy Services has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (7880)
2024 (9690)
2023 (8537)
2022 (11159)
2021 (9813)
2020 (11984)
Funding
Current Stage
Public CompanyTotal Funding
unknown2004-08-25IPO
Leadership Team
Recent News
2026-01-25
Business Standard India
2026-01-25
Company data provided by crunchbase