Tata Consultancy Services ยท 7 hours ago
Data Engineer
Tata Consultancy Services is a leading global IT services, consulting, and business solutions organization. They are seeking a Data Engineer to develop robust ETL processes, manage data pipelines, and implement microservices on Kubernetes. The role involves working with various programming languages and tools to ensure efficient data management and application performance.
Business Information SystemsConsultingInformation TechnologyIT Management
Responsibilities
Configure and troubleshoot authentication and authorization using Kerberos to secure access to Big Data systems like Hadoop, Spark, or specific databases. Implement security principles and role-based access in data environments
Perform basic database administration tasks such as performance monitoring, indexing, and query optimization on engines like SQL Server, PostgreSQL, Oracle, and Greenplum
Efficiently extract, transform, and load data between these heterogeneous databases
Develops, tests, and modifies software to enhance data platform and application efficiency. Provides technical support for issues
Actively participates in agile ceremonies, including program increment planning, daily standups, team backlog grooming, iteration retrospectives, team demos, and inspect & adapt sessions
Supports test and QA efforts on data projects and coordinates with data operations teams for production deployments
Possesses strong analytical, organizational, and problem-solving skills. Demonstrates the ability and desire to quickly learn new technologies and adapt to changing technology and priorities
Excellent verbal and written communication skills with both technical and non-technical staff. Capable of working independently, handling multiple concurrent projects, prioritizing effectively, and collaborating effectively within a team environment
Skilled at eliciting, gathering, analyzing user requirements, and interpreting, validating, and mapping business requirements to appropriate solutions
Able to meet deadlines
Qualification
Required
Solid understanding of search technology, real-time data pipeline construction, ETL processes, and various programming languages including Java and Python
Proficient with UNIX/Linux, scheduling, and orchestration tools
Expert in developing robust Python scripts for automating ETL tasks, data ingestion, cleansing, validation, and workflow orchestration
Experienced in implementing RESTful APIs in Python for data exposure and consumption
Skilled in using Python libraries (e.g., Pandas, NumPy, SQLAlchemy) for data manipulation and database connectivity
Design and deploy microservices and data applications on Kubernetes clusters, managing deployments, services, and autoscaling
Implement and manage CI/CD pipelines that automate the deployment of Docker images to Kubernetes environments
Create optimized Docker files to package data applications (Python scripts, ETL services) and their dependencies, ensuring consistent environments
Customize deployments using values.yaml in Helm for different environments (dev, QA, production)
Configure and troubleshoot authentication and authorization using Kerberos to secure access to Big Data systems like Hadoop, Spark, or specific databases
Implement security principles and role-based access in data environments
Perform basic database administration tasks such as performance monitoring, indexing, and query optimization on engines like SQL Server, PostgreSQL, Oracle, and Greenplum
Efficiently extract, transform, and load data between these heterogeneous databases
Requires a Bachelors in Computer Science, Computer Engineering or related field and some experience ADO/GIT, ETL, SQL, UNIX/Linux, Docker/Kubernetes, API Development, JSON, Kafka, Automated Testing, BDD, Big Data distributed systems, various programming languages like Java and Python, orchestration tools and processes or other directly related experience
Develops, tests, and modifies software to enhance data platform and application efficiency
Provides technical support for issues
Actively participates in agile ceremonies, including program increment planning, daily standups, team backlog grooming, iteration retrospectives, team demos, and inspect & adapt sessions
Supports test and QA efforts on data projects and coordinates with data operations teams for production deployments
Possesses strong analytical, organizational, and problem-solving skills
Demonstrates the ability and desire to quickly learn new technologies and adapt to changing technology and priorities
Excellent verbal and written communication skills with both technical and non-technical staff
Capable of working independently, handling multiple concurrent projects, prioritizing effectively, and collaborating effectively within a team environment
Skilled at eliciting, gathering, analyzing user requirements, and interpreting, validating, and mapping business requirements to appropriate solutions
Able to meet deadlines
BACHELOR OF COMPUTER SCIENCE
Preferred
Managerial exp is good to have
Company
Tata Consultancy Services
Tata Consultancy Services is a business solutions company that specializes on information technology services and consulting.
H1B Sponsorship
Tata Consultancy Services has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (7880)
2024 (9690)
2023 (8537)
2022 (11159)
2021 (9813)
2020 (11984)
Funding
Current Stage
Public CompanyTotal Funding
unknown2004-08-25IPO
Leadership Team
Recent News
2026-01-17
2026-01-17
2026-01-17
Company data provided by crunchbase