Be an early applicantLess than 25 applicants

Company

Original Job Post

Tata Consultancy Services · 3 days ago

Senior Data Engineer

Philadelphia, PA

Full-time

Hybrid

Senior Level

10+ years exp

Wonder how qualified you are to the job?

Maximize your interview chances

ConsultingInformation Services

H1B Sponsorship

Insider Connection @Tata Consultancy Services

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Hands-on architecture/development of ETL pipelines using an internal framework written in Java.

Hands-on architecture of real-time REST APIs or other solutions for streaming data using Spark.

Interpret data, analyze results using statistical techniques, and provide ongoing reports.

Develop and implement databases, data collection systems, data analytics, and strategies to optimize efficiency and quality.

Acquire data from primary or secondary sources, maintain databases/data systems.

Identify, analyze, and interpret trends or patterns in complex data sets.

Filter and clean data by reviewing reports and performance indicators to locate and correct issues.

Work with management to prioritize business and information needs.

Identify new process improvement opportunities.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

JavaScalaSparkPythonBig DataKafkaAWSOracle SQLHive SQLDatabricksJenkinsREST APIsData analysisDatabase implementationData collectionData optimizationData maintenanceStatistical analysisTrend analysisData cleaningProcess improvementSpark architectureHadoop architectureProblem-solvingAnalyticalCommunicationInterpersonalTeam player

Required

10-12 years of relevant experience

Hands-on architecture/development of ETL pipelines using Java

Experience with Scala Spark, Python, Big Data, Kafka, AWS, Oracle SQL, Hive SQL, Databricks, and Jenkins

Hands-on architecture of real-time REST APIs or other solutions for streaming data using Spark

Interpreting data, analyzing results using statistical techniques, and providing ongoing reports

Developing and implementing databases, data collection systems, data analytics, and other strategies for optimization

Experienced with Databricks

Acquiring data from primary or secondary data sources and maintaining databases/data systems

Identifying, analyzing, and interpreting trends or patterns in complex data sets

Filtering and cleaning data by reviewing reports and performance indicators to locate and correct problems

Working with management to prioritize business and information needs

Locating and defining new process improvement opportunities

Motivated team player with excellent communication, interpersonal, analytical, and problem-solving skills

Good knowledge of Spark and Hadoop Architecture

Company

Tata Consultancy Services

Glassdoor

3.8

Tata Consultancy Services is a multinational information technology services, business solutions and consulting company based in India.

Founded in 1968

Mumbai, Maharashtra, IND

10,001+ employees

http://www.tcs.com

H1B Sponsorship

Tata Consultancy Services has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Trends of Total Sponsorships

2023 (6766)

2022 (10550)

2021 (11696)

2020 (10701)