Tata Consultancy Services · 1 day ago
Pyspark Engineer
Irving, TX
Full-time
Onsite
Mid, Senior Level
$90K/yr - $120K/yr
5+ years expTata Consultancy Services is seeking a Pyspark Engineer to design, develop, and maintain scalable data pipelines. The role involves optimizing data workflows and ensuring data integrity for business intelligence, requiring strong experience in Apache Spark and PySpark.
Business Information SystemsConsultingInformation TechnologyIT Management
Responsibilities
Onsite role with strong experience in Apache Spark framework including good understanding of core concepts, performance optimization and industry best practices
Proficient in PySpark with hands-on coding experience and ability to implement complex business level transformations
Collaborate with the stakeholders and analysts to understand data requirement and deliver robust, creative and innovative solutions
Familiarity with unit testing, object-oriented programming (OOPS) concepts and interpreting test results
Proficient to write complex and efficient SQL queries to extract the business critical insights from large-scale data
Experience with scheduling of the transformation jobs as per business requirement
Perform root-cause analysis and troubleshoot errors on data pipelines, evaluating data quality issues, and implementing corrective fixes
Qualification
Required
PySpark Developer with 5-10 years experience in data engineering practice
Strong experience in Apache Spark framework including good understanding of core concepts, performance optimization and industry best practices
Proficient in PySpark with hands-on coding experience and ability to implement complex business level transformations
Collaborate with the stakeholders and analysts to understand data requirement and deliver robust, creative and innovative solutions
Familiarity with unit testing, object-oriented programming (OOPS) concepts and interpreting test results
Proficient to write complex and efficient SQL queries to extract the business critical insights from large-scale data
Experience with scheduling of the transformation jobs as per business requirement
Perform root-cause analysis and troubleshoot errors on data pipelines, evaluating data quality issues, and implementing corrective fixes
BACHELOR OF COMPUTER SCIENCE
Company
Tata Consultancy Services
Tata Consultancy Services is a business solutions company that specializes on information technology services and consulting.
10001+ employees
H1B Sponsorship
Tata Consultancy Services has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (7880)
2024 (9690)
2023 (8537)
2022 (11159)
2021 (9813)
2020 (11984)
Funding
Current Stage
Public CompanyTotal Funding
unknown2004-08-25IPO
Leadership Team
K. Krithivasan
Chief Executive Officer & Managing Director
Aarthi Subramanian
President and Chief Operating Officer
Recent News
2026-01-25
Business Standard India
2026-01-25
Company data provided by crunchbase