Tekshapers ยท 4 hours ago
Big Data Specialist
Tekshapers is seeking a skilled Big Data Engineer with strong experience in Hadoop, PySpark, Python, and Apache Kafka. The ideal candidate will design, develop, and maintain scalable data processing systems while collaborating with cross-functional teams to deliver high-quality data solutions.
Responsibilities
Design, develop, and optimize big data pipelines using Hadoop ecosystem and Apache Spark (PySpark)
Build and maintain real-time data streaming solutions using Apache Kafka
Develop efficient, reusable, and scalable code using Python
Process and transform large volumes of structured and unstructured data
Ensure data quality, reliability, and performance of data pipelines
Collaborate with data scientists, analysts, and application teams to support analytics and business needs
Monitor, troubleshoot, and optimize data workflows and system performance
Implement best practices for data security, governance, and compliance
Qualification
Required
Strong experience with Hadoop (HDFS, YARN, Hive, HBase, etc.)
Hands-on experience with Apache Spark / PySpark for batch and large-scale data processing
Proficiency in Python for data engineering and automation
Experience with Apache Kafka for real-time data streaming and messaging
Solid understanding of ETL/ELT processes and data modeling
Experience working with Linux/Unix environments
Knowledge of SQL and relational/non-relational databases
Company
Tekshapers
Tekshapers was founded in 2009, an MI, USA based Information Technology Company and our primary objective is to provide sophisticated business solutions to a group of companies worldwide.
H1B Sponsorship
Tekshapers has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (25)
2024 (15)
2023 (12)
2022 (27)
2021 (10)
2020 (13)
Funding
Current Stage
Late StageCompany data provided by crunchbase