Collabera · 4 hours ago
Data Engineer
Chicago, IL
Contract
Onsite
Mid Level
$70/hr - $73/hrCollabera is a global leader in talent solutions, and they are seeking a Hadoop Data Engineer to join their client’s team on a contract basis. This role involves designing, developing, and maintaining data pipelines using various Big Data frameworks while ensuring data integrity and performance.
ConsultingInformation ServicesInformation Technology
Hiring Manager
Abhishek Tomar
Responsibilities
Design, develop, and maintain batch and near-real-time data pipelines using Spark Structured Streaming, MapReduce, and other Big Data frameworks
Ingest data from multiple sources such as message queues (Kafka), file shares, REST APIs, and relational databases
Transform, clean, and validate data in HDFS, Hive, Impala, or Spark SQL
Convert and manage data in formats like JSON, CSV, XML to support downstream analytics
Perform data validation, profiling, and analysis to identify anomalies and ensure data integrity
Troubleshoot issues in data pipelines, SQL jobs, or Spark applications, including slow-running jobs or failures
Qualification
Required
Strong SQL Skills - one or more of MySQL, HIVE, Impala, SPARK SQL
Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json, csv, xml
Experience working with SPARK Structured steaming
Experience working with Hadoop/Big Data and Distributed Systems
Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc
Hands on programming experience in at least one of Scala, Python, PHP
Benefits
Medical insurance
Dental insurance
Vision insurance
401(k) retirement plan
Life insurance
Long-term disability insurance
Short-term disability insurance
Paid parking/public transportation
Paid time off
Paid sick and safe time
Hours of paid vacation time
Weeks of paid parental leave
Paid holidays annually - AS Applicable
Company
Collabera
Collabera is an end-to-end information technology services and solutions provider helping clients align their business and IT strategies.
Founded in 1991
10001+ employees
H1B Sponsorship
Collabera has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (141)
2024 (93)
2023 (120)
2022 (186)
2021 (180)
2020 (146)
Funding
Current Stage
Late StageTotal Funding
$30M2006-05-04Series Unknown· $30M
Leadership Team
Lalit Sharma
CFO
Michael H. Abraham
Chief Financial Officer
Recent News
2024-04-09
2023-01-20
2022-04-19
Company data provided by crunchbase