Apply on Employer Site

Matlen Silver · 17 hours ago

Hadoop Data Engineer

Charlotte, NC

Contract

Onsite

Senior Level

5+ years exp

Matlen Silver is actively seeking a talented and motivated Data Engineer/Feature Lead to join their dynamic and energetic team. The role involves designing and developing high-performance, scalable real-time data processing solutions, collaborating with cross-functional teams, and providing guidance to junior teammates.

Information TechnologyRecruitingStaffing Agency

H1B Sponsor Likely

Hiring Manager

Mrunal Patel

Responsibilities

Design and develop high-performance, scalable real-time data processing solutions using technologies like Kafka (KStreams, KTable), Spark Streaming, and Redis to handle massive data sets from multiple channels

Implement and optimize streaming data pipelines to process and analyze near real-time data, ensuring low-latency and high-throughput performance

Leverage expertise in Hadoop stack technologies, including HDFS, Spark, MapReduce, Yarn, Hive, Sqoop, Impala, and Hue, to design and optimize data processing workflows

Utilize NoSQL databases such as Redis to support real-time data storage and retrieval for mission-critical applications

Collaborate with cross-functional teams to identify system bottlenecks, benchmark performance, and propose innovative solutions to enhance system efficiency

Take ownership of defining Big Data and real-time data strategies and roadmaps for the Enterprise, aligning them with business objectives

Stay abreast of emerging technologies and industry trends related to Big Data and real-time data processing, continuously evaluating new tools and frameworks for potential integration

Provide guidance and mentorship to junior teammates, fostering a culture of technical excellence

Qualification

HadoopSparkKafkaNoSQL databasesPythonScalaJavaBash/Shell ScriptingDistributed systemsProblem-solving

Required

Bachelor's or Master's degree in Science or Engineering, or a related field

Minimum of 5 years of industry experience, with at least 3 years focused on hands-on work in Big Data and real-time data processing technologies

Strong expertise in Hadoop stack technologies, such as HDFS, Spark, Yarn, Hive, Sqoop, Impala, and Hue

Proficiency in real-time streaming technologies like Kafka (KStreams, KTable) and Spark Streaming

Strong knowledge of NoSQL databases like Redis, MongoDB, or HBase

Proficiency in programming languages such as Python, Scala, Java, and Bash/Shell Scripting

Excellent problem-solving abilities and the capability to deliver effective solutions for business-critical applications

Strong understanding of distributed systems, data partitioning, and fault-tolerant architectures

Company

Matlen Silver

Matlen Silver is a staffing agency for IT firms.

Founded in 1980

Somerville, New Jersey, USA

1001-5000 employees

https://www.matlensilver.com/

H1B Sponsorship

Matlen Silver has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (34)

2024 (10)

2023 (8)

2022 (8)

2021 (17)

2020 (35)