Big data developer jobs in United States
cer-icon
Apply on Employer Site
company-logo

RIT Solutions, Inc. ยท 3 months ago

Big data developer

positionCharlotte, NC
timeFull-time
remoteOnsite
seniorityMid Level

RIT Solutions, Inc. is seeking a Big Data Developer to design and implement scalable data ingestion and transformation pipelines. The role involves building and managing data streaming pipelines, collaborating with data teams, and ensuring the security and reliability of data engineering components.

Staffing & Recruiting
check
H1B Sponsor Likelynote

Responsibilities

Design and implement scalable data ingestion and transformation pipelines using PySpark or Scala, Hadoop, Hive, and Dremio
Build and manage Kafka batch pipelines for reliable data streaming and integration
Work with on-prem Hadoop ecosystems (Cloudera, Hortonworks, MapR) or cloud-native big data platforms
Develop and maintain RESTful APIs using Python (FastAPI, Flask, or Django) to expose data and services
Collaborate with data scientists, ML engineers, and platform teams to ensure seamless data flow and system performance
Monitor, troubleshoot, and optimize production data pipelines and services
Ensure security, scalability, and reliability across all data engineering components
(Optional but valuable) Contribute to the design and deployment of AI-driven RAG systems for enterprise use cases

Qualification

HadoopPySparkKafkaREST API developmentBig Data EngineeringCloud platformsAIRAG architecturesCommunication skillsProblem-solving skillsCollaboration skills

Required

Experience in Big Data Engineering
Strong hands-on experience with PySpark or Scala
Deep expertise in on-prem Hadoop distributions (Cloudera, Hortonworks, MapR) or cloud-based big data platforms
Proficiency in Kafka batch processing, Hive, and Dremio
Solid understanding of REST API development using Python frameworks
Familiarity with cloud platforms (GCP, AWS, or Azure)
Excellent problem-solving, communication, and collaboration skills

Preferred

Experience or exposure to AI and RAG architectures is a plus
Contribute to the design and deployment of AI-driven RAG systems for enterprise use cases

Company

RIT Solutions, Inc.

twitter
company-logo
Jobdiva Job Portal: https://www1.jobdiva.com/candidates/myjobs/searchjobsdone.jsp?a=xbjdnwgjodtga1y1im2g881fkkeiwd0775lbvq8yqgps8vb2q36w2vj1ga6xxork&compid=-1 Recruitment (contingency search and campus selection).
location
Arlington, Virginia, US
people-size201-500 employees
web-link
http://www.ritsolinc.com

H1B Sponsorship

RIT Solutions, Inc. has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2023 (2)

Funding

Current Stage
Growth Stage
Company data provided by crunchbase