Orion Innovation · 1 day ago
Big Data Engineer
Edison, NJ
Full-time
Hybrid
Entry Level
1+ years expOrion Innovation is a premier, award-winning, global business and technology services firm. The Big Data Engineer will be responsible for designing and implementing big data pipelines, optimizing API performance, and developing data processing solutions using various technologies.
Big DataCloud ComputingInformation Technology
Responsibilities
Requirement analysis, requirement gathering, design, business impact analysis, gap analysis, estimation, development, testing, coding, code review, unit testing and deployment of the application
Design, build, install, configure, and support Hadoop (Big Data)
Design and implement big data pipelines to ingest and process data in real-time and monitor for data miss or error in progress to ensure that data reaches the end system
Measure the performance of various APIs and implement optimization on slow services to enhance the responsiveness of the system
Deliver functional enhancements to the existing big data applications
Provide inputs on solution architecture based on evaluation/understanding of solution alternatives, frameworks, and products
Develop Hadoop batch jobs for data extraction from multiple unstructured and structured data sources for populating into various repositories (Hadoop, Neo4J, MongoDB, Apache SOLR)
Interact with clients to elicit architectural and non-functional requirements such as performance, scalability, reliability, availability, maintainability
Participate in designing the data model structured data in RDBMS into a graph database solution and NoSQL database solution
Develop near real-time data processing solutions using Kafka and Spark Streaming
Participate in designing Spark architecture with Databricks and Structured Streaming
Set up Microsoft Azure with Databricks, and Databricks Workspace for business analytics
Contribute to the automate build process by using Jenkins and Ansible to achieve continuous integration and continuous deployment
Qualification
Required
Master's in Computer Science/Applications, Information Technology/Systems or Electronics/Electrical Engineering
Minimum 1 year experience as Big Data Engineer, Data Engineer, Data Engineering Specialist, Data Warehousing Analyst or related occupation
Must be willing to travel/relocate to anywhere in the US
Company
Orion Innovation
Orion Innovation is an IT services and solutions provider helping organizations with Digital Transformation services.
5001-10000 employees
H1B Sponsorship
Orion Innovation has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (123)
2024 (74)
2023 (90)
2022 (138)
2021 (185)
2020 (226)
Funding
Current Stage
Late StageTotal Funding
unknown2018-10-22Acquired
2015-01-07Undisclosed
Leadership Team
Brian Bronson
Chief Executive Officer
Rajul Rana
Chief Technology Officer
Recent News
2025-10-21
Company data provided by crunchbase