The Dignify Solutions, LLC · 1 month ago
Streamsets Developer
Jersey City, NJ
Full-time
Onsite
Senior Level
5+ years expThe Dignify Solutions, LLC is seeking a StreamSets Developer with extensive Big Data experience. The role involves designing, developing, deploying, and troubleshooting StreamSets pipelines within various environments, ensuring efficient data flow into Hadoop systems.
Bookkeeping and PayrollHuman ResourcesRecruitingStaffing AgencyTraining
Responsibilities
At least 5+ years Big Data experience with hands-on experience in designing, developing, deploying and troubleshooting StreamSets pipelines within Big Data Eco-Systems
Experience using the StreamSets Data Collector to design, test, deploy, operate, and maintain pipelines that flow streaming and batch data into Hadoop
Must have worked on the development and deployment of StreamSets pipelines within the customers Cloud or On Premise environments
Solid working understanding of Big Data ETL solutions
Experience in Hadoop Ecosystem development including HDFS, Hive, Hive QL, Spark, YARN, Sqoop, Scala
Experience in handling different file formats like Parquet, Avro, ORC, Text files
Strong analytical and design skills, including the ability to understand business requirements and translate them into efficient and effective technical designs that work well within large-scale, well-structured enterprise environments
Excellent trouble-shooting skills, with the ability to quickly identify and document the root cause of issues, and effectively communicate possible resolutions
Aptitude and desire for learning new technologies
Qualification
Required
At least 5+ years Big Data experience with hands-on experience in designing, developing, deploying and troubleshooting StreamSets pipelines within Big Data Eco-Systems
Experience using the StreamSets Data Collector to design, test, deploy, operate, and maintain pipelines that flow streaming and batch data into Hadoop
Must have worked on the development and deployment of StreamSets pipelines within the customers Cloud or On Premise environments
Solid working understanding of Big Data ETL solutions
Experience in Hadoop Ecosystem development including HDFS, Hive, Hive QL, Spark, YARN, Sqoop, Scala
Experience in handling different file formats like Parquet, Avro, ORC, Text files
Strong analytical and design skills, including the ability to understand business requirements and translate them into efficient and effective technical designs that work well within large-scale, well-structured enterprise environments
Excellent trouble-shooting skills, with the ability to quickly identify and document the root cause of issues, and effectively communicate possible resolutions
Aptitude and desire for learning new technologies
Primary Skill: APEX, Clear Case, Maven, Object-Oriented, SASS
Company
The Dignify Solutions, LLC
The Dignify Solutions with Global Capabilities and Local Excellence – has combined experience of 30 +years in Client Services/ Engagement/ Relationship/ Partnership, Sales/ Account Management, Service Delivery, Recruiting, Staffing and Talent Acquisition for the whole gamut of skillsets in Information Technology (Digital Transformation, Artificial Intelligence, Machine Learning and other business domains).
51-200 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase