Cynet Systems · 2 months ago
Big Data Platform Support Engineer
Reston, VA
Full-time
Onsite
Senior Level, Lead/Staff
8+ years expCynet Systems is a company focused on providing innovative solutions, and they are seeking a Big Data Platform Support Engineer to lead the design, development, and support of large-scale data platforms. The role involves ensuring high performance and reliability of data pipelines while mentoring junior engineers and collaborating with cross-functional teams.
EmploymentRecruitingStaffing Agency
Responsibilities
Lead a team of software engineers in the design, development, and implementation of multiple applications
Perform detailed technical design, coding, code reviews, and testing of new and existing applications
Serve as a subject matter expert for specified systems and ensure compliance with DevSecOps practices and policies
Identify gaps in requirements and develop solutions to improve system performance and availability
Lead evaluations of risk, opportunities, and technology integration across projects
Support the Project Manager as the technical lead, estimating technical costs and defining system requirements
Participate in architectural planning, roadmap discussions, and transformation initiatives to new software architectures
Extend open-source libraries and systems to meet team requirements
Ensure adherence to code quality, deployment standards, and practices
Mentor junior developers and foster a culture of continuous improvement
Qualification
Required
8 years of software design, development, testing, and requirements management
Strong experience supporting Cloudera applications running in cloud environments
Hands-on experience with Cloudera Manager for monitoring and maintaining production clusters
Expertise in writing shell scripts for Hadoop daemon service health checks and automation tasks
Experience working with Hive, Impala, HBase, and SOLR, including query optimization and database management
Proficient in coordinating with application development, security, and platform teams for configuration and performance enhancements
Cloudera administration and optimization (CDP, CDSW, Hive, Spark, NiFi)
Cloud application support with MongoDB
Experience in cloud disaster recovery strategies
Strong Kafka administration and troubleshooting, including Streams API, integration with MQ, topic/offset management, and broker management
Apache NiFi administration, registry management, and integration with Kafka, HBase, and Solr
HBase administration, troubleshooting, and database management
Solr administration, managing shards, collections, logging levels, and query optimization
Flume integration with Kafka, NiFi, and IBM MQ
Bachelor's degree in Information Technology or Computer Science
In lieu of a degree, an additional 4 years of relevant work experience is required
Preferred
Perform critical data migrations from CDH to CDP
Design and implement big data pipelines and automated data flows using Python/R and NiFi
Perform incremental updates and upgrades to Cloudera environments
Manage job workflows using Oozie and Hue
Implement security policies across Hadoop clusters using Ranger
Configure and manage Cloudera Data Science Workbench (CDSW)
Troubleshoot Kerberos, TLS/SSL, and model-related issues
Support Big Data/Hadoop databases through all development and production phases
Optimize database performance, troubleshoot replication, and manage connectivity/security issues
Create and implement automation scripts for maintenance and monitoring
Experience with Kafka ecosystem (Brokers, Connect, Zookeeper) in production environments
Support streaming technologies including Kafka, Spark, and Kudu
Company
Cynet Systems
Headquartered in Washington DC Metro Area, Cynet Systems is a top talent supplier for companies across North America.
1001-5000 employees
Funding
Current Stage
Late StageLeadership Team
Ashwani (Ash) M.
Partner and Co-CEO
Nikhil "Nick" Budhiraja
Founder / Co-CEO
Company data provided by crunchbase