Cynet Systems · 1 week ago
Hadoop Administrator
Cynet Systems is seeking a Hadoop Administrator responsible for managing, monitoring, and optimizing MapR-based Hadoop clusters in a production environment. This role ensures high availability, performance, security, and compliance while supporting data engineering and analytics teams through efficient cluster operations and automation.
EmploymentRecruitingStaffing Agency
Responsibilities
Manage, monitor, and optimize MapR-based Hadoop clusters in a production environment
Perform daily cluster operations including health checks, performance tuning, capacity planning, and system upgrades
Install, configure, patch, and upgrade MapR distributions and ecosystem tools
Configure and support multi-tenant environments ensuring isolation, fair resource usage, and performance SLAs
Manage YARN queues, ACLs, quotas, and tenant-specific security policies
Collaborate with data engineering and analytics teams to onboard new tenants and align resource requirements
Diagnose and resolve performance issues, bottlenecks, and failures across MapR-FS, YARN, Spark, Hive, Kafka, and related services
Handle node failures, job failures, and cluster rebalancing while maintaining uptime
Implement and manage monitoring, alerting, and reporting using tools such as MapR Control System, Grafana, Nagios, Prometheus, or similar
Implement and manage security controls including Kerberos, SSL encryption, user and role management, and policy enforcement
Ensure compliance with internal and external data governance and security standards
Maintain backup, disaster recovery, and high availability strategies using MapR snapshots, mirrors, and failover configurations
Support 24/7 production availability and participate in on-call rotations
Develop and maintain automation using Python, Shell scripting, or Ansible to streamline operations
Improve cluster provisioning, monitoring, and deployment pipelines through automation
Qualification
Required
Hands-on experience as a Hadoop or MapR Administrator
Strong knowledge of MapR-FS, MapR-DB, MapR Streams, YARN, Hive, Spark, and Kafka
Experience managing high-availability production Hadoop clusters
Proficiency in Linux administration
Experience with multi-tenant Hadoop environments and resource governance
Strong scripting, automation, and performance tuning skills
Experience with monitoring tools such as Grafana, Nagios, Prometheus, or MapR Control System
Solid understanding of Hadoop security including Kerberos, SSL, ACLs, and directory integrations
Bachelor's degree in Computer Science, Information Technology, or a related field, or equivalent professional experience
Preferred
Experience migrating from MapR to other Hadoop distributions
Knowledge of cloud-based big data services
Exposure to CI/CD pipelines, DevOps tools, or containerized big data workloads