Hadoop Administrator jobs in United States
cer-icon
Apply on Employer Site
company-logo

Cynet Systems · 1 week ago

Hadoop Administrator

Cynet Systems is seeking a Hadoop Administrator responsible for managing, monitoring, and optimizing MapR-based Hadoop clusters in a production environment. This role ensures high availability, performance, security, and compliance while supporting data engineering and analytics teams through efficient cluster operations and automation.

EmploymentRecruitingStaffing Agency
check
Growth Opportunities

Responsibilities

Manage, monitor, and optimize MapR-based Hadoop clusters in a production environment
Perform daily cluster operations including health checks, performance tuning, capacity planning, and system upgrades
Install, configure, patch, and upgrade MapR distributions and ecosystem tools
Configure and support multi-tenant environments ensuring isolation, fair resource usage, and performance SLAs
Manage YARN queues, ACLs, quotas, and tenant-specific security policies
Collaborate with data engineering and analytics teams to onboard new tenants and align resource requirements
Diagnose and resolve performance issues, bottlenecks, and failures across MapR-FS, YARN, Spark, Hive, Kafka, and related services
Handle node failures, job failures, and cluster rebalancing while maintaining uptime
Implement and manage monitoring, alerting, and reporting using tools such as MapR Control System, Grafana, Nagios, Prometheus, or similar
Implement and manage security controls including Kerberos, SSL encryption, user and role management, and policy enforcement
Ensure compliance with internal and external data governance and security standards
Maintain backup, disaster recovery, and high availability strategies using MapR snapshots, mirrors, and failover configurations
Support 24/7 production availability and participate in on-call rotations
Develop and maintain automation using Python, Shell scripting, or Ansible to streamline operations
Improve cluster provisioning, monitoring, and deployment pipelines through automation

Qualification

Hadoop administrationMapR administrationLinux administrationAutomationScriptingPerformance tuningSecurity managementCollaboration skillsCommunication skills

Required

Hands-on experience as a Hadoop or MapR Administrator
Strong knowledge of MapR-FS, MapR-DB, MapR Streams, YARN, Hive, Spark, and Kafka
Experience managing high-availability production Hadoop clusters
Proficiency in Linux administration
Experience with multi-tenant Hadoop environments and resource governance
Strong scripting, automation, and performance tuning skills
Experience with monitoring tools such as Grafana, Nagios, Prometheus, or MapR Control System
Solid understanding of Hadoop security including Kerberos, SSL, ACLs, and directory integrations
Bachelor's degree in Computer Science, Information Technology, or a related field, or equivalent professional experience

Preferred

Experience migrating from MapR to other Hadoop distributions
Knowledge of cloud-based big data services
Exposure to CI/CD pipelines, DevOps tools, or containerized big data workloads

Company

Cynet Systems

twittertwitter
company-logo
Headquartered in Washington DC Metro Area, Cynet Systems is a top talent supplier for companies across North America.

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Ashwani (Ash) M.
Partner and Co-CEO
linkedin
leader-logo
Nikhil "Nick" Budhiraja
Founder / Co-CEO
linkedin
Company data provided by crunchbase