Hadoop Administrator jobs in United States
cer-icon
Apply on Employer Site
company-logo

Capgemini · 8 hours ago

Hadoop Administrator

Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world. They are seeking an experienced Hadoop Administrator to manage and support production-grade MapR Hadoop clusters, ensuring high availability, performance, and security across diverse workloads.

ConsultingInformation TechnologyInsurTechIT ManagementSoftware
check
H1B Sponsor Likelynote

Responsibilities

Manage, monitor, and optimize MapR-based Hadoop clusters in a production environment
Oversee daily operations, including cluster health checks, performance tuning, capacity planning, and system upgrades
Perform installation, configuration, patching, and version upgrades for MapR distributions and ecosystem tools
Configure, support, and optimize multi-tenant setups, ensuring isolation, resource fairness, and performance SLAs
Manage YARN queues, ACLs, quotas, and security policies per tenant requirements
Collaborate with data engineering and analytics teams to onboard new tenants and align resource needs
Diagnose and resolve cluster performance issues, bottlenecks, and failures across MapR FS, YARN, Spark, Hive, Kafka, and related services
Manage node failures, job failures, and cluster rebalancing while maintaining uptime
Automate alerting, monitoring, and reporting using tools like MapR Control System (MCS), Grafana, Nagios, Prometheus, or similar
Implement and manage security features such as Kerberos, Ranger/Sentry policies, SSL encryption, and user/role management
Ensure compliance with internal and external standards for data governance and security
Maintain reliable backup and DR strategies using MapR snapshots, mirrors, and failover configurations
Ensure 24/7 availability of production environments and participate in on-call rotation
Develop automation for operational tasks using Python, Shell scripting, or Ansible
Streamline cluster provisioning, monitoring, and deployment pipelines

Qualification

Hadoop AdministrationMapRLinux AdministrationPerformance TuningMulti-Tenant ManagementAutomationMonitoring ToolsHadoop SecurityShell ScriptingPythonAnsibleCloud Services

Required

4+ years of hands-on experience as a Hadoop/MapR Administrator
Strong knowledge of MapR-FS, MapR-DB, MapR Streams, YARN, Hive, Spark, and Kafka
Experience managing production clusters with high availability requirements
Proficiency in Linux administration (RHEL/CentOS/Ubuntu)
Expertise with multi-tenant Hadoop environments, resource governance, and user management
Strong skills in shell scripting, automation, and performance tuning
Experience with monitoring tools (Grafana, Nagios, Prometheus, MapR MCS)
Understanding of Hadoop security (Kerberos, SSL, ACLs, AD integration)

Preferred

Experience migrating from MapR to other Hadoop distributions (Cloudera, Hortonworks) - a plus
Knowledge of Cloud (AWS/Azure/GCP) big data services
Experience with CI/CD pipelines, DevOps tools, or containerized big data workloads

Benefits

Flexible work
Healthcare including dental, vision, mental health, and well-being programs
Financial well-being programs such as 401(k) and Employee Share Ownership Plan
Paid time off and paid holidays
Paid parental leave
Family building benefits like adoption assistance, surrogacy, and cryopreservation
Social well-being benefits like subsidized back-up child/elder care and tutoring
Mentoring, coaching and learning programs
Employee Resource Groups
Disaster Relief
Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
Life and disability insurance
Employee assistance programs

Company

Capgemini

company-logo
Capgemini is a software company that provides consulting, technology, and digital transformation services.

H1B Sponsorship

Capgemini has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2856)
2024 (3012)
2023 (3424)
2022 (4392)
2021 (3311)
2020 (5871)

Funding

Current Stage
Public Company
Total Funding
$4.72B
2025-09-18Post Ipo Debt· $4.72B
1999-04-01IPO

Leadership Team

leader-logo
Aiman Ezzat
CEO, Capgemini Group
linkedin
leader-logo
Anirban Bose
CEO of Americas Strategic Business Unit
linkedin
Company data provided by crunchbase