Altimetrik · 16 hours ago
Hadoop Admin
Austin, TX
Full-time
Hybrid
Senior Level
6+ years expAltimetrik is seeking a Hadoop Administrator responsible for the implementation and ongoing administration of Hadoop infrastructure. The role involves cluster maintenance, troubleshooting, monitoring, and ensuring proper backup and recovery strategies while collaborating with application teams for system updates and performance tuning.
Information TechnologySoftware
Responsibilities
Responsible for implementation and ongoing administration of Hadoop infrastructure
Responsible for cluster maintenance, troubleshooting, monitoring, and following proper backup & recovery strategies
Provisioning and managing the life cycle of multiple clusters like EMR & EKS
Infrastructure monitoring, logging & alerting with Prometheus, Grafana, and Splunk
Performance tuning of Hadoop clusters and Hadoop workloads, including capacity planning at the application/queue level
Responsible for memory management, queue allocation, and distribution experience in Hadoop/Cloud era environments
Should be able to scale clusters in production and have experience with 18/5 or 24/5 production environments
Monitor Hadoop cluster connectivity and security, including file system (HDFS) management and monitoring
Investigate and analyze new technical possibilities, tools, and techniques that reduce complexity, create more efficient and productive delivery processes, or deliver better technical solutions that increase business value
Involved in fixing issues, performing RCA, and suggesting solutions for infrastructure/service components
Responsible for meeting Service Level Agreement (SLA) targets and collaboratively ensuring team targets are met
Ensure all changes to production systems are planned and approved in accordance with the Change Management process
Collaborate with application teams to install operating system and Hadoop updates, patches, and version upgrades when required
Maintain central dashboards for all system, data, utilization, and availability metrics
Qualification
Required
Responsible for implementation and ongoing administration of Hadoop infrastructure
Responsible for cluster maintenance, troubleshooting, monitoring, and following proper backup & recovery strategies
Provisioning and managing the life cycle of multiple clusters like EMR & EKS
Infrastructure monitoring, logging & alerting with Prometheus, Grafana, and Splunk
Performance tuning of Hadoop clusters and Hadoop workloads, including capacity planning at the application/queue level
Responsible for memory management, queue allocation, and distribution experience in Hadoop/Cloud era environments
Should be able to scale clusters in production and have experience with 18/5 or 24/5 production environments
Monitor Hadoop cluster connectivity and security, including file system (HDFS) management and monitoring
Investigate and analyze new technical possibilities, tools, and techniques that reduce complexity, create more efficient and productive delivery processes, or deliver better technical solutions that increase business value
Involved in fixing issues, performing RCA, and suggesting solutions for infrastructure/service components
Responsible for meeting Service Level Agreement (SLA) targets and collaboratively ensuring team targets are met
Ensure all changes to production systems are planned and approved in accordance with the Change Management process
Collaborate with application teams to install operating system and Hadoop updates, patches, and version upgrades when required
Maintain central dashboards for all system, data, utilization, and availability metrics
Experience: 6–12 years of total experience, with at least 3 years of hands-on work in developing, maintaining, optimizing, and resolving issues in Hadoop clusters supporting business users
Operating Systems: Experience in Linux/Unix OS services, administration, shell, and awk scripting
Programming: Strong knowledge of at least one programming language — Python, Scala, Java, or R — with debugging skills
Hadoop Ecosystem: Experience in Hadoop components — MapReduce, Hive, Pig, Spark, Kafka, HBase, HDFS, H-Catalog, Zookeeper, and Oozie/Airflow
Security: Experience in Hadoop security including Kerberos, Knox, and TLS
Databases: Hands-on experience with SQL and NoSQL databases (HBase), including performance optimization
Tools & Automation: Experience in tool integration, automation, and configuration management using GIT and Jira platforms
Soft Skills: Excellent oral and written communication, presentation skills, and strong analytical and problem-solving abilities
Company
Altimetrik
About Altimetrik Altimetrik is an AI-first data- and digital-engineering company that helps enterprises accelerate growth with an incremental, product-oriented approach.
5001-10000 employees
H1B Sponsorship
Altimetrik has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (85)
2024 (93)
2023 (81)
2022 (75)
2021 (110)
2020 (157)
Funding
Current Stage
Late StageTotal Funding
unknown2024-06-27Acquired
Leadership Team
Raj Sundaresan
Chief Executive Officer
Adam Caplan
President, AI
Recent News
Company data provided by crunchbase