Sr. Hadoop Data Engineer / Administrator jobs in United States
info-icon
This job has closed.
company-logo

Mindlance · 3 months ago

Sr. Hadoop Data Engineer / Administrator

Mindlance is a company seeking a Sr. Hadoop Data Engineer / Administrator to oversee the administration of Hadoop infrastructure and data science projects. The role involves managing database systems, ensuring data integrity, and collaborating with various teams to optimize performance and security.

Human Resources
check
H1B Sponsor Likelynote

Responsibilities

Responsible for implementation and ongoing administration of Hadoop infrastructure, Data science infrastructure and Lakehouses
Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments to Lakehouse technologies
Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, Pig and MapReduce access for the new users
Cluster maintenance as well as creation and removal of nodes using tools like Ganglia, Nagios, Cloudera Manager Enterprise, Dell Open Manage and other tools
Performance tuning of Hadoop clusters and Hadoop MapReduce routines
Screen Hadoop cluster job performances and capacity planning
Monitor Hadoop cluster connectivity and security
Manage and review Hadoop log files
File system management and monitoring
HDFS support and maintenance
Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability
Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required
Point of Contact for Vendor escalation
Data modelling, design & implementation based on recognized standards
Software installation and configuration
Database backup and recovery
Database connectivity and security
Performance monitoring and tuning
Disk space management
Software patches and upgrades
Automate manual tasks

Qualification

Hadoop AdministrationSQLSparkLinux OSData ScienceStarburst/TrinoDBA experienceCommunication skills

Required

3-5 Years of DBA experience required
5-8 Years of Hadoop Admin experience required
Strong communication skills required
Must have strong experience working with SQL (our analytics platform)
Must have strong experience working with Spark (main platform)
Must have strong experience working with Linux OS
Related Bachelor's degree in an IT related field or relevant work experience

Preferred

Experience with Starburst/TrinoPresto specialization highly preferred
Exposure to Data Science tools highly preferred (but not required)

Company

Mindlance

company-logo
Mindlance is a Staffing and Recruiting company which provides multi-vertical staffing services

H1B Sponsorship

Mindlance has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (71)
2024 (53)
2023 (37)
2022 (72)
2021 (36)
2020 (40)

Funding

Current Stage
Late Stage

Leadership Team

R
Rajat Paul Dhall
Co-Founder & Managing Director
linkedin
V
Vik Kalra
Co-Founder and Managing Director
linkedin
Company data provided by crunchbase