Acceldata · 2 months ago
Staff Product Support Engineer - Hadoop Operations
United States
Full-time
Hybrid
Lead/StaffAcceldata is seeking a Staff Product Support Engineer / Product Specialist - Hadoop Operations SME who will be responsible for designing, optimizing, migrating, and scaling Hadoop and Spark-based data processing systems. This role involves hands-on experience with Hadoop and focuses on building resilient, high-performance distributed data systems while collaborating with customer engineering teams.
Artificial Intelligence (AI)Big DataData ManagementEnterprise SoftwareInfrastructure
Responsibilities
Design and optimise distributed Hadoop-based applications, ensuring low-latency, high-throughput performance for big data workloads
Troubleshooting: Provide expert-level support for data or performance issues in Hadoop, Nifi, and Spark jobs and clusters
Data Processing Expertise: Work extensively with large-scale data pipelines using Hadoop, Nifi, and Spark's core components
Performance Tuning: Conduct deep-dive performance analysis, debugging, and optimization of Nifi, Impala, and Spark jobs to reduce processing time and resource consumption
Cluster Management: Collaborate with DevOps and infrastructure teams to manage Nifi, Impala, and Spark clusters on platforms like Hadoop/YARN, Kubernetes, or cloud platforms (AWS EMR, GCP Dataproc, etc.)
Migration: Provide dedicated support to ensure the stability and reliability of the new ODP Hadoop environment during and after migration. Promptly address evolving technical challenges and optimise system performance after migration to ODP
Be involved with and work on other support-related activities - Performing POC & assisting with Onboarding deployments of Acceldata & Hadoop distribution products
Qualification
Required
Hands-on experience with Hadoop and other core data operations
Experience in designing, optimizing, migrating, and scaling Hadoop and Spark-based data processing systems
Ability to collaborate with customer engineering teams to deliver high-throughput Hadoop, Nifi, and Spark applications
Expert-level support for data or performance issues in Hadoop, Nifi, and Spark jobs and clusters
Extensive work with large-scale data pipelines using Hadoop, Nifi, and Spark's core components
Conduct deep-dive performance analysis, debugging, and optimization of Nifi, Impala, and Spark jobs
Collaborate with DevOps and infrastructure teams to manage Nifi, Impala, and Spark clusters
Provide dedicated support to ensure the stability and reliability of the new ODP Hadoop environment during and after migration
Flexibility to work in rotational shifts based on team coverage needs and customer demand
Comfortable supporting operations in a 24/7 environment and willing to adjust working hours accordingly
Preferred
Master's degree
Experience working with scripting languages (Scala, Python, Bash, PowerShell)
Familiarity with virtual machine technologies and multi-node environment (50+ nodes)
Proficient with Linux, NFS, and Windows, including application installation, scripting, and working with the command line
Working knowledge of application, server, and network security management concepts
Certification on any of the leading Cloud providers (AWS, Azure, GCP) and/or Kubernetes
Knowledge of databases like MySQL and PostgreSQL
Be involved with and work on other support-related activities - Performing POC & assisting with Onboarding deployments of Acceldata & Hadoop distribution products
Company
Acceldata
Acceldata offers an Agentic Data Management Platform that intelligently monitors and optimizes enterprise data systems.
Founded in 2018
201-500 employees
H1B Sponsorship
Acceldata has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (5)
2023 (1)
Funding
Current Stage
Growth StageTotal Funding
$105.56MKey Investors
Prosperity7 VenturesMarch CapitalInsight Partners
2023-10-10Series C· $10M
2023-02-08Series C· $50M
2021-09-28Series B· $35M
Leadership Team
Rohit Choudhary
Founder & CEO
Ashwin Rajeeva
Co-founder and CTO
Recent News
Lightspeed Venture Partners
2025-12-04
acceldata.io
2025-12-04
Company data provided by crunchbase