Kafka Administrator jobs in United States
info-icon
This job has closed.
company-logo

QBA Worldwide · 1 day ago

Kafka Administrator

QBA Worldwide is seeking an experienced Kafka Administrator to manage, operate, and optimize Apache Kafka environments. The ideal candidate will be responsible for ensuring high availability, security, scalability, and performance of Kafka clusters while collaborating closely with development and infrastructure teams to support real-time data streaming solutions.

Computer Software
check
Growth Opportunities

Responsibilities

Install, configure, and maintain Apache Kafka clusters
Ensure high availability, fault tolerance, and disaster recovery strategies
Manage Kafka brokers, topics, partitions, and replication
Monitor Kafka performance and resource utilization
Identify bottlenecks and tune configurations for optimal throughput and low latency
Perform capacity and load optimization activities
Implement and manage Kafka security features, including authentication, authorization, and encryption
Enforce access controls and compliance with organizational security standards
Set up and maintain monitoring tools and alerting mechanisms
Proactively detect, troubleshoot, and resolve issues before they impact business operations
Diagnose and resolve Kafka-related issues, including performance degradation, connectivity problems, and data inconsistencies
Provide operational support for production Kafka environments
Work closely with development, data, and infrastructure teams to integrate Kafka with applications and data pipelines
Support real-time data ingestion and streaming use cases
Automate routine Kafka administration tasks using scripts and tools
Improve operational efficiency and reduce manual intervention
Create and maintain comprehensive documentation for Kafka configurations, operational procedures, and best practices
Analyze current and future resource requirements
Plan and execute Kafka cluster scaling strategies to meet growing data demands

Qualification

Apache Kafka AdministrationKafka ArchitectureCluster Management & High AvailabilityPerformance Monitoring & TuningKafka SecurityMonitoring & Alerting ToolsTroubleshooting & Production SupportAutomation & ScriptingLinux/Unix SystemsCollaboration & Documentation

Required

Strong hands-on experience administering Apache Kafka in production environments
Expertise in Kafka architecture, brokers, topics, partitions, and replication
Experience with performance tuning, monitoring, and troubleshooting Kafka clusters
Knowledge of Kafka security configurations and best practices
Scripting experience for automation (Shell, Python, or similar)
Strong collaboration and documentation skills

Preferred

Experience with Kafka ecosystem tools such as Kafka Connect, Kafka Streams, and Schema Registry
Hands-on experience managing Kafka on cloud platforms (AWS MSK, Azure Event Hubs for Kafka, or GCP Pub/Sub Kafka integration)
Knowledge of containerization and orchestration tools such as Docker and Kubernetes
Experience with infrastructure as code tools (Terraform, Ansible, or similar)
Familiarity with CI/CD pipelines for deploying and managing Kafka-related components
Experience with distributed systems and large-scale, high-throughput data streaming architectures
Knowledge of log aggregation and monitoring tools (ELK stack, Splunk, Datadog, etc.)
Understanding of data serialization formats such as Avro, Protobuf, or JSON
Exposure to stream processing frameworks like Apache Flink or Apache Spark Streaming
Strong analytical, problem-solving, and communication skills

Company

QBA Worldwide

twitter
company-logo
Transforming Technology into Business Impact At QBA, we believe technology should not just work—it should transform.

Funding

Current Stage
Growth Stage

Leadership Team

leader-logo
Probal DasGupta, Ph.D.
Founder (QBA Worldwide) and CEO (Americas)
linkedin
leader-logo
Arpita Biswas
Assistant to the CEO (America's)
linkedin
Company data provided by crunchbase