VBeyond Corporation ยท 1 day ago
Kafka Engineer (Platform)
Irvine, CA
Contract
Hybrid
Senior Level, Lead/Staff
10+ years expVBeyond Corporation is seeking a Senior Kafka Platform Engineer to lead the management and optimization of their enterprise-grade Apache Kafka ecosystem. The role involves performing architectural reviews, tuning performance for high-throughput pipelines, and collaborating with application teams to deliver secure and resilient streaming solutions.
ConsultingCRMDeliveryHuman ResourcesInformation Technology
Hiring Manager
Prashant P
Responsibilities
Platform Management: Enhance and maintain Apache Kafka and Confluent Platform deployments on AWS
Architecture & Strategy: Review existing implementations to recommend and execute optimizations for scalability and reliability
Application Integration: Collaborate with product and engineering teams to define streaming patterns and integrate new high-impact use cases
Development: Build and maintain Kafka Producers/Consumers, Kafka Connectors, and Kafka Streams applications
Infrastructure as Code (IaC): Automate Kafka infrastructure deployment and scaling using Terraform, Kubernetes (EKS), and Helm
Governance: Enforce best practices for topic design, schema evolution, partitioning, and data retention
Observability: Monitor, troubleshoot, and fine-tune clusters using Confluent Control Center, Prometheus, and Grafana
Security & Resilience: Implement robust disaster recovery protocols and ensure high availability while maintaining strict security standards (TLS/RBAC)
Mentorship: Act as a subject matter expert (SME), providing technical leadership and mentoring junior engineers
Qualification
Required
10+ years in Platform Engineering, with at least 3+ years of dedicated, hands-on experience with Apache Kafka
Strong proficiency in Kafka client development using Java or Python
Deep knowledge of the Confluent ecosystem (Brokers, Schema Registry, Control Center, ksqlDB)
Proven experience managing Kafka on AWS (MSK or EC2-based setups) and Kubernetes (EKS)
Hands-on experience with Kafka Connect, Kafka Streams, and Terraform
Familiarity with Prometheus, Grafana, ELK, or similar observability stacks
Preferred
Prior experience in FinTech or highly regulated, security-conscious environments
Expertise in TLS, SASL/OAuth authentication, and encryption at rest
Exposure to Apache Flink, Spark Streaming, or other real-time engines
Experience building multi-tenant topic strategies and governance frameworks
Confluent Certified Developer or Administrator is a major plus
Company
VBeyond Corporation
VBeyond Corporation is a staffing and recruiting company specializing in emerging search and HR consulting services.
201-500 employees
Funding
Current Stage
Growth StageLeadership Team
Rajesh Khanna
President
Sandeep Mitra
Director
Recent News
Company data provided by crunchbase