USAJOBS · 15 hours ago
Kafka Engineer
USAJOBS is seeking Kafka Engineers to join the Social Security Administration's innovative technology team. In this role, you will design, build, and maintain scalable data pipelines using Kafka, collaborating with cross-functional teams to deliver reliable and secure solutions that support millions of Americans every day.
ConsultingGovernmentHuman ResourcesInformation TechnologyInternetStaffing Agency
Responsibilities
This announcement serves as public notice. Applications submitted be placed into a pool and will remain on file for selection as positions become available
Vacancies may be filled for up to 6 months after the closing date of this announcement. Applicants may not receive notifications of referral status until the full 6-month eligibility period has elapsed
Positions filled with applications from this pool will be placed into positions where artificial intelligence duties occupy the majority of the work performed
Design, develop, and maintain robust Kafka-based applications and data pipelines that support SSA's business operations, including the real-time or near-real-time data to AI/ML models
Collaborate with development, operations, and infrastructure teams to deliver reliable, scalable, and high-performing Kafka solutions
Ensure the availability, reliability, and performance of Kafka clusters and related systems
Work closely with architects, data engineers, and stakeholders to define requirements and deliver solutions
Troubleshoot and resolve issues in Kafka applications, ensuring minimal downtime and optimal performance
Document code, design decisions, processes, configurations, and best practices for future reference and team knowledge sharing
Mentor junior developers and share Kafka expertise, fostering a culture of learning and growth
Stay current with the latest Kafka releases, features, and ecosystem advancements
Perform statistical analysis to monitor team performance, improve processes, and ensure customer satisfaction
Define and set SLAs for projects, ensuring high standards of service delivery
Qualification
Required
U.S. Citizenship required
Selective Service Registration, if applicable (www.sss.gov)
Fingerprinting and background and/or security investigation may be required
Job offers are contingent on fingerprinting and background / security investigation results
Selectees may be required to serve a 1 year probationary period
Relocation expenses will not be paid
All qualification requirements must be met by the closing date of the announcement
Candidates will not be hired based on their race, sex, color, religion, or national origin
Experience must be IT related; the experience may be demonstrated by paid or unpaid experience and/or completion of specific, intensive training (for example, IT certification), as appropriate
To qualify for the 2210 IT Specialist series, the applicant must demonstrate the following competencies: Attention to Detail, Customer Service, Oral Communication, Problem Solving
Minimum Qualifications: Grade 14 To qualify at the GS-14 level, you must have at least 52 weeks of specialized experience at the GS-13 level, or equivalent, designing, developing, and maintaining scalable, fault-tolerant data pipelines using Apache Kafka; managing and administering Kafka clusters throughout the Systems Development Life Cycle (SDLC), including upgrades and patching; leading large-scale projects, serving as a Product Owner or Agile/Scrum team lead; demonstrating strong programming skills in Java, with Python experience as a plus; utilizing Kafka APIs (Producer, Consumer, Streams, Connect) for event-driven and microservices-based solutions; applying knowledge of serialization formats (Avro, Protobuf, JSON) and schema registry/data governance, including Hackolade for data modeling; optimizing producer/consumer performance and handling large-scale data ingestion; implementing unit and integration testing for Kafka applications; configuring and tuning Kafka clusters for performance, reliability, and scalability; monitoring and troubleshooting Kafka clusters using tools such as Prometheus and Grafana; supporting hybrid integration architecture patterns
Minimum Qualifications: Grade 15 To qualify at the GS-15 level, you must have at least 52 weeks of specialized experience at the GS-14 level, or equivalent, leading the design, development, and implementation of enterprise-scale, fault-tolerant data pipelines using Apache Kafka; providing expert-level management and administration of Kafka clusters throughout the Systems Development Life Cycle (SDLC), including upgrades and patching; overseeing large-scale, cross-functional projects as a senior Product Owner or Agile/Scrum leader, ensuring alignment with organizational goals; demonstrating advanced proficiency in Java programming, with experience in Python as a plus; architecting event-driven and microservices-based solutions leveraging Kafka APIs (Producer, Consumer, Streams, Connect); establishing and enforcing best practices for serialization formats (Avro, Protobuf, JSON) and schema registry/data governance, including Hackolade for data modeling; directing the optimization of producer/consumer performance and large-scale data ingestion strategies; leading the implementation of unit and integration testing frameworks for Kafka applications; managing hybrid integration architecture patterns and ensuring reliability, scalability, and performance of Kafka clusters; overseeing monitoring and troubleshooting activities using tools such as Prometheus and Grafana; providing technical guidance and mentorship to teams on Kafka cluster setup, configuration, and tuning; ensuring compliance with organizational standards and data governance policies
Resumes exceeding two pages in length will not be considered
Benefits
A career with the U.S. government provides employees with a comprehensive benefits package.
Eligibility for benefits depends on the type of position you hold and whether your position is full-time, part-time or intermittent.
Company
USAJOBS
USAJOBS enables federal job seekers to access job opportunities across hundreds of federal agencies and organizations.
Funding
Current Stage
Late StageRecent News
Company data provided by crunchbase