DataFactZ · 7 hours ago
Data Engineering Specialist (Confluent Kafka exp)
Fort Mill, SC
Contract
Onsite
Senior Level, Lead/Staff
10+ years expDataFactZ is looking for a seasoned engineer with deep expertise in Confluent Kafka, cloud automation, and AWS-based data pipelines. This role blends infrastructure engineering, event streaming, and hands-on data development to support large-scale, real-time systems across hybrid cloud environments.
AnalyticsBig DataBusiness IntelligenceCloud ComputingCloud Data ServicesConsultingData IntegrationData VisualizationPredictive AnalyticsProfessional Services
Responsibilities
Design and manage scalable Confluent Kafka clusters and event streaming solutions
Build and maintain data pipelines using PySpark, Spark SQL, Python, and AWS services
Automate infrastructure using Terraform, Ansible, Bash, and cloud-native tooling
Implement CI/CD pipelines (GitHub, Jenkins, Artifactory, Octopus, Harness)
Support Kubernetes/Rancher environments and cloud provisioning (AWS & Azure)
Collaborate with cross-functional teams to ensure smooth deployments and reliable data flows
Qualification
Required
10+ years in infrastructure/middleware engineering; 3–5 years in AWS data engineering
Deep expertise in Confluent Kafka administration and performance tuning
Strong skills in PySpark, Spark SQL, Python, Terraform, Ansible, Bash
Experience with PostgreSQL, Redshift, SQL Server, Glue, Airflow
Knowledge of Kubernetes, Rancher, and monitoring tools (Splunk, ELK, Dynatrace)
Excellent communication, problem-solving, and collaboration skills
Bachelor's degree in CS/Engineering or equivalent experience
Preferred
AWS Solutions Architect, CKAD, CKA certifications
Familiarity with AI tools and modern engineering workflows
Company
DataFactZ
Guiding Industry leaders in the new world of data driven decisions with competency in Cloud, Data & Analytics.
501-1000 employees
H1B Sponsorship
DataFactZ has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9)
2024 (19)
2023 (18)
2022 (37)
2021 (11)
Funding
Current Stage
Late StageLeadership Team
Sridhar K.
Co-founder & CFO
Recent News
2023-12-27
2023-12-27
Company data provided by crunchbase