Capgemini · 1 week ago
Senior Data Engineer - Real Time Data Processing
Atlanta, GA
Full-time
Hybrid
Mid, Senior Level
$110K/yr - $115K/yr
7+ years expCapgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world. As a Senior Data Engineer, you'll design and deliver real-time data pipelines and event-driven microservices while collaborating closely with platform and product teams to scale data services.
ConsultingInformation TechnologyInsurTechIT ManagementSoftware
Responsibilities
Build reliable streaming applications using Confluent Kafka, Apache Flink, Hazelcast, Kafka Streams, Kafka Connect, and Schema Registry
Develop ETL/ELT pipelines for real time ingestion, transformation, and distribution; implement windowing, joins, and stateful processing
Implement distributed caching and in memory data grid integrations to reduce latency and improve throughput
Contribute to event gateway / event grid routing, schemas, topic design, ACLs, and dead letter strategies
Write clean, testable code for microservices (Java/Python), focusing on reliability, idempotency, and observability
Automate CI/CD pipelines, containerization (Docker), and deployments to Kubernetes
Participate in data governance: tagging, metadata updates, lineage capture, schema evolution, and data quality checks
Monitor production systems, perform performance tuning, troubleshoot backpressure/lag, and improve SLO attainment
Collaborate on design docs, code reviews, and cross team integrations
Qualification
Required
7+ years in software engineering, with 3+ years focused on real time streaming or event driven systems
Strong hands-on experience with Kafka (topics, partitions, consumer groups), Schema Registry, Kafka Connect, and either Flink or Kafka Streams or Hazelcast
Solid understanding of ETL/ELT concepts, event time vs. processing time, checkpointing, state management, and exactly once/at least once semantics
Proficiency with microservices (Java /Python), APIs (REST/gRPC), Avro/JSON/protobuf, and contract testing
Experience with Docker, Kubernetes, and CI/CD tools (GitHub Actions/Azure DevOps/Jenkins or similar)
Familiarity with distributed caching (Redis, Hazelcast) and in memory data grids
Cloud experience in at least one cloud platform (Azure/AWS/GCP)
Knowledge of observability (metrics, logs, traces) and resilience (retries, timeouts, DLQs, circuit breakers)
Exposure to data governance, metadata catalogs, and lineage tooling; schema evolution and compatibility (backward/forward/full)
Core competencies to include Problem Solving, Ownership, Code Quality, Operational Mindset, Collaboration, Continuous Improvement
Preferred
CDC pipelines, Flink SQL, custom Kafka Connect connectors
Experience with feature flags, canary releases, and progressive delivery
Performance tuning: batch sizes, compression, serialization choices (Avro vs. Protobuf), and partitioning strategies
Benefits
Flexible work
Healthcare including dental, vision, mental health, and well-being programs
Financial well-being programs such as 401(k) and Employee Share Ownership Plan
Paid time off and paid holidays
Paid parental leave
Family building benefits like adoption assistance, surrogacy, and cryopreservation
Social well-being benefits like subsidized back-up child/elder care and tutoring
Mentoring, coaching and learning programs
Employee Resource Groups
Disaster Relief
Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade, Company paid holidays, Personal Days, Sick Leave
Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
Life and disability insurance
Employee assistance programs
Other benefits as provided by local policy and eligibility
Company
Capgemini
Capgemini is a software company that provides consulting, technology, and digital transformation services.
10001+ employees
H1B Sponsorship
Capgemini has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2856)
2024 (3012)
2023 (3424)
2022 (4392)
2021 (3311)
2020 (5871)
Funding
Current Stage
Public CompanyTotal Funding
$4.72B2025-09-18Post Ipo Debt· $4.72B
1999-04-01IPO
Leadership Team
Aiman Ezzat
CEO, Capgemini Group
Anirban Bose
CEO of Americas Strategic Business Unit
Recent News
2026-01-08
2026-01-06
2026-01-05
Company data provided by crunchbase