Fujitsu · 1 week ago
Oracle Senior Python and Kafka Engineer
Fujitsu is a global digital transformation company seeking a hands-on Senior Python and Kafka Engineer to support a correctness-critical, event-driven digital repository processing platform. The role focuses on improving structured logging, Kafka reliability, event lineage, reconciliation, completion verification, observability, testing, and operational readiness across distributed services.
Big DataCloud ComputingCyber SecurityEnterprise SoftwareTelecom & CommunicationsInformation TechnologySoftwareCloud InfrastructureInformation and Communications Technology (ICT)IT Infrastructure
No H1B
Responsibilities
Implement a consistent structured JSON logging standard across Python services, including standardized fields, logging levels, contextual information, and actionable failure details
Improve Kafka producer and consumer reliability, with particular attention to:
Offset commit behavior
Consumer-group stability and rebalancing
Retry processing
Dead-letter topic handling
Message-loss investigation
Duplicate-processing and idempotency considerations
Instrument distributed services to provide greater visibility into how individual digital objects move through the processing pipeline
Implement or contribute to an event-lineage capability that records:
The processing stages an object passed through
The order in which stages occurred
The outcome of each stage
Where processing stopped or failed
Develop reconciliation and completion-tracking capabilities that compare expected workflow stages with recorded events
Help produce an actionable completion verdict for processed objects, including the ability to identify incomplete processing and support alerting or delivery holds
Implement telemetry using OpenTelemetry and contribute to an OpenLineage-based lineage solution, with Marquez currently identified as the leading implementation option
Develop and maintain Python services that interact with Kafka, PostgreSQL, MongoDB, object storage, and external APIs
Work with shared internal Python packages that provide message-envelope models, Kafka producer and consumer wrappers, retry and dead-letter handling, shared-state storage, and operational-metadata access
Write automated tests and support safe delivery through the existing Kubernetes, Kustomize, and ArgoCD environment
Troubleshoot complex distributed-processing issues across services, messages, data stores, and external dependencies
Pair closely with the internal engineer leading this work and contribute directly to implementation, testing, technical documentation, and operational readiness
Qualification
Required
• Significant hands-on experience operating or developing Kafka-based production applications
• Deep understanding of producer and consumer delivery semantics
• Experience with Kafka offsets, commit strategies, consumer groups, partition assignment, and rebalancing
• Demonstrated ability to diagnose missing, delayed, duplicated, or repeatedly retried messages
• Practical experience implementing retry and dead-letter processing patterns
• Advanced Python software-engineering experience
• Strong understanding of concurrency, threading, and runtime behavior
• Experience building and supporting production services and shared Python libraries
• Ability to write maintainable, testable, and operationally supportable code
• Experience defining and implementing structured logging standards, not only configuring logging products
• Ability to establish consistent log fields, severity levels, correlation information, error context, and diagnostic detail
• Understanding of observability practices for distributed and event-driven systems
• Strong working knowledge of PostgreSQL
• Experience using PostgreSQL JSON capabilities
• Ability to design and query operational, tracking, or event-related data structures
Preferred
• Hands-on experience with OpenTelemetry
• Experience with OpenLineage, Marquez, or comparable data-lineage and event-lineage solutions
• Working knowledge of Kubernetes sufficient to deploy, troubleshoot, and operate applications in a Kustomize and ArgoCD environment
• Experience using Grafana and Grafana Loki, or equivalent metrics, dashboarding, and log-management platforms
• Strong understanding of event-driven architecture patterns, including:
• Idempotent processing
• Exactly-once delivery concerns
• At-least-once processing implications
• Transactional boundaries between a datastore and a message bus
• Failure recovery in distributed workflows
Experience with one or more of the following would be beneficial but is not required:
• MongoDB
• Apache Solr
• AWS S3 or other S3-compatible object storage
• Istio
• AWS Secrets Manager
• External Secrets Operator
• AWS EFS and NFS-based shared storage
• Image or video processing pipelines
• Digital asset, library, archive, or repository platforms
• Apache Airflow and PgBouncer
• TypeScript or Node.js
Benefits
Medical, vision, and dental insurance
Life insurance
Short-term and long-term disability insurance
401k
Paid Time Off
Any leave required under federal, state, or local law, as applicable, such as leave under the Colorado Healthy Families and Workplaces Act
This role may be eligible for an annual bonus, which is based on individual
Company
Fujitsu
Global digital services for organizational transformation.
Funding
Current Stage
Public CompanyTotal Funding
unknown1949-05-16IPO
Leadership Team
Peter Grassi
Chief Executive Officer, Oceania
Ian Bradbury
CTO - Financial Services
Recent News
2026-09-30
Company data provided by crunchbase