Lumen Solutions Group Inc. ยท 5 months ago
IT Solutions Architect Sr/Data Platform Engineer
Lumen Solutions Group Inc. is seeking an IT Solutions Architect Sr/Data Platform Engineer with extensive experience in data engineering and real-time streaming architectures. The role involves managing data flows, ensuring compliance with data governance, and leveraging cloud-native infrastructure for data processing.
Information Technology & Services
Responsibilities
6+ years of experience in data engineering, real-time streaming, or event-driven architectures
Strong hands-on expertise in Amazon MSK (Managed Streaming for Apache Kafka), Kafka Streams, and Kafka Connect
Experience in managing data flows with Apache NiFi and workflow orchestration with Apache Airflow
Proficiency in managing MQ and other Pub/Sub messaging platforms and frameworks
Experience with Flink, Spark Streaming, or similar frameworks for real-time processing
Deep understanding of distributed systems, stream processing semantics, and event-driven microservices
Expertise in cloud-native data infrastructure (AWS/GCP/Azure), Kubernetes, and container orchestration
Strong grasp of data governance, schema evolution, security, and compliance best practices
Qualification
Required
6+ years of experience in data engineering, real-time streaming, or event-driven architectures
Strong hands-on expertise in Amazon MSK (Managed Streaming for Apache Kafka), Kafka Streams, and Kafka Connect
Experience in managing data flows with Apache NiFi and workflow orchestration with Apache Airflow
Proficiency in managing MQ and other Pub/Sub messaging platforms and frameworks
Experience with Flink, Spark Streaming, or similar frameworks for real-time processing
Deep understanding of distributed systems, stream processing semantics, and event-driven microservices
Expertise in cloud-native data infrastructure (AWS/GCP/Azure), Kubernetes, and container orchestration
Strong grasp of data governance, schema evolution, security, and compliance best practices