Apply on Employer Site

GDECA (Gravity Data Engineering & Cloud Analytics) · 4 months ago

AWS DataHub Developer

United States

Full-time

Remote

Senior Level

GDECA is seeking a Senior AWS DataHub Developer to design and build real-time, event-driven data services on AWS. The role focuses on architecting and delivering Kafka-based streaming pipelines and serverless data applications, collaborating with architects, data engineers, and product teams to create scalable solutions for enterprise-grade analytics.

Information Technology & Services

Responsibilities

Design & Deliver Event-Driven Pipelines: Build serverless data flows using AWS Lambda, Step Functions, EventBridge, SNS, SQS, API Gateway

Real-Time Streaming: Develop Kafka (Apache Kafka/Amazon MSK) consumers/producers for high-throughput, low-latency streaming and decoupled microservices

Microservices & APIs: Build and optimize TypeScript (preferred) or Python services/APIs for data ingestion, transformation, and delivery

AWS Data Services Integration: Work with S3, DynamoDB, Glue, Athena, CloudWatch for storage, metadata, querying, and observability

Quality & Reliability: Implement idempotency, retries, dead-letter queues, exactly-once/at-least-once semantics where appropriate, and schema evolution strategies

CI/CD & Testing: Use Git-based workflows and CI/CD (e.g., GitHub Actions, Jenkins) with automated tests (unit/integration/load) and infrastructure deployments

IaC (Developer View): Define application-layer infrastructure using AWS CDK, Terraform, or CloudFormation—with strong emphasis on developer productivity and repeatability

Agile Collaboration: Contribute to technical design, story sizing, peer reviews, and continuous improvement

Qualification

AWS LambdaKafkaTypeScriptAWS Data ServicesCI/CDInfrastructure as CodeAgile Collaboration

Required

Experience in designing and building real-time, event-driven data services on AWS

Proficiency in architecting and delivering Kafka-based streaming pipelines

Experience in building serverless data applications using AWS Lambda, Step Functions, EventBridge, SNS, SQS, API Gateway

Experience in developing Kafka (Apache Kafka/Amazon MSK) consumers/producers for high-throughput, low-latency streaming

Experience in building and optimizing TypeScript or Python services/APIs for data ingestion, transformation, and delivery

Experience with AWS Data Services such as S3, DynamoDB, Glue, Athena, CloudWatch

Knowledge of implementing idempotency, retries, dead-letter queues, exactly-once/at-least-once semantics, and schema evolution strategies

Experience with Git-based workflows and CI/CD (e.g., GitHub Actions, Jenkins) with automated tests (unit/integration/load) and infrastructure deployments

Experience in defining application-layer infrastructure using AWS CDK, Terraform, or CloudFormation

Ability to contribute to technical design, story sizing, peer reviews, and continuous improvement