JSR Tech Consulting · 19 hours ago
AWS Data Pipeline Developer
JSR Tech Consulting is seeking an AWS-focused Developer to join the Platform Enablement team at a major investment firm. This role centers on designing, building, and optimizing cloud-based data feed solutions using AWS services, with an emphasis on scalability and reliability.
Responsibilities
Design, develop, test, and deploy AWS-based components supporting data pipelines
Build solutions using AWS services including Lambda, S3, EventBridge, and ECS Fargate
Implement parameter-driven feed generation logic across multiple data domains (e.g., Contract, Customer)
Build and maintain PostgreSQL-based CFGenDB schemas for transformed domain data
Configure and manage data extraction from on-prem and cloud-based databases
Apply transformation rules using configuration files to ensure accurate feed generation for downstream systems
Create and maintain CI/CD pipelines using tools such as Jenkins
Ensure deployments comply with security, governance, and regulatory standards
Monitor feed generation workflows, Lambda executions, and ECS tasks
Troubleshoot issues related to data validation, file tagging, access permissions, and processing failures
Partner with feature teams, DBAs, and platform engineers to validate deployments and resolve defects
Produce and maintain technical documentation, deployment procedures, and operational runbooks
Communicate progress, risks, and issues clearly to stakeholders
Qualification
Required
Strong hands-on experience with AWS services, including Lambda, S3, EventBridge, and ECS Fargate
Solid experience with PostgreSQL and SQL for data modeling and transformation
Familiarity with CI/CD tools such as Jenkins and Bitbucket
Understanding of Infrastructure-as-Code concepts
Experience with event-driven architectures and data pipeline orchestration
Hands-on development experience using Python or Java in AWS environments
Working knowledge of cloud security best practices
Strong analytical and problem-solving abilities
Comfortable working in Agile environments
Clear and effective written and verbal communication skills
Ability to collaborate across engineering, data, and platform teams