ApTask ยท 2 months ago
Flink Developer
ApTask is a leading global provider of workforce solutions and talent acquisition services, dedicated to shaping the future of work. They are seeking a Flink Developer to architect and maintain Flink clusters, automate deployments, and collaborate with development teams to optimize job performance.
Human ResourcesInformation TechnologySmall and Medium BusinessesStaffing Agency
Responsibilities
Architect, provision and maintain highly available Flink clusters on EKS and ECS
Build and customize autoscaling strategies (Kubernetes HPA/VPA, ECS capacity providers, custom metrics) to handle dynamic workloads
Install, configure and secure the Flink Web UI and related dashboards
Automate deployments and upgrades using infrastructure as Code (Terraform, CloudFormation, Helm charts)
Develop CI/CD pipelines for Flink job packaging and cluster configuration
Integrate monitoring , alerting, and tracing (Prometheus, Grafana, CloudWatch, X-Ray) for both control plane and streaming applications
Troubleshoot performance issues- tuning parallelism, memory, checkpointing, state backend configurations
Collaborate with development teams to optimize job code, data partitioning, and checkpoint strategies
Define runbooks, conduct game-days and blameless post-mortems to continually improve SLOs/SLA adherence
Enforce security best practices: IAM roles, network policies, encryption at rest /in-transit
Evaluate new features and contribute to roadmaps for platform enhancements
Qualification
Required
3+ years in an SRE or DevOps role supporting distributed streaming platforms
2+ years hands on experience with Apache Flink at scale
Deep expertise deploying Flink on Kubernetes (EKS) and container services (ECS)
Strong skills in autoscaling customization: Kubernetes HPA/VPA, custom metrics adapters, ECS autoscaling policies
Experience installing and securing Flink web UI, metrics reporters, and REST endpoints
Proficiency with Infrastructure as Code (Terraform, Helm, CloudFormation)
In-depth knowledge of monitoring and alerting stacks (Prometheus, Grafana, CloudWatch)
Familiarity with stateful stream processing concepts; checkpoints, savepoints, state backends
Hands-on networking, IAM and security controls in AWS
Company
ApTask
ApTask is a staffing and recruiting company offering staffing, project, and workforce solutions.
H1B Sponsorship
ApTask has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (1)
2020 (1)
Funding
Current Stage
Growth StageRecent News
Company data provided by crunchbase