ZenRows · 20 hours ago
Senior Software Engineer - API
United States
Full-time
Remote
Senior Level
6+ years expZenRows is one of the fastest-growing startups in Europe, focused on transforming data workflows through large-scale data extraction from the web. They are seeking a highly experienced Senior Software Engineer to lead the design and evolution of their asynchronous processing systems, ensuring performance and reliability across critical infrastructure components.
Big DataCloud Data ServicesData IntegrationData MiningInformation TechnologySaaSSoftware
Responsibilities
Design and evolve our job processing architecture to handle millions of concurrent async tasks reliably
Architect pipelines that support retry strategies, dynamic task routing, prioritization, rate limiting, and idempotency at scale
Drive the design of scheduling systems for recurring or trigger-based workflows (cron, event-based, user-initiated)
Build systems that support both real-time and batch data processing use cases with observability built in
Own end-to-end lifecycle of background workers, queues, schedulers, and task orchestration logic
Improve the resilience and self-healing capacity of async workflows
Drive capacity planning, performance tuning, and operational efficiency (latency, throughput, infra cost)
Define SLAs and reliability goals for job processing and scheduling systems
Build dashboards and alerting for job failures, stuck queues, throughput anomalies, and retry storms
Lead incident response and root cause analysis when async systems are involved
Enable dynamic scaling and distributed execution across regions/clouds
Set technical direction for how we process, prioritize, and schedule work internally
Mentor senior engineers and contribute to elevating engineering standards and architecture reviews
Drive adoption of best practices around event-driven systems, queueing strategies, and fault-tolerant design
Qualification
Required
Have 6+ years of backend and infrastructure engineering experience, with at least 2 years working on large-scale async job systems, task queues, or pipelines
Have deep expertise in queueing systems like Celery, Sidekiq, BullMQ, SQS, Kafka, RabbitMQ, or Google Pub/Sub
Have designed or operated distributed schedulers (e.g., Airflow, Temporal, Argo, custom systems)
Know how to make asynchronous systems idempotent, traceable, and fault-tolerant
Understand retry strategies (exponential backoff, circuit breakers), deduplication, and concurrency control
Are comfortable operating at scale — tens of millions of tasks/day, across shards, nodes, or cloud regions
Write clean, maintainable code in Python, Go, Node, or similar backend language
Think in systems — how jobs affect SLAs, billing, retries, rate limits, and customer experience
You have world-class product sense and can prioritize engineering efforts based on business impact
Communicate clearly, document thoroughly, and guide complex decisions across teams
Are familiar with time-series monitoring, metrics, tracing, and log pipelines (Prometheus, Grafana, OpenTelemetry, etc.)
Preferred
Have experience with multi-cloud deployment strategies
Have previously built your own workflow engine, job scheduler, or orchestration system
Can share war stories from scaling task systems or fixing nightmare-level production incidents — and what you learned
Company
ZenRows
ZenRows provides subscription-based SaaS services that turn any website into structured data.
11-50 employees
Funding
Current Stage
Early StageTotal Funding
$1.15MKey Investors
4Founders Capital
2022-06-30Pre Seed· $1.15M
Recent News
thesaasnews.com
2025-10-28
2024-01-29
Company data provided by crunchbase