Shopify · 5 months ago
Senior Software Engineer- Streaming Pipelines
United States
Full-time
Remote
Senior LevelShopify is a company dedicated to empowering entrepreneurs and transforming commerce. They are seeking a Senior Software Streaming Pipelines Engineer to innovate how merchant data flows through modern streaming architectures, developing solutions that enhance data processing at a global scale.
E-CommerceE-Commerce PlatformsEnterprise SoftwareSaaS
Responsibilities
Looking for a Senior Software Streaming Pipelines Engineer to join our team reimagining how merchant data flows through modern streaming architectures
You’ll be crafting solutions that challenge conventional approaches to data processing at global scale
We’ve developed a declarative pipeline framework using Apache Beam, Google Cloud Dataflow, and ClickHouse that transforms how data engineers build streaming systems
Imagine YAML-driven pipelines that eliminate boilerplate code, real-time stream processing across multiple regions, and an architecture that makes complex data transformations feel effortless
You’ll work across multiple languages – Kotlin, Ruby, Python, and Rust – choosing the right tool for each challenge, alongside dbt for elegant data modelling and our custom framework that turns pipeline development into a configuration exercise rather than a coding marathon
The puzzle? Replacing entrenched batch systems with streaming-first architecture while merchants never notice the transition
You’ll tackle fascinating problems: How do you handle late-arriving data in distributed streams? What’s the most elegant approach to backfill terabytes while maintaining real-time processing? How do you architect lightning-fast real-time modelling that seamlessly combines data from multiple tables?
We embrace AI and LLMs to accelerate repetitive tasks, freeing you to focus on the creative problem-solving that makes this work truly rewarding
If you love turning 'impossible' requirements into beautiful solutions, this is your playground
Qualification
Required
Care deeply about what you do and about making commerce better for everyone
Excel by seeking professional and personal hypergrowth
Keep up with an unrelenting pace (the week, not the quarter)
Be resilient and resourceful in face of ambiguity and thrive on (rather than endure) change
Bring critical thought and opinion
Use AI tools reflexively as part of your fundamental workflow
Embrace differences and disagreement to get shit done and move forward
Work digital-first for your daily work
Experience with Apache Beam, Google Cloud Dataflow, and ClickHouse
Proficiency in multiple programming languages – Kotlin, Ruby, Python, and Rust
Experience with dbt for elegant data modelling
Ability to handle late-arriving data in distributed streams
Experience with backfilling terabytes while maintaining real-time processing
Ability to architect lightning-fast real-time modelling that seamlessly combines data from multiple tables
Company
Shopify
Shopify is a cloud-based, multi-channel commerce platform designed for small and medium-sized businesses.
Founded in 2004
10001+ employees
H1B Sponsorship
Shopify has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (57)
2024 (37)
2023 (9)
2022 (84)
2021 (41)
2020 (13)
Funding
Current Stage
Public CompanyTotal Funding
$122.25MKey Investors
Bessemer Venture PartnersKlister Credit
2015-05-21IPO
2013-12-11Series C· $100M
2011-10-17Series B· $15M
Leadership Team
Tobias Lütke
CEO
Mikhail Parakhin
Chief Technology Officer
Recent News
BNN Bloomberg
2026-01-13
2026-01-13
2026-01-13
Company data provided by crunchbase