Duckbill · 10 hours ago
Data Engineer
San Francisco, CA
Full-time
Hybrid
Mid Level
3+ years expDuckbill is developing a SaaS product that simplifies financial planning and analysis of cloud billing data for large enterprises. They are looking for a Data Engineer to design and maintain ETL pipelines that process complex cloud billing data, ensuring data quality and ownership.
Information Technology & Services
Responsibilities
Build and maintain ETL pipelines processing hundreds of millions of rows of cloud billing data
Work with ClickHouse, Parquet files, and S3 to design efficient data storage and retrieval systems
Develop data validation and quality control systems using Python and SQL
Design data models for complex, evolving cloud billing schemas (AWS CUR and beyond)
Build and optimize Airflow workflows for reliable data processing
Collaborate with the entire engineering team to investigate and resolve data quality issues
Scale data infrastructure as we expand to new cloud providers and use cases
Qualification
Required
3+ years experience with data products: warehouses/lakehouses/OLAPs, ETL pipelines, or job queues
Software engineering experience, with intermediate Python experience
Strong SQL skills including CTEs, window functions, and query optimization
Experience with data validation and quality control systems
Comfortable with columnar databases, Parquet, and cloud storage (S3)
Ability to deliver results in hours instead of days
Some experience in a startup environment, or ability to work well in a startup environment
Fastidiousness about data quality and comfort when there's no answer key
Preferred
Experience with ClickHouse or other OLAP datastores
Past experience with cost management tools and/or cloud billing data
Experience with Airflow or similar workflow orchestration tools
Backend engineering experience beyond data pipelines
Company
Duckbill
Cloud cost management doesn’t have to be bewildering.
11-50 employees
H1B Sponsorship
Duckbill has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2024 (1)
2023 (1)
Funding
Current Stage
Early StageLeadership Team
Mike Julian
CEO & Cofounder
Recent News
2025-08-21
2025-05-01
Company data provided by crunchbase