Crustdata (YC F24) · 4 months ago
Senior Data Platform Engineer
Crustdata is a startup focused on building robust data systems, and they are seeking a Senior Data Platform Engineer to design and maintain their data platform. The role involves architecting core data infrastructure, developing data pipelines, and enabling data science and machine learning initiatives.
Software
Responsibilities
Architect & Build: Design, build, and maintain our core data infrastructure, including our data warehouse and data lake, using modern cloud technologies (AWS, GCP, or Azure)
Pipeline Development: Develop and scale robust, fault-tolerant data pipelines (ETL/ELT) to ingest and process massive volumes of structured and unstructured data from diverse sources
Enable Data Science & ML: Create the foundational platform to support our data scientists and ML engineers. This includes building systems for feature engineering, model training, and deploying ML models into production
Orchestration at Scale: Implement and manage workflow orchestration for hundreds of daily data jobs, ensuring reliability, monitorability, and efficiency using tools like Airflow, Dagster, or Prefect
Real-time Infrastructure: Build and manage real-time data streaming pipelines using technologies like Kafka or Flink to power live dashboards and time-sensitive product features
Data Quality & Governance: Champion data quality and reliability. Implement frameworks for data validation, testing, and monitoring to ensure our data is accurate and trustworthy
Qualification
Required
3+ years of professional software engineering experience, with a significant focus on data engineering or building backend systems at scale
Strong programming skills in Python or another modern language (e.g., Java, Go)
Hands-on experience with modern big data technologies such as Spark, Flink, or Dask
Practical experience with workflow management tools like Temporal, Airflow, Dagster, or Prefect
A pragmatic problem-solver who can navigate ambiguity, manage complexity, and take ownership of projects from inception to completion
Excited to work in a fast-paced, collaborative environment and wear multiple hats
Preferred
Experience with real-time streaming technologies (Kafka, Pulsar, Kinesis)
Familiarity with containerization and orchestration (Docker, Kubernetes)
Knowledge of modern data warehousing and lakehouse architectures (e.g., Delta Lake, Iceberg)
Company
Crustdata (YC F24)
People and Company Search for AI Power any AI agent in sales, recruitment and investment with the freshest, most trusted data.
H1B Sponsorship
Crustdata (YC F24) has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (3)
Funding
Current Stage
Early StageTotal Funding
$12MKey Investors
Y Combinator
2025-10-22Seed· $6M
2024-12-04Seed· $6M
Recent News
Tech Startups - Startups and Technology news
2025-11-12
Tech Startups - Startups and Technology news
2025-11-12
Company data provided by crunchbase