Senior Data Platform Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Crustdata (YC F24) · 4 months ago

Senior Data Platform Engineer

Crustdata is a startup focused on building robust data systems, and they are seeking a Senior Data Platform Engineer to design and maintain their data platform. The role involves architecting core data infrastructure, developing data pipelines, and enabling data science and machine learning initiatives.

Software
check
H1B Sponsor Likelynote

Responsibilities

Architect & Build: Design, build, and maintain our core data infrastructure, including our data warehouse and data lake, using modern cloud technologies (AWS, GCP, or Azure)
Pipeline Development: Develop and scale robust, fault-tolerant data pipelines (ETL/ELT) to ingest and process massive volumes of structured and unstructured data from diverse sources
Enable Data Science & ML: Create the foundational platform to support our data scientists and ML engineers. This includes building systems for feature engineering, model training, and deploying ML models into production
Orchestration at Scale: Implement and manage workflow orchestration for hundreds of daily data jobs, ensuring reliability, monitorability, and efficiency using tools like Airflow, Dagster, or Prefect
Real-time Infrastructure: Build and manage real-time data streaming pipelines using technologies like Kafka or Flink to power live dashboards and time-sensitive product features
Data Quality & Governance: Champion data quality and reliability. Implement frameworks for data validation, testing, and monitoring to ensure our data is accurate and trustworthy

Qualification

Data engineeringCloud technologiesBig data technologiesPipeline orchestrationReal-time streamingPythonData qualityStartup mentalityProblem solving

Required

3+ years of professional software engineering experience, with a significant focus on data engineering or building backend systems at scale
Strong programming skills in Python or another modern language (e.g., Java, Go)
Hands-on experience with modern big data technologies such as Spark, Flink, or Dask
Practical experience with workflow management tools like Temporal, Airflow, Dagster, or Prefect
A pragmatic problem-solver who can navigate ambiguity, manage complexity, and take ownership of projects from inception to completion
Excited to work in a fast-paced, collaborative environment and wear multiple hats

Preferred

Experience with real-time streaming technologies (Kafka, Pulsar, Kinesis)
Familiarity with containerization and orchestration (Docker, Kubernetes)
Knowledge of modern data warehousing and lakehouse architectures (e.g., Delta Lake, Iceberg)

Company

Crustdata (YC F24)

twittertwittertwitter
company-logo
People and Company Search for AI Power any AI agent in sales, recruitment and investment with the freshest, most trusted data.

H1B Sponsorship

Crustdata (YC F24) has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (3)

Funding

Current Stage
Early Stage
Total Funding
$12M
Key Investors
Y Combinator
2025-10-22Seed· $6M
2024-12-04Seed· $6M
Company data provided by crunchbase