GamblingCareers.com · 8 hours ago
Sr Engineer Software
San Mateo, CA
Full-time
Hybrid
Senior Level
$160K/yr - $190K/yr
5+ years expGamblingCareers.com is seeking a Senior Software Engineer to join their Streaming Data Platform team. The role involves designing, building, and operating real-time streaming data pipelines to support near real-time analytics and diverse access patterns.
Casino
Responsibilities
Design, build, and operate real-time streaming data pipelines with low-latency delivery to MPP databases such as StarRocks, Apache Pinot, and Apache Druid
Implement and maintain data pipelines that handle moderate to high data skew, applying techniques like bucketing, salting, and adaptive partitioning
Work with Apache Iceberg tables for streaming workloads, including partitioning strategies, compaction tuning, file sizing, and snapshot management
Collaborate with platform and analytics teams to model data for different consumption patterns, including real-time dashboards and analytical queries
Optimize streaming jobs and storage layouts to improve query performance, reduce latency, and control infrastructure cost
Assist in diagnosing and resolving performance bottlenecks related to ingestion, skew, and distributed query execution
Contribute code, reviews, and documentation to shared data platform components and internal frameworks
Participate in design discussions and provide technical input on streaming architecture and data modeling decisions
Qualification
Required
5+ years of professional software engineering and/or data engineering experience
Kafka experience is a must (designing, building, and operating Kafka-based streaming systems in production)
Hands-on experience building and operating production streaming pipelines with low-latency requirements
Experience integrating streaming systems with MPP analytical databases such as StarRocks, Apache Pinot, or Apache Druid
Solid understanding of data skew challenges and mitigation techniques (bucketing, salting, repartitioning, adaptive strategies)
Working knowledge of Apache Iceberg for streaming or near-real-time workloads, including table layout and compaction concepts
Proficiency in Java and/or Python
Strong SQL skills and understanding of distributed query execution and performance tuning
Familiarity with data distribution strategies such as tablet distribution, bucketing, and colocation concepts
Experience operating data pipelines in production, including monitoring, alerting, and incident response
Preferred
Experience contributing to open-source data or analytics projects
Exposure to materialized views, primary key models, or real-time OLAP optimizations
Experience working with large-scale event-driven architectures and high-throughput data systems
Benefits
Wellness programs with fitness and weight management partners
Paid maternity paternity leave
Infertility treatment
Flexible time off
Competitive 401k plan
Company
GamblingCareers.com
GamblingCareers.com is the leading job board for the iGaming and Online Gambling industry, dedicated to bridging the gap between talented job seekers and top employers in the sector.
2-10 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase