Galileo · 4 months ago
Software Engineer, Platform & Data Infrastructure
Galileo is the leading platform for Gen AI evaluation and observability, aiming to democratize the building of safe and reliable applications in AI-powered software development. The Software Engineer, Platform & Data Infrastructure role focuses on building and optimizing large-scale infrastructure and services that support real-time queries and data-intensive systems, ensuring high performance and reliability.
Artificial Intelligence (AI)Big DataDeveloper ToolsGenerative AIMachine Learning
Responsibilities
Build and scale core infrastructure – design and optimize distributed systems and APIs that handle millions of real-time queries with low latency and high reliability
Develop data-intensive systems – work across SQL, NoSQL, time-series, and object stores, ensuring data pipelines and lookups are optimized for throughput and efficiency
Optimize performance at scale – profile and tune systems for latency, throughput, and cost, ensuring the platform can grow with customer demand
Work on real-time serving systems – design high-throughput caching layers and data lookup services to enable fast, reliable access to large-scale datasets
Build and extend pub-sub and orchestration frameworks – leverage and improve systems like Kafka, RabbitMQ, and Celery to coordinate workloads and streaming data pipelines
Design internal developer tooling – create load testing, benchmarking, and performance analysis tools that help us and our customers understand and trust the system
Collaborate cross-functionally – partner with product, research, and application engineering teams to ensure the platform can support new capabilities, models, and workloads
Qualification
Required
Experience with large scale distributed systems
Experience with NoSQL databases and time-series databases
Worked on real-time high throughput caching systems
Excellent python programming skills
Worked with raw-data lookup indexes such as Lucene and/or similar frameworks
Experience with runtime orchestration and pub-sub frameworks like RabbitMQ, Celery, Kafka
Built low-latency data lookup APIs
Done extensive performance optimizations
Built internal tooling foundations for performance testing, load testing and benchmarking
Preferred
Experience with time-series or columnar databases (e.g., ClickHouse, TimescaleDB, DuckDB)
Familiarity with distributed query engines or streaming frameworks (Presto, Trino, Flink, Spark Streaming)
Hands-on with container orchestration and scaling systems (Kubernetes, EKS)
Experience building observability and performance tooling (Grafana, OpenTelemetry, flame graphs)
Benefits
Unlimited PTO
Parental Leave (birthing & non-birthing) – 100% pay for 8 weeks
Medical Insurance
Dental Insurance
Vision Insurance
401(k) Retirement Savings Plan
Pre-IPO Stock Options
Commuter Benefits (pre-tax + company sponsored)
Mental & Physical Wellness Stipend
Daily Meals Stipend
Company
Galileo
Galileo.ai is an AI platform that provides services for developing, testing, monitoring, and securing their AI applications.
H1B Sponsorship
Galileo has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (10)
2023 (4)
2021 (2)
2020 (1)
Funding
Current Stage
Growth StageTotal Funding
$68.1MKey Investors
Scale Venture PartnersBattery Ventures
2024-10-15Series B· $45M
2022-11-01Series A· $18M
2021-12-20Seed· $5.1M
Recent News
2025-12-22
The Motley Fool
2025-12-13
Company data provided by crunchbase