Thinking Machines Lab · 1 month ago
Software Engineer, Data Infrastructure
San Francisco
Full-time
Onsite
Mid Level
$350K/yr - $475K/yrThinking Machines Lab is dedicated to advancing collaborative general intelligence and making AI accessible for everyone. The role involves contributing to data infrastructure, focusing on architecting and scaling core infrastructure for distributed training pipelines and intelligent processing systems for large datasets.
Artificial Intelligence (AI)Foundational AIGenerative AIInformation TechnologyProduct ResearchSoftware
Responsibilities
Design, build, and operate scalable, fault-tolerant infrastructure for LLM Research: distributed compute, data orchestration, and storage across modalities
Develop high-throughput systems for data ingestion, processing, and transformation — including training data catalogs, deduplication, quality checks, and search
Build systems for traceability, reproducibility, and robust quality control at every stage of the data lifecycle
Implement and maintain monitoring and alerting to support platform reliability and performance
Collaborate with research teams to unlock new features, improve data quality, and accelerate training cycles
Qualification
Required
Bachelor's degree or equivalent experience in computer science, engineering, or similar
Proficiency in at least one backend language (we use Python or Rust)
Are fluent in distributed compute frameworks such as Apache Spark or Ray
Are deeply familiar with cloud infrastructure, data lake architectures, and batch and streaming pipelines
Comfort operating across the stack and owning projects end-to-end
Thrive in a highly collaborative environment involving many, different cross-functional partners and subject matter experts
A bias for action with a mindset to take initiative to work across different stacks and different teams where you spot the opportunity to make sure something ships
Preferred
Have hands-on experience with Kafka, dbt, Terraform, and Airflow
Have experience building a web crawler
Have extensive experience understanding and scaling deduplication, data mining, and search
Have strong knowledge of file formats and storage systems (e.g., Parquet, Delta Lake, etc.) and how they impact performance and scalability
Are proactive about documentation, testing, and empowering your teammates with good tooling
Benefits
Generous health, dental, and vision benefits
Unlimited PTO
Paid parental leave
Relocation support as needed
Company
Thinking Machines Lab
Thinking Machines Lab is an AI research and product company that aims to increase understanding and customization of AI systems.
Founded in 2025
11-50 employees
H1B Sponsorship
Thinking Machines Lab has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9)
Funding
Current Stage
Early StageTotal Funding
$2.01BKey Investors
Andreessen HorowitzMinistry of Economy, Culture and Innovation
2025-06-20Seed· $2B
2025-05-05Grant· $9.98M
Leadership Team
Mira Murati
Co-Founder and Chief Executive Officer
Recent News
Morningstar.com
2026-01-11
Business Insider
2026-01-06
Crunchbase News
2026-01-02
Company data provided by crunchbase