Software Engineer, Developer Experience & Evals jobs in United States
cer-icon
Apply on Employer Site
company-logo

Fireworks AI · 4 days ago

Software Engineer, Developer Experience & Evals

Fireworks AI is building the future of generative AI infrastructure, delivering high-quality models with fast and scalable inference. The Software Engineer, DevEx & Evals will shape the platform by improving the developer journey through streamlined onboarding and optimized evaluation tooling.

Artificial Intelligence (AI)Data ManagementSaaSSoftware
check
H1B Sponsor Likelynote

Responsibilities

Unify the AI Lifecycle: Build a streamlined experience that connects our serverless inference, fine-tuning, and on-demand deployment products into a single, intuitive workflow
Streamline Developer Onboarding: Obsess over the 'Time to First Token' and 'Time to First Fine-tune.' Identify and eliminate friction points for new developers entering the platform
Architect Scalable Eval Tooling: Design full-stack features that support the continuous cycle of training and evaluation, providing deep insights into model quality that directly inform the next round of fine-tuning
Productize Inference Optimization: Build experiences that help developers optimize their GPU deployments for their specific workloads, guiding them on the right balance of throughput, latency, and model quality

Qualification

Software EngineeringGenAI Lifecycle UnderstandingInference OptimizationOpen Source ContributionsDomain-Specific EvaluationUser-Centric MindsetDeveloper Experience PassionStartup Experience

Required

1 - 7 years of software engineering experience (We are hiring at multiple levels for this role)
Passion for Developer Experience: You care deeply about API design, documentation, and the ergonomics of CLI/SDK tools
Understanding of the GenAI Lifecycle: You understand the end-to-end workflow—from prompting a base model to curating a dataset, fine-tuning, and productionizing agents—and how these steps interconnect
User-Centric Mindset: Willing to talk to users, triage GitHub issues for open-source projects, and build products from scratch to serve emerging needs

Preferred

3+ years of software engineering experience
Domain-Specific Evaluation Experience: Strong familiarity with designing and running evaluations for domain-specific use cases (e.g. medical, legal, coding, or custom internal datasets)
Open Source Contributions: Prior contributions to developer tools or AI/ML repositories
Inference & Hardware Knowledge: Interest in the hardware side of AI—understanding GPU constraints, inference optimization techniques, and how they relate to model performance
Startup DNA: Experience in fast-paced environments where you own features end-to-end

Company

Fireworks AI

twittertwittertwitter
company-logo
Fireworks AI is an advanced platform that enables users to build, tune, and scale AI applications using open-source models

H1B Sponsorship

Fireworks AI has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (11)
2024 (3)
2023 (1)

Funding

Current Stage
Growth Stage
Total Funding
$327M
Key Investors
Sequoia CapitalBenchmark
2025-10-28Series C· $230M
2025-10-28Secondary Market· $20M
2024-07-07Series B· $52M

Leadership Team

leader-logo
Lin Qiao
CEO and cofounder
linkedin
leader-logo
Aishwarya Srinivasan
Head of AI Developer Relations
linkedin
Company data provided by crunchbase