UX Engineer, LLM Experimentation Platform jobs in United States
cer-icon
Apply on Employer Site
company-logo

Arize AI · 3 weeks ago

UX Engineer, LLM Experimentation Platform

Arize AI is a leading AI & Agent Engineering observability and evaluation platform, empowering AI engineers to build high-performing applications. The UX Engineer will focus on refining user experiences for an LLM evaluation and prompt experimentation platform, making complex tools manageable and enjoyable for technical users.

AI InfrastructureArtificial Intelligence (AI)Information TechnologyMachine LearningSoftware
check
H1B Sponsor Likelynote

Responsibilities

Refine and iterate on UX for existing features - you won't build from scratch, but you'll make things significantly better
Watch real users struggle in Fullstory, identify friction points, and fix them
Prototype interaction alternatives rapidly (in Figma or code) to test different approaches
Work closely with our Senior engineers who own feature architecture - they build the foundation, you perfect the interface
Own the "feel" of the product: transitions, feedback, error handling, progressive disclosure
Build reusable interaction patterns that the team can leverage
Run lightweight usability tests to validate improvements
A typical week might include:
Watching 10 user sessions, identifying 3 common friction points
Prototyping 2 different flows for evaluator configuration in Figma
Implementing the winner with smooth transitions and helpful inline guidance
Pairing with Staff engineers to refactor a complex form into a multi-step wizard
Running a quick usability test with 5 users on the new onboarding flow

Qualification

UX refinementPrototyping in FigmaFrontend frameworksSession replay toolsDesign systemsAnimation librariesUsability testingEdge case considerationUser feedback incorporationB2B SaaS experience

Required

You've made products noticeably better through interaction refinement (show us!)
You're comfortable with modern frontend frameworks and animation libraries
You've used session replay tools and incorporated user feedback into designs
You can work in Figma to prototype before committing to code
You think about edge cases, loading states, and empty states automatically
You've worked on complex tools (dev tools, data tools, B2B SaaS) where UX really matters

Preferred

Bonus: You've built or contributed to design systems
Formal design training (though it's welcome)
Full-stack experience (we have engineers for that)
Experience with our specific tech stack (we care more about your UX sensibility)

Benefits

Medical
Dental
Vision
A 401(k) plan
Unlimited paid time off
A generous parental leave plan
Additional support for mental health and wellness

Company

Arize AI

twittertwittertwitter
company-logo
Arize is an AI engineering platform focused on evaluation and observability. It helps engineers develop, evaluate, and observe AI agents.

H1B Sponsorship

Arize AI has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2024 (1)

Funding

Current Stage
Growth Stage
Total Funding
$131.02M
Key Investors
Adams Street PartnersTCVBattery Ventures
2025-02-20Series C· $70M
2022-09-07Series B· $38M
2021-09-28Series A· $19M

Leadership Team

leader-logo
Jason Lopatecki
Founder - CEO
linkedin
Company data provided by crunchbase