Roku · 9 hours ago
Conversational AI Agent Analyst
San Jose, CA
Full-time
Hybrid
Mid Level
$112K/yr - $153K/yr
3+ years expRoku is the #1 TV streaming platform in the U.S., and they are seeking a Conversational AI Agent Analyst to join their Product Management team. In this role, you will focus on generating data-driven insights and guiding the roadmap for customer-facing LLM-powered Bot products, analyzing key performance metrics to improve the bot experience.
AdvertisingAdvertising PlatformsDigital EntertainmentDigital MediaHardwareInformation ServicesMedia and EntertainmentSoftwareTVVideo Streaming
Hiring Manager
Shelby Ruff
Responsibilities
Analyze Bot Performance: Evaluate the performance of existing and new bot features by tracking and interpreting key bot KPIs, including Bot CSAT (Customer Satisfaction) scores, Bot Containment Rate, Bot Accuracy Rate, Bot Recontact Rate, and more. Identify trends, gaps, and areas for improvement in these metrics. Transform data and customer interaction logs into actionable insights. Provide a precise analysis of what’s driving bot success or failure
Drive Product Improvements: Work closely with product managers, customer service operations, and our 3rd party bot vendor to prioritize enhancements and fixes for the bot based on your analyses. Use your findings to shape the product roadmap and ensure development efforts align with user needs and business goals. Partner with engineering, design, customer support, and QA teams to communicate Bot performance results and customer pain points. Advocate for users by sharing data-backed stories that highlight opportunities to refine the conversational AI experience
Product Quality Ownership: Own creation of test cases and hands-on testing of any new bot releases. Work with cross-functional stakeholders to ensure test cases are executed, triaged, and driven to resolution. Work with internal stakeholders and our vendors to ensure bugs and enhancement requests are prioritized and completed on time
Reporting & Monitoring Improvements: Work with internal data science teams and our bot vendor to maintain and update dashboards in Looker as well as on our 3rd party bot system, to ensure they are providing necessary insights
Bot System Administration: Be the single point of contact for bot system administration tasks, ensuring system configurations are updated and optimized as needed
Qualification
Required
3+ years of experience in business analysis, product analytics, data analysis, or quality assurance, preferably working with customer-facing technology or AI-powered tools
Bachelor's degree in a relevant field (e.g., Business, Data Science, Computer Science, or related discipline) or equivalent practical experience
Familiarity with conversational AI systems, LLMs, Bots, or virtual assistants, and an understanding of customer service metrics. Experience specifically with Bot performance analysis is a plus
Proven ability to analyze large datasets and derive meaningful insights. Comfortable working with metrics and KPIs to evaluate product performance. Not afraid to roll up your sleeves and manually analyze bot conversations. Proficiency with Excel, BI tools, or data visualization software to analyze and report on performance trends. Experience writing SQL queries for data analysis is a plus (SQL is nice-to-have, but not a strict requirement)
Excellent written and verbal communication skills. Able to clearly present findings and recommendations to both technical and non-technical stakeholders. Strong storytelling skills with data – capable of crafting clear narratives around bot performance and customer experience for various audiences
Experience working in cross-functional teams and the ability to influence product decisions through data-driven storytelling
A proactive and curious mindset with strong problem-solving skills. Detail-oriented when diagnosing issues and evaluating the bot's accuracy and effectiveness. Enthusiasm for learning about the latest AI tools and techniques, and applying that knowledge to improve Roku's conversational AI products continuously
Ability to thrive in a fast-paced environment and adapt as the product and business needs evolve
Excellent organization and time management to handle multiple analyses and reporting deadlines
Benefits
Health insurance
Equity awards
Life insurance
Disability benefits
Parental leave
Wellness benefits
Paid time off
Healthcare (medical, dental, and vision)
Life
Accident
Disability
Commuter
Retirement options (401(k)/pension)
Company
Roku
Roku develops video streaming devices that provide users access to Internet-streamed video or audio services.
1001-5000 employees
H1B Sponsorship
Roku has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (120)
2024 (166)
2023 (81)
2022 (279)
2021 (195)
2020 (107)
Funding
Current Stage
Public CompanyTotal Funding
$220.61MKey Investors
News CorpFidelityGlobespan Capital Partners
2017-09-28IPO
2015-11-09Series H· $45.5M
2015-11-01Secondary Market
Leadership Team
Preston Smalley
VP of Viewer Product
T
Thomas Dodson
Vice President of Platform Operations
Recent News
Sherwood News
2026-01-13
Company data provided by crunchbase