Murphy & Associates, Inc. · 22 hours ago
Principal UX Researcher
United States
Contract
Remote
Lead/Staff
$86/hr - $112/hrMurphy & Associates, Inc. is a technology consulting firm that has been serving diverse clients in the Greater Seattle Area since 1980. They are seeking a Principal UX Researcher to collaborate on high-impact projects aimed at enhancing the development and evaluation of AI systems, focusing on data identification and human-centered evaluation frameworks.
Information Technology & Services
Responsibilities
Develop criteria and protocols for identifying problematic data in AI training datasets
Implement a tracking system to monitor flagged data instances across the lifecycle of AI models
Establish guidelines for intervention and remediation of problematic data
Define key properties and operational criteria for agentic mental models in AI
Develop prototype models that demonstrate agentic reasoning and decision-making processes
Assess the interpretability and robustness of agentic mental models through empirical studies
Identify and formalize human-centered criteria for AI model evaluation
Develop and test evaluation tools and protocols incorporating user feedback and behavioral studies
Generate actionable recommendations for integrating human-centered evaluation into AI development cycles
Qualification
Required
Experience in UX research with a focus on AI systems
Proficiency in developing criteria and protocols for data identification in AI training datasets
Ability to implement tracking systems for monitoring flagged data instances
Experience in establishing guidelines for intervention and remediation of problematic data
Knowledge of agentic mental models in AI and their operational criteria
Experience in developing prototype models demonstrating agentic reasoning
Ability to assess interpretability and robustness of AI models through empirical studies
Experience in identifying human-centered criteria for AI model evaluation
Ability to develop and test evaluation tools incorporating user feedback
Experience in generating actionable recommendations for integrating human-centered evaluation into AI development
Benefits
Health, dental, and vision insurance
401k
Company
Murphy & Associates, Inc.
Murphy: Empowering Businesses with Transformative Solutions Since 1980 Unlock new possibilities with Murphy, the trusted and award-winning talent solutions partner for over 150 clients in the Northwest and beyond.
Founded in 1980
51-200 employees
Funding
Current Stage
Growth StageLeadership Team
Joel Murphy
Chief Executive Officer
Judd Murphy
Chief Financial Officer
Company data provided by crunchbase