Apply on Employer Site

Pluralsight · 20 hours ago

Assessment Solution Strategist

United States

Full-time

Remote

Mid Level

$67K/yr - $93K/yr

3+ years exp

Pluralsight is a leading learning platform dedicated to enhancing the technology skills of the workforce. They are seeking an Assessment Solution Strategist to design and manage assessments that accurately measure skills and competencies, ensuring high-quality evaluation across various domains. This role involves collaboration with internal and external partners to create valid assessments aligned with educational goals.

E-LearningEdTechEducationInformation ServicesInformation Technology

Responsibilities

Design assessment blueprints and related assessment deliverables

Quality assessment performance management: item/test analysis, calibration, equating/scaling, reliability/validity checks

Data analysis and ongoing assessment monitoring and continuous quality improvement

Ensuring that assessment content aligns with curriculum standards, learning objectives, and educational goals

Leverage AI to optimize processes and deliverables

Establish guidelines and standards for creating assessment content to maintain consistency and reliability

Staying updated on best practices in assessment design and research to inform assessment development

Documentation of processes, procedures, and decisions related to assessment design, development and continuous quality monitoring and improvement

Design and develop valid and reliable assessments that align with learning objectives and competency frameworks

Monitors assessment portfolio across the assessment lifecycle

Manage SOWs for vendor relations

Collaborates with internal and external partners throughout the design, development, and deployment of assessments

Workload management, ability to handle multiple tasks and pay attention to detail

Individual workload project management

Staying current with assessment trends, learning science, and industry standards (e.g., AERA, APA, NCME)

Support the development of digital assets or other collateral as related to assessment

As required, provides training, consultation, or guidance to team members and partners on assessment models, assessment design and development practices, and data-driven, evidence-based practices in assessment

Performs other related duties as assigned

An appetite for curiosity and rapid innovation

Qualification

Assessment designPsychometricsData analysisQuality assuranceLearning management systemsTechnical content knowledgeProject managementAttention to detailCollaborationCommunication skillsGrowth mindset

Required

Bachelor's degree in academic, psychological or educational measurement, instructional design, psychometrics, or a related field

3+ years of relevant professional designing and developing high integrity assessments or background in educational measurement

Strong command of assessment types, taxonomy, and principles of validity and reliability

Excellent writing, editing, and quality assurance skills

Experience working with vendors, SMEs and cross-functional teams

Experience learning management systems (LMSs), authoring tools, and item banks

Innovation driven, growth mindset

Candidates should have strong organizational and project management skills to effectively manage multiple assessment development projects simultaneously, meet deadlines, and coordinate with team members

Strong analytical skills are important for analyzing assessment data, identifying trends, and making data-driven decisions to improve assessment content and processes

Attention to detail is crucial for ensuring the accuracy, clarity, and consistency of assessment content

Previous experience in assessment development, instructional design, curriculum development measurement, or a related field is required

Experience with technical/IT content or certifications (e.g., AWS, Azure, Python, security)

Background in psychometrics or data analysis using tools like Excel, R, or SPSS

Knowledge of accessibility and universal design for learning (UDL) standards

Experience with adaptive testing or automated assessment tools

Familiarity with Pluralsight platform and value proposition

Experience with SaaS software (eg. ZenDesk, Asana, Confluence, and Smartsheet)

Masters Degree or 3-5 years experience in assessment design, development or measurement