American Board of Ophthalmology ยท 6 hours ago
Assessment Design Manager
Pennsylvania, United States
Full-time
Remote
Mid Level
$100K/yr - $120K/yr
3+ years exp
Maximize your interview chancesHealth CareMedical
Insider Connection @American Board of Ophthalmology
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
Provides exam content development support for all ABO assessments.
Oversees program evaluation and improvement for all ABO assessments.
Develops, implements, and evaluates oral examiner training.
Oversees content outline reviews and revisions for all ABO assessments.
Contributes to organizational learning and development.
Conducts research on assessment innovations.
Develops the onboarding and training curriculum for ABO item writers and examiners.
Oversees the training of the oral examiners:
Develops and communicates the training schedule
Ensures all content within the training materials (manuals, slide presentations, video recordings) remains current and coordinates updates when needed
Secures and onboards the training presenters
Organizes and shares the virtual meeting logistics (e.g., Zoom links, calendar invitations)
Conducts, records, and runs training webinars/meetings.
Oversees content outline and test specifications development and revisions
Collaborates with the Exam Development Manager on item bank evaluation, identifying gaps, and developing workplans to support new item generation
Collaborates with the Volunteer Manager on the evaluation and training of all item writers and examinations.
Collaborates with the operations staff on the timeline and language for volunteer communication campaigns
Develops criteria for examination form assembly for all examinations with the Director of Psychometrics and Assessment
Assists the Director of Psychometrics and Assessment with key validation for all ABO assessments
Develops and supports policies and procedures related to examination security and item exposure
Collaborates with the Certification Experience team in development of materials for candidates related to the exam format, rules, and expectations
Oversees the evaluation of all assessment programs including but not limited to:
Identifying goals for item retention and performance
Designing, disseminating, and analyzing results of surveys
Coordinates assessment design changes with all relevant teams
Assists in evaluation of ABO assessments with compliance with professional standards, including but not limited to NCCA and ABMS Standards.
Conducts literature reviews and research related to assessment design (including but not limited to the use of AI in item generation and scoring, alternate item types)
Develops process improvement pilot projects
Collaborates with other boards and experts on exam design research and evaluation
Coordinates research meetings with internal and external researchers
Co-authors peer-reviewed research
Assists with/attends Initial Certification Committee meetings and/or other ABO Board and Committee meetings as requested
Supports basic data analyses, writing of reports or minutes, and/or other support tasks related to exam development
Conducts availability polls and schedules meetings for various teams (internal and external)
Attends staff meetings and collaborates with other teams
Attends and presents at professional conferences (e.g., ATP, AERA/NCME, ABMS)
Provides education to staff, Board of Directors, and others.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Advanced degree (MS, MEd) in Educational Psychology, Applied Psychology, Measurement, or related field
Able to learn new software applications and assimilate new material quickly.
Exhibits willingness to learn new skills and participate in professional development.
Communicates accurately and effectively, internally and externally.
Uses various applications to coordinate program tasks such as file management, scheduling, evaluation tracking, and survey tools.
Proficient with Microsoft applications (Word, Excel, Adobe, PowerPoint, and Outlook).
Minimum skills in MS Excel include creation of tables and Pivot tables, lookup functions, and use of basic statistical functions.
Preferred
Three or more years of experience in psychometrics or exam development, preferably in licensure or certification
Experience training subject matter experts
Experience implementing program evaluation
Proficiency with statistical software (e.g., R, SPSS, WINSTEPS)
Experience conducting research and communicating results through written and verbal communication
Track record of remote work success
Company
American Board of Ophthalmology
ABO was the first American Board established to certify medical specialists and is one of 24 specialtyBoards recognized by the ABMS & AMA.
11-50 employees
Funding
Current Stage
Early StageLeadership Team
Beth Ann Comber
Chief Operating Officer
Company data provided by crunchbase
