Evaluating Program Design Strategies: How Generalizable Are Disruptive Approaches?

-

Breakout Bayhill 23 - 24
PD Panel Discussion

Testing programs routinely seek opportunities to improve on existing design and practices to prepare for the next generation of their products or services, and often take an approach of gradual, incremental change. However, some national licensing boards in the US across multiple professions have chosen to dramatically rethink existing policies and practices. As licensure programs continue to evolve, what new factors should they consider for a reset of prerequisites, or eligibility and learning opportunities? In what new ways can achievement or competence be determined? What changes to policies and practices are needed to support program innovation? How can the testing industry respond to the need to evolve, while not abandoning core principles of validity, reliability, and fairness? Finally, how can these disruptions best be implemented to lay the groundwork for future disruptions from AI-based capabilities?

Join us for this session, where presenters with expertise in psychometrics, licensure, and practice will discuss how disruptive change that creates new policies and practices for licensing exams will impact several areas crucial for exam success. The generalizability of this model across sectors, and the importance of the perspectives of diverse stakeholders, will also be discussed.

Speakers
Partner
ACS Ventures, LLC
Director, Test Development Innovations
National Board of Medical Examiners