Best “practice”: Important Considerations in (auto)generating Practice Exams

-

Breakout Celebration 12 - 13
P Presentation

Certification programs have seen a growth in interest and utilization of Artificial Intelligence (AI) for item generation. Additionally, there is a renewed focus on how to efficiently create content to start engaging potential candidates with their programs. This session outlines a use case of a practice certification test that incorporates AI into its content development and the important considerations therein. An in-house AI engine was trained on a variety of program documents, including the exam blueprint and minimally-qualified candidate definition. Subject matter experts (SMEs) were then trained in item writing best practices and use of the AI tool to generate content, which was then reviewed, modified, and approved for use on the practice exam. The objective in this exercise is to glean learnings from using AI in a lower-stakes setting like a practice exam before implementing those learnings and practices into an operational testing environment. Lessons learned and recommendations for other programs looking to cautiously employ automated item generation into their exam development processes will be provided. 

Speakers
Psychometrician II
Alpine Testing Solutions
Learning Experience Manager
Veeam Software
Senior Psychometrician & Operations Manager
Alpine Testing Solutions