Traditional Angoff standard setting exercises often pose a significant challenge for subject matter experts (SMEs). SMEs can find the concept to be a bit nebulous and challenging because it is difficult to estimate all of the reasons minimally qualified candidate would answer the questions correctly. After a while, they often start using the Angoff ratings as a continuous difficulty scale, with 0 being the hardest and 100 being the easiest. They also tend to rate items based SOLEY on how many minimally qualified candidates will actually KNOW the correct answers--excluding random guessing and the ability to eliminate implausible options. This new approach to the traditional Angoff methodology not only improves the consistency of the SMEs’ ratings, but also greatly simplifies their task by helping them focus on all aspects of candidates’ performance on the items by combining the results of their own evaluation to present them with a recommended Angoff score for each item.