The other day a colleague asked me to review a new end-of-course “Level 1 Reaction” survey he was about to launch for a series of on-line leadership programs. He also wanted to know how to use Predictive Evaluation (PE) techniques with the survey. Cool question – see my answer below.

Your end of course questionnaire is a typical Kirkpatrick Level instrument and is well written. Suggestion for implementing PE: set a “success gate” for the Level 1 results before delivery. To do that you could:

• Define each response on the survey as “Good” and “Bad”.
  
  
• For example the questions with the response possibilities of E=Excellent VG=Very Good G=Good F=Fair P=Poor could have E and VG as good with G, F, and P as bad.
• Set a success gate of acceptable responses such as 90% of the participants will choose E or VG.
• If the success gate is achieved or exceeded = CELEBRATE! If the gate is not achieved, then begin investigation into why and determine appropriate corrective actions if warranted.