Category: End of Course Questionnaire
Training Evaluation work processes need to be integrated with the following existing training and development processes:
- Instructional Design
- Course Development
- Course Delivery
Everyone wants to have the best end of course evaluation form for their courses. Too often, people copy other organizations forms because they like the questions without really thinking through the data the instrument needs to capture. Before developing your training / course evaluation form, answer these questions:
- How will the data be used? Understand the purpose of the training / course evaluation form. It must provide data that supports the purpose of the evaluation.
- How will the data be analyzed? Training / course evaluation form data is collected, tabulated, summarized, and reported to others. Design the training / course evaluation form so that data can be easily summarized and analyzed.
- Who will use the information? Identify the audience and how they plan to use the information from the training / course evaluation form.
- What facts are needed? Identify the specific data the training / course evaluation form needs to capture so that provides useful information.
- What is success? This is defining the Quality Gate or Q-Gate of successful results such as a mean value of 4.0 or greater on a 5-point scale.
Recently a client asked for a simple way of using the dashboard concept to share Level 1 evaluation data to her leadership training facilitators. A dashboard is a report to (in this case) facilitators that provides an at-a-glance perspective on their results and any comments. A good dashboard should facilitate discussion by highlighting metric status points, encouraging management by exception, where deviations from the norm become the focal points of discussion.
Below is a chart from the dashboard. What is way cool is that you can use Predictive Evaluation with these data. Simply set a percentage of acceptable responses as the success gate. For this example, a success gate could be 90% of the responses would be “Stronger Agree” or “Agree”. As you can see the question The instructor was easy to learn from met the success gate. The question The instructor was well prepared did not meet the 90% success gate. When results fall below the predicted metric (90%) then, as warranted, corrective actions can be put into place.
The other day a colleague asked me to review a new end-of-course “Level 1 Reaction” survey he was about to launch for a series of on-line leadership programs. He also wanted to know how to use Predictive Evaluation (PE) techniques with the survey. Cool question – see my answer below.