IMPACT EVALUATION SERIES: COLLECT IMPACT DATA FROM COMPANY RECORDS
You should now have a clear picture as to the impact that the training is providing and whether or not it is as predicted. An issue that exists with the current impact data is that it is self-reported via the Impact Survey and somewhat validated with the Impact Interviews. This is good and, many times, sufficient for you to produce the Impact Dashboard and draw your conclusions on the value of training. If you choose, you can further build your case by collecting data from existing company records. This type of data is known as extant data.
Extant data are existing data, information, and observations that have been collected or that are available for use in the assessment and evaluation processes. Basically, you analyze records and files that the company already has, rather than set out to gather additional information. Where and what files you look at depend on the impact being claimed by participants (e.g., sales figures, attendance figures, call-backs for repair, etc.). Customer e-mails, tech support log files, marketing and business plans, business requirements, documents, and vision statements are just a few of the types of information that help you validate the impact.
The quickest way to gather extant data is to ask High-Impact interview participants to provide the documentation that proves their case (assuming they have permission to share it with you). This typically comes in the form of presentations, spreadsheets, sales records, financial statements, manufacturing reports, time and motion studies, etc. When you receive the documentation, review it and ensure that you have sufficient information to validate claimed impact.
At times, the participant no longer has the backup documentation or it simply does not exist. This does not mean that you do not include the impact in your Impact Dashboard, but you may need to add a disclaimer to the report stating so.
Bringing Meaning to Impact Results
It is now time to bring meaning to the Impact results that you have collected. Do this by:
- Analyzing results and draw conclusions
- Is the training program contributing to achievement of the business outcomes?
- Collect training expense data
- Compare results & ROI to predictions in the Impact Matrix
Previous Blogs in the Impact Evaluation Series
Collect Detailed Impact Data from Successfully Adopted Participants
Interview Successful and Unsuccessful Participants (part 1 of 2)
Interview Successful and Unsuccessful Participants (part 2 of 2)
