“The four-level Kirkpatrick-Katzell model is a clear and present danger. It sends numerous harmful messages.” Will Thalheimer
If you want to know what those harmful messages are, the information is on pages 7-10.
Will Thalheimer has developed The Learning-Transfer Evaluation Model, which is designed to help us determine whether our evaluation methods provide valid feedback. There are eight levels, starting with inadequate evaluation methods through to learning transfer effects.
Level 1 – Attendance, where the learner signs up, starts, attends, or completes a learning experience. This is unacceptable as a measure of learning.
Level 2 – Activity, where the learner engages in activities related to learning. However, learner attention, interest, and participation do not directly result in learning.
Level 3 – Learner Perceptions, where the learner is either queried in a way that reveals or does not reveal insights on learning effectiveness. This is an inadequate measure because it is not always related to learning results.
Level 4 – Knowledge, where the learner answers questions about facts or terminology. This does not necessarily enable performance or guarantee later retrieval.
Level 5 – Decision Making Competence, where the learner makes decisions given relevant realistic scenarios. When occurring after several days, it’s an adequate measure. It asks the question, “Do learners know what to do?”
Level 6 – Task Competence, where the learner performs relevant realistic actions and decision making. When occurring after several days, it’s an adequate measure. It asks the question, “Can learners actually do what they learned to do?”
Level 7 – Transfer, when the learner uses what was learned to perform work tasks successfully as clearly demonstrated through objective measures. Whether full or assisted transfer, it’s an adequate measure. It asks the question, “In targeted work situations, are learners being successful in using what they learned?”
Level 8 – Effects of Transfer, in which transfer can affect learners, coworkers/family/friends, the organization, the community, society, and the environment. It’s an adequate measure. It asks the question, “If learners have been successful in transfer, what effects has that transfer had on targeted and untargeted outcomes and stakeholders?”
Thalheimer recognizes that we will rarely use all levels in the model, which is okay. He believes we should use evaluation approaches from Levels 5 through 8 when we need to evaluate strategically important, costly, or continuing learning interventions.
A one-page sheet that shows the entire model can be found on my website.
I can help you learn how to design learning experiences that achieve transfer- or do it for you. Contact me.
May your learning be sweet- and safe.
#learningtransfer #trainingevaluation #transfer #evaluation #laurel&associates #learning
One page model: https://bit.ly/3BrvHtK