#1: Chapter 10 discusses evaluation in instructional design and provides you with two evaluation models, the CIPP and Kirkpatrick models for evaluation. Search for at least two other models used and summarize these models. Describe how you would use them to evaluate your instruction.
This was a challenge for me this week, because I use the Kirkpatrick in everything we do at work. It is applicable to our trainings as well as our eLearnings. I am blessed to have a trainer that is certified in all levels of Kirkpatrick. That said, I found it interesting that our chapter did not favor this common system and was especially interested in the rationalization of its deficiencies. It caused me to have discussion with my trainer to get her opinions and start some research on whether we should change or not. I doubt that we do in the long run, but it was good to have it brought to my attention.
As far as some other options, we use ADDIE and SAM which both include a time frame for evaluation of your product/instruction. ADDIE has been our standard, but we are slowly switching to SAM for our eLearnings. SAM is a Successive Approximation Model. It includes less steps than ADDIE and produces work much faster.
I also skimmed through Phillip's Five-Level Training Evaluation Framework found at this link.
Reflect on what other questions that instructional design evaluation should address besides whether the instruction design leads to comparable amounts of learning and learner satisfaction as traditional methods. What else would be useful to know?
I will fall back to the SAM model on this one, since I feel that it addresses questions that are often overlooked. It began with with developers questioning what defines good learning events. From an eLearning perspective, they felt the fundamental characteristics should be meaningful, memorable, motivational, and measurable. They followed the CCAF: Context, Challenge, Activity, and Feedback model to develop courses because these four areas were useful.
Chapter's 12 & 13 focus on project management and how to manage projects when resources are scarce. You have been assigned to develop a series of professional development sessions focusing on technology use in the classroom for teachers during a time of economic decline. How will you use Situational Leadership to facilitate this project and manage scarce resources?
It would be nice to always be able to spend as much time as we wanted on developing courses. As a project manager, it is impossible to do so in the current economic times. We must do more with less. In this scenario, I would first pool my resources and find SMEs to be part of a mini-team in helping to develop the sessions. Since no one leadership style is used in Situational Leadership, a combination will have to suffice to get the job accomplished. Many hats will be worn by the project manager, since he/she will have to serve in more than one roll due to the economic conditions. I would use technology as the method of deliver for the teachers. A course of several modules developed over a short time span, with the help of the SMEs, would reach more people and be more cost effective.
Jennifer,
ReplyDeleteI certainly got a feel for how accomplished you are in your profession by reading your blog. You mentioned different evaluation models that I would like to learn more about. My only experience in education to date is instruction and small power point didactic material.
While your blog is efficient and you gained some insight into possible problems with Kirkpatrick’s evaluation system, I was not able to appreciate the same insight. This comes from my limited background.
Your in depth knowledge of these programs and how they function in production of an instructional design model is impressive to me. I would have enjoyed more detail in your descriptions of using these methods in your work. However, I did make some notes in regards to areas I may want to research in the future. It benefits me greatly in comprehension to see examples of real world situations that call for using these methods.
Differences you mentioned between the Addie and Sam systems and why Sam is proving to be the more useful system in your work would have been interesting to learn. What is it about Sam that is more efficient? Do you feel you would have a better end product with this system? What are your thoughts on whether or not these methods would end in a design more likely to be accepted system wide in an organization?
Hi, Dawn,
DeleteAs we are in the infant stages of a project we are 100% using with SAM instead of ADDIE, I'd say that some of the major differences so far is the elimination of weeks of analyzing and storyboarding (only to go back to the drawing board once the group met again). The group met that morning to discuss purpose of eLearning, needs of it, and threw around some idea. Then, they went to another meeting and lunch while I worked on a "prototype" for them to see when they came back from lunch. Yes, this sounds like a storyboard, but it was really a very rough eLearning product. It was great! The discussion and feedback were immediate, we all knew and agreed on the direction it was going before we left that day, and (so far) no one has deviated or tried to leave the original plan. All this literally happened in one day. With ADDIE, it would be a 2-3 week phase. This is going to really streamline the project, produce work much faster, allow for more of the feedback stage, and reduce costs all the way around.
I really like the SAM model. I definitly believe important types of learning is overlooked, as you pointed out in your blog post. One of the key elements I like about SAM, was that is focued on if the learning process is memorable. To me, the best way for students to learn is if they are attracted to what it is they are learning, can apply what the are being taught, and are able to find a connection. The SAM model seems to really focus on these aspects of learing, and realizes that students learn best whenever they can relate to the content.
ReplyDeleteI feel after reading your post, that I have alot of learning to do in the realm of educational design. It boggled my mind a bit as well when the book focused on the deficiencies of the Kirkpatrick model, as it seems this has been a primary model for years.
ReplyDeleteI have never heard of the SAM model before, but i do like that it focuses on the realization that students learn best when content can be related to their daily lives. One of the biggest challenges we as teachers have is to relate content to our students. I also like that the SAM model has fewer steps compared to the other models like ADDIE, or the Kirkpatrick model. Great job on the post.