MTM Measurement Initiative Instructor Overview

What is this initiative? A way for us to get better We will be using data and feedback we collect through a system called Metrics that Matter (MTM) to make improvements with the content we deliver, the way we train, the way learners practice, and the way we operate. Simply put, we’re collecting better data so we can make better decisions. This includes evaluation data on your delivery, the content as well as the classrooms and the technology used as part of the training.

Makes your job easier Improved performance How does it impact you? You and the learners will have the opportunity to provide feedback on the courses you deliver The data will help us to remove roadblocks and barriers to enable you to deliver training with better content and better training resources Improved performance Receiving regular feedback from the learners will help you take action to improve course delivery

We need your help! To help remove barriers for you and optimize your ability to perform, we need supporting data. We can’t do this without you Talk about the evaluations and their importance in class (using this slide and script) Encourage the learners to complete them and to provide candid feedback. We want to hear from you too The feedback you provide can have a huge impact. Take a few minutes to complete the evaluations we send to you. Document your stories. When you use the data to make improvements, facilitate change, or leverage successes – write it down so it can be leveraged for knowledge-sharing and used in communications. Instructor Resources for in-class communication: http://knowledgeadvisors.force.com/knowledgeHome/articles/MTM_Knowledge_Article/Standard-Slide-for-Communicating-Evaluation-Process http://knowledgeadvisors.force.com/knowledgeHome/articles/MTM_Knowledge_Article/Standard-Script-for-Communicating-Evaluation-Process-In-Class

Getting the Critical Feedback Communicate in Class Students Complete Evaluation Complete Instructor Evaluation Communicate evaluation process and benefits: At class start Near class end *Download this slide and script* If via email: Communicate process Encourage completion If in-class: Direct students to URL Provide adequate time Provide your feedback: Course content Logistics Class environment Right trainees, right class, right time (Instructor Resources for in-class communication: http://knowledgeadvisors.force.com/knowledgeHome/articles/MTM_Knowledge_Article/Standard-Slide-for-Communicating-Evaluation-Process http://knowledgeadvisors.force.com/knowledgeHome/articles/MTM_Knowledge_Article/Standard-Script-for-Communicating-Evaluation-Process-In-Class) Speaker Notes In order to gather feedback from your learners and you, this is what will happen: At the beginning of a training class, you will explain the evaluation process and the importance of completing the evaluations to your training class attendees. In regards to the importance, it is key that we let them know that their evaluation feedback measures course satisfaction and job relevance, helps refine our training programs to better meet their learning and growth needs, and vital to our striving to improve quality and increase job impact. In regards to the process, the evaluation will take 5-7 minutes for a training attendee to complete. There are two different ways these evaluations can be administered – either in class on a break a few hours before the very end of class via a url, so that the students are focused on completing the evaluation, and not rushing out the door; or, post-class via an email link that will be sent to their email address. If it is via an email link post class, it is important to re-communicate the process and importance near the end of class to the students, and ensure they are provided adequate time to complete the class evaluation. The students would then complete the class evaluation online. If they have not completed the evaluation over a certain period of time, MTM will send them reminder emails for them to complete their evaluation. Students will also receive an additional evaluation to complete a couple of months after the training, to assess how they have been able to apply the training to their job, ensuring that the training we provide is applicable and practical to them and their job, and enable future trainings to have an even greater impact. Additionally, there will be an instructor class evaluation that you will fill out in MTM, to provide your feedback on how the class can be improved in such areas as course content, logistics, class environment, and if the right trainees are in the right class at the right time. All of this feedback is critical to how we improve our classes. (

Your actions make the learner experience better You are a Key Player Your actions make the learner experience better As an effective instructor, you: Increase learner satisfaction Increase the impact the training has on the learner’s job Make training a more valuable experience Strive for excellence Identify improvement opportunities Class and professional development Play your part in our broader organizational improvement Speaker Notes Research has shown that the more effective an instructor is, the greater the satisfaction of the learner and the more they get out of the class. Ultimately, we want to strive for excellence, and the feedback from the class evaluations will help us to do this. We will be receiving feedback that we can use to continuously improve course content, training logistics, and ensuring the right employees are attending the right training at the right time. Additionally, the feedback you receive in your reports should be used as professional development opportunities for all of you. With the use of MTM, we will be able to provide you with information you can use to develop your own skills, and to become a better instructor. You will receive great feedback, to help you continuously improve your skills, so look for ways to develop yourselves based on the report feedback. By doing this, we will be able to continuously improve the impact and value to the organization from our efforts. The more we can increase the value and impact of training, the more valued and respected the training organization will be. With the results from MTM, we will receive feedback about how the training we deliver is used on the job, what the impact is, what the manager’s level of engagement is, and how behavior change is occurring. We will be able to show both qualitative and quantitative results to the business areas and senior management regarding the results and impact of the training we deliver. Therefore, use the feedback you receive to identify how you can continuously improve different areas about the classes, how you can develop yourself, and how you can play your part in our broader organizational improvement, so that you are always striving for excellence.

Your help in this process is appreciated. We look forward to making our organization better…together!

Appendix: About MTM

Metrics that Matter (MTM) Leading system dedicated to Learning & Talent reporting Automated data collection from learning evaluations Practical, scalable, and repeatable measurement Focused on job impact and business results Used by top organizations, including those that have received the following honors: CLO LearningElite Training 125 Hall of Fame ATD Best Brandon Hall Excellence Speaker Notes And the tool we decided on was Metrics that Matter (MTM) from CEB. What is Metrics that Matter, and why did we select this as the tool? As I mentioned, we were looking for a leading system that would automate data collection from learning evaluations, and also whose core was in Learning & Talent reporting. We wanted a solution for evaluations that was practical, easy to use, and scalable across the entire organization, and also that we could use repeatedly across our training solutions. Metrics that Matter (MTM) is all of those things. Additionally, we were looking for a tool that helped us to help us show the value of the training that we deliver to the rest of the organization. That is, a tool that helped us to show what the job impact is once an attendee goes back on the job, and how that impacts business results. MTM helps us to do this. Finally, MTM is by top organizations across a broad set of industries, including award winning training organizations as you can see here, that we want to be in the company of.

In Summary Metrics that Matter® allows us to… Implement end-to-end automated class evaluation process Use consistent approach across all classes Increase the impact of the training organization Communicate our value to the business Continuously improve Recognize excellence Speaker Notes Instructions for Use: It is recommended that you add your own organizational benefits as you talk through this slide In summary, Metrics that Matter® allows us to do several things, including activities we could not do before: Implement an end-to-end automated class evaluation solution and process that allows us to use a consistent approach across all classes Enables us to use the feedback from a simple and effective class evaluation process to communicate and show our business value Increase the value and impact of the training organization to the business and our customers Continuously improve, based on the feedback from our ‘customers’, both our courses and our own delivery Finally, as we integrate MTM into our own development processes throughout the year, we will look at ways for how we can create approaches to recognize excellent performers as a result of MTM feedback, and how to incorporate the feedback into our performance management process. We are very excited about the use of MTM in our class evaluation process, and the impact it has on our customers, our training organization, and the business as a whole. Are there any questions that I can answer?