1. Improving and Focusing a Training Course using GroupSystems Electronic Meeting Technology Alan Weatherall Ventana UK alan.weatherall@ventana.co.uk

2. References This presentation is a summary of the following paper: –Weatherall, A., Improving and Focussing a Training Course using GroupSystems Electronic Meeting Technology, Hawaii International Conference of Systems Sciences, 2000. This paper, and others on related subjects can be found on www.emsl.co.uk.

3. Content Training development process Four-level evaluation of training Some current applications of GroupSystems in training and education Using GroupSystems interactively during a course Benefits

4. The Training Development Process Develop the course (Note: to be completed after the previous 3 steps) Define Training Requirements (different knowledge, skills and attitudes needed to achieve the performance requirements) Define the Performance Requirements (actions needed to achieve the business requirements) Define the Business Requirements (what the organization needs)

5. The Training Development and Evaluation Process Measure Business Results Measure Performance Results Measure Education Results Deliver the course Develop the course Define Training Requirements Define Performance Requirements Define Business Requirements

6. Four-level evaluation of training Level 1: participant satisfaction Level 2:knowledge, skills, attitudes acquired Level 3:knowledge, skills and attitudes used Level 4:business payback

7. Applications of GroupSystems in Training and Education Quality in Learning and Teaching –student feedback on course content –learning techniques Supporting the University Faculty –developing research questions –defining data elements –operation of the governance structure –academic issues for the 21 st century

8. Applications of GroupSystems in Training and Education (cont) Fifth Grade school –what would you like to learn? High School –mock jury trials –collective novel writing

9. Using GS interactively during a course Course description Starting the course During the course End-of-course feedback After the course Benefits –for course sponsor –for participants

10. Using GS interactively during a course Course description –to include measurable learning objectives ‘action’ words performance conditions criteria

11. Using GS interactively during a course Participant feedback when starting the course: –comments on the course objectives –any requirements not in the course objectives? –your experience of GroupSystems –planned GroupSystems activities that you plan –any other comments?

12. Using GS interactively during a course Feedback during the course (repeated as required): –what would you like to go over again? –too slow/too fast/about right? –what have you learned? –additional topics? –what’s good/what’s bad –are you still awake?

13. Using GS interactively during a course End-of-course feedback –covers level 1 and 2 feedback do you feel confident… overall satisfaction –shared immediately with the participants attitudes as well as skills After the course –level 3 and 4 feedback

14. Using GS interactively during a course Benefits for course sponsor –reduced course duration, achieved through consistent focus on most important topics honest and direct feedback –repeatable measurement of the course anonymous feedback where appropriate full recording and instant printout

15. Using GS interactively during a course Benefits for participants –reduced course duration –very easy to ask questions –relaxed –in charge of the learning process Participants in charge of the learning process!

16. Reduced course duration In the particular circumstances of one course, the techniques described in this paper helped reduce its duration by 75%. However, it is not suggested that such a reduction is generally achievable. This feedback technique has also helped reduce the course length a further 50%, by enabling a focus on the issues that were the most important for specific participants.

17. Feedback, comments or suggestions on this presentation would be very welcome alan.weatherall@ventana.co.uk phone: 44-2380-252817, mobile 44-410-418-208 fax:44-2380-268235