1. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 1 5.1 Training for TVET staff in the use of alternative learning tools

2. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Romanian ODL Development Network and TVET Learning Environment 2

3. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Romanian ODL Development Network Aim: To provide Romanian Students and learners with world class online learning materials. 3

4. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Romanian ODL Development Network The Network 16 development centres distributed across Romania, each focusing on a different knowledge domain. 4

5. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Romanian ODL Development Network The People Each development centre will be managed by a coordinator who will work with materials designers and developers. 5

6. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Romanian ODL Development Network The Coordinator The coordinator’s role is to ensure that proposed designs are feasible; to match design requirements with technical capacity; to ensure that developments target priority areas; and to ensure that development costs are controlled. 6

7. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Romanian ODL Development Network The Designer The designer’s role is to identify areas of the curriculum where online learning could make a meaningful contribution to learner achievement. Designers will typically be subject experts with a strong focus on education issues. 7

8. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Romanian ODL Development Network The Developer The developer’s role is to carry out the technical implementation of the design. Developing a learning activity will often require several developers each providing their specialism: for example video, graphics, programming. 8

9. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Romanian ODL Development Network The workflow A teacher has an idea for an online activity They begin formalising their idea as a proposal The proposal is submitted to the appropriate development centre 9

10. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Romanian ODL Development Network The workflow The coordinator assesses the feasibility of the idea. If it is feasible, it is submitted to the National Centre The designer recieves feedback 10

11. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Romanian ODL Development Network The workflow The National Centre selects ideas for further development balancing the need to meet national and international priorities, budgets etc. Development centres recieve feedback 11

12. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Romanian ODL Development Network The workflow Development centres inform designers who should develop their design further The designer works with the coordinator to create a feasible design. 12

13. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Romanian ODL Development Network The workflow The coordinator identifies and timetables suitible developers The design is implemented The activity goes online 13

14. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Romanian ODL Network 14 Designer Coordinator Developer National Centre

15. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 TVET Learning Environment 15 Developed Content Learning Environment Built-in Features Teachers and Learners ICT Support?

16. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 TVET Learning Environment 16 Learning Environment Tracking Database School/Course reports User accounts/ administration Training §

17. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Elearning FreeMind mindmapping 17 Practice ‘Blended Learning’ Typical of kind of software to be encountered On-going staff development Upgrades Useful tool for ICT support! Install it…

18. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 ICT Issues Mindmap 18

19. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Freemind Download at: FreeMind Download Mac OS X and Windows versions on CD Tutorial FreeMind PDF document on CD 19

20. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 eLearning Video 20

21. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 eLearning ICT Support Issues Administrative Learning material development support Wider range of software Winder range of hardware New security considerations Always changing! 21

22. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 The National eLearning Platform Learner Management System Will be available - ? For demonstration purposes – Moodle Complete Course and Learner Management System Extensive ‘built-in’ feature set Dynamic database driven web site Repository of learning materials TVET Portal site 22

23. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Implementing eAssessment 23

24. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 eAssessment Advantages Allows ‘off-line’ practice and revision Instant scoring Flexible access – on demand? Enhance feedback to learners Administrative benefits – results reporting Easily linked with other learning ‘objects’ Widens range of assessment methods 24

25. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 eAssessment Security 1 Learner responses stored on remote server Backup daily or x2 Saved locally if network down Timing can be reset Responses not cached on client PC Secure browser window 25

26. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 eAssessment Security 2 Isolate to IP address Consider PC suite for eAssessment Randomise question order Randomise question options order Randomise values (numeric) Random question selection from a question bank 26

27. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 eAssessment Software Navigation Consistent Navigate to any question Confirm quit/end Questions can remain unanswered Help on all screens + paper 27

28. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 eAssessment Reporting Comprehensive database Scores, averages When assessment completed Time taken Responses chosen Question Statistics – validity, discrimination Manual review Printed reports Formats for teachers / verifiers Question analysis 28

29. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 eAssessment Interoperability Import / export questions Import / export assessments Import / export results IMS/QTI v2 29

30. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 eAssessment Accessibility Compatibility with Screen readers Speech recognition Touch screens Images Alternate text Keyboard navigation Text / CSS adjustments 30

31. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 How to write good MCQs

32. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 In this session What is assessment? What is the purpose of assessment? Types of assessment instruments MCQ structure, design, do’s and don’ts?

33. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Assessment in the learning process. Assessment of learning Learning Activities LEARNER Learning Objectives

34. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 What is assessment? The process of: Planning for evidence collection Collecting of evidence Interpreting the collected evidence Using the evidence

35. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 What is the purpose of assessment? Formative To support the learner in the learning process Diagnostic What does the learner know now? Are there gaps in understanding? Summative Pass or Fail?

36. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Types of assessment instruments Multiple choice questions True – False items Matching items Short answer / concise response Many more….

37. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Types of assessment instruments Fill in the blanks Essay / extended response Report writing Open book assignment Take-home assignment

38. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Multiple choice questions What are they? A question in which learners are asked to select one alternative from a given list of alternatives in response to a "question stem". Stem "Which one of the following is the currency unit used in Zambia?"

39. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Multiple choice questions Alternatives (answer choices/ options) A Zambian dollar B Kwacha C Rand D Lilangeni Key B Distractors A C D (the incorrect responses)

40. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Multiple choice questions Types: Single correct response "Which one of the following is the currency unit used in Zambia?" Incomplete stem The currency used in Zambia is called:

41. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Multiple choice questions Advantages A wide range of knowledge, skills and attitudes can be tested in a relatively short time ALL levels of knowledge can be tested using MCQ Easy to score Reliable Different response alternatives can provide diagnostic feedback

42. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Multiple choice questions Disadvantages Difficult to set Time consuming to prepare Assessors tend to focus on lower cognitive levels only

43. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Multiple choice questions Do’s and don’t’s Keep stem simple and ensure clarity Avoid negatives – if used use CAPITALS Example: "Which one of the following is NOT an inert gas?" Use ‘none of the above’ or ‘all of the above’ sparsely

44. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Multiple choice questions Do’s and don’t’s Keep responses about equal in length Undesirable: The most general cause of low individual incomes in Romania is a. The lack of valuable productive services to sell b. Unwillingness to work c. Automation d. Inflation

45. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Multiple choice questions Do’s and don’t’s Keep responses about equal in length Desirable: What is the most general cause of low individual incomes in Romania? a. A lack of valuable productive services to sell b. The population's overall unwillingness to work c. The nation's increased reliance on automation d. An increasing national level of inflation

46. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Multiple choice questions Do’s and don'ts Ensure stem and responses are grammatical consistent eg A chain of islands is called an: a. archipelago. b. peninsula. c. polder d. moraine.

47. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Multiple choice questions Do’s and don'ts Avoid using similar word in stem and response eg The height to which a water dam is built depends on a. the length of the reserve behind the dam b. the volume of water behind the dam c. the height of water behind the dam d. the strength of the reinforcing wall

48. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Multiple choice questions Do’s and don'ts Place correct responses randomly - no pattern in the reponses e.g. DCBADCBA ….. When possible, present alternatives in some logical order eg dates 1963 1975 1983

49. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Multiple choice questions Do’s and don’t’s Be certain there is only one best or correct response to the stem Ensure ALL responses are plausible Questions are to be independent

50. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Multiple choice questions Do’s and don’t’s Avoid the use of specific determiners which would permit a test-wise but unprepared learner to respond correctly. Specific determiners refer to sweeping terms like "all," "always," "none," "never," "impossible," "inevitable," etc. Statements including such terms are more likely to be false.

51. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Multiple uses of MCQ Designing a interactive face-to-face session around a few MCQs. MCQs can be presented in a variety of ways in face-to-face sessions Short tests for diagnostic feedback Multiple choice questions for group discussion

52. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Grudzoidal test entirely content free! Please work on your own. Try out your exam technique to pick the most likely option for each of the eight questions. Then try to work out why you made your selection. If you feel you can make sense of the questions, please seek help! 52

53. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Please jot down numbers 1-8 1234567812345678 53

54. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 Hot Potatoes Download at: Hot potatoes Download Mac OS X and Windows versions on CD Tutorial Hot potatoes tutorial on CD 54

55. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 eLearning Standards Content Packaging Package a set of resources Any file: html, image, Flash, PDF etc Move content from one learning platform to another Easy sharing Navigation editable Content objects editable Manifest contains organisation information IMS, LRN, SCORM, AICC, IMS QTI 55

56. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 eLearning Standards Content Repositories Content repositories Database of learning objects Multiple sources/ suppliers Links from LMS Metadata for searching Academic level, subject domain, author etc Dublin Core, IEEE LOM 56

57. EUROPEAN UNION Project financed under Phare MoERI/ NCVETD - PIU Material produced under Phare 2006 financial support PHARE TVET RO2006/018-147.04.01.02.01.03.01 elearning Standards Tools LMS tools Adobe Flash Viewletbuilder eXe Reload Wimba Create 57