1. 1 University of Maribor Faculty of Organisational Sciences Eva Jereb & Igor Bernik eva.jereb@fov.uni-mb.si Comparing students’ readiness for e-examinations in 2004 and 2005 8 th International Conference on Education, Athens

2. 2 E-learning E-examination exists for a relatively long time is still in its infancy At the presented research we tried to find out: whether e-examination is reasonablewhether e-examination is reasonable whether the students are prepared for this kind of examinationwhether the students are prepared for this kind of examination whether and why they expect e-examinations with anxietywhether and why they expect e-examinations with anxiety how and when e-examination should be introduced to the studentshow and when e-examination should be introduced to the students For better implementation of e-examinations regardless of location we investigated the readiness of students to take this kind of exams.

3. 3 Why e-exams?  Grading the exams automatically promises: faster, cheaper and more consistent grading.  The number of candidates who should be examined is rising.  Even if automatic marking is not used capturing student’s answers electronically has benefits in legibility and comprehension.  Higher security with tests being held electronically and being released to candidates at the start of the examination.  Immediate feedback.  At any time and any place. E-examination has potential for speeding up the whole examination process.

4. 4 Alternatives 1. No e-examinations. Examinations should be oral or written on paper. paper. 2. Use e-examinations for instant tests and classic tests for final exams. exams. 3. Combining electronic and classic examinations. 4. E-examinations only. In classroom or remote, synchronous or asynchronous. asynchronous.

5. 5 Methodology GDSS GroupSystems

6. 6 Survey statements: S1:I would replace classic written or oral exams with e-exams. S2:Immediate feedback is one of the main advantages of e-examination. S3:E-examination is far more interesting than classic examination, it attracts and motivates me. S4:E-examinations should be time limited. S5:E-examinations ensure objective evaluation of results. S6:E-examinations require a high level of computer knowledge. S7:E-examination is straining, it would make me too tired. S8:One of the advantages of e-examinations is less possibility of cheating. S9:Knowledge should be tested instantly with help of e-examinations. S10:E-examinations could take place remote from the school. S11:E-examinations could be carried out anytime, according to individuals. S12:If I could choose between classic and e-examination I would choose e examination.

7. 7 Results 2004 54 students (20 females and 34 males) participated Ages ranged from 21 to 44 years, with a mean of 27 years and 5 month (M=24,4 years for females and M=29,2 years for males). 2005 173 students (107 females and 66 males)participated Ages ranged from 20 to 50 years, with a mean of 25 years and 6 month (M=26,36 years for females and M=24,71 years for males).

8. 8 Students agree with replacing classic written or oral exams with e-exams. Strongly Agree → Strongly Disagree Strongly Agree → Strongly Disagree 12345 200420052004 2004 2004 20042005 48,1042,2035,2030,6411,1014,451,905,783,706,94 S1: I would replace classic written or oral exams with e-exams. oral exams with e-exams. Note: results are in percentage.

9. 9 One of the main reasons why students like idea about e-examinations is the possibility of immediate feedback. Strongly Agree → Strongly Disagree Strongly Agree → Strongly Disagree 12345 200420052004 2004 2004 20042005 77,8076,8814,8012,721,902,890,004,625,602,89 S2: Immediate feedback is one of the main advantages of e-examination. advantages of e-examination. Note: results are in percentage.

10. 10 E-examinations attract and motivate large number of students. Strongly Agree → Strongly Disagree Strongly Agree → Strongly Disagree 12345 200420052004 2004 2004 20042005 29,6031,2146,3035,2611,1012,723,7012,149,308,67 S3: E-examination is far more interesting than classic, it motivates me. than classic, it motivates me. Note: results are in percentage.

11. 11 Time should be limited to reduce cheating, to raise motivation and to reduce fatigue of long lasting tiring examination. Strongly Agree → Strongly Disagree Strongly Agree → Strongly Disagree 12345 200420052004 2004 2004 20042005 29,6029,4829,6025,4313,0019,6520,4015,037,4010,40 S4: E-examinations should be time limited. Note: results are in percentage.

12. 12 Trust in results evaluation objectivity is decreasing. Strongly Agree → Strongly Disagree Strongly Agree → Strongly Disagree 12345 200420052004 2004 2004 20042005 42,6036,9929,6021,3914,8021,977,4013,295,606,36 S5: E-examinations ensure objective evaluation of results. evaluation of results. Note: results are in percentage.

13. 13 Some students are anxious because they are not familiar with e-examination method. But we can see less fear of the computer technology in the year 2005. Strongly Agree → Strongly Disagree Strongly Agree → Strongly Disagree 12345 200420052004 2004 2004 20042005 37,0017,9218,5024,8611,1014,4514,8021,3918,5021,39 S6: E-examinations require a high level of ICT knowledge. ICT knowledge. Note: results are in percentage.

14. 14 Students do not think that e-examination is straining and tiring. More than half of them strongly disagree with statement 7. Strongly Agree → Strongly Disagree Strongly Agree → Strongly Disagree 12345 200420052004 2004 2004 20042005 9,304,051,9012,7214,8010,4020,4021,3953,7051,45 S7: E-examinations is straining, it would make me too tired. make me too tired. Note: results are in percentage.

15. 15 Up-to-date technology enables good control over examinations and reduces cheating. Strongly Agree → Strongly Disagree Strongly Agree → Strongly Disagree 12345 200420052004 2004 2004 20042005 24,1029,4837,0028,9014,8015,619,309,2514,8016,76 S8: One of the advantages of e-examinations is less possibility of cheating. Note: results are in percentage.

16. 16 We are all different. Some like the idea of instant pressure, some dislike. Strongly Agree → Strongly Disagree Strongly Agree → Strongly Disagree 12345 200420052004 2004 2004 20042005 40,7042,7729,6024,8613,0013,879,3011,567,406,94 S9: Knowledge should be tested instantly with help of e-examinations. Note: results are in percentage.

17. 17 Result of social trend; lack of time and need of flexibility. Strongly Agree → Strongly Disagree Strongly Agree → Strongly Disagree 12345 200420052004 2004 2004 20042005 77,8079,7713,0013,293,701,160,004,055,601,73 S10: E-examinations could take place remote from the school. remote from the school. Note: results are in percentage.

18. 18 Result of social trend; lack of time and need of flexibility as well. Strongly Agree → Strongly Disagree Strongly Agree → Strongly Disagree 12345 200420052004 2004 2004 20042005 72,2072,8316,7014,451,905,201,904,057,403,47 S11: E-examinations could be carried out anytime, according to individuals. anytime, according to individuals. Note: results are in percentage.

19. 19 Students are afraid of new challenges and are not familiar with the new method of testing. Strongly Agree → Strongly Disagree Strongly Agree → Strongly Disagree 12345 200420052004 2004 2004 20042005 38,9036,4231,5025,4318,5016,761,909,839,3011,56 S12: If I could choose I would choose e-examinations. e-examinations. Note: results are in percentage.

20. 20 Decision  For the next generation of students we will be using combination of classic and e-examinations.  We will try to introduce e-examination in all fields where possible. The final idea is to replace classic examinations with e-examinations in whole of course where possible.

21. 21 Conclusion  Feedback from the students confirmed the need of introducing e-examinations.  Important factors for the positive relations towards e- examinations, are: Immediate feedback Immediate feedback Freedom of choice of place Freedom of choice of place  Students are becoming more familiar with up to date ICT technology and are less afraid.  But students still do not know whether e-exams are good or bad for them.  Next step  pilot testing.

22. 22 University of Maribor Faculty of Organisational Sciences Eva Jereb & Igor Bernik eva.jereb@fov.uni-mb.si Thank you. 8 th International Conference on Education, Athens

23. 23 Before and after taking e-test Strongly Agree → Strongly Disagree 12345 BeforeAfterBeforeAfterBeforeAfterBeforeAfterBeforeAfter S1 33,3%58,3%33,3%16,7%20,8% 8,3%0,0%4,2% S2 66,7%75,0%4,2% 12,5%8,3% 4,2%8,3% S3 33,3%54,2%25,0%20,8%16,7%12,5%20,8%8,3%4,2% S4 25,0% 16,7%25,0%29,2%16,7%12,5%16,7% S5 29,2%41,7%20,8% 37,5%20,8%8,3%12,5%4,2% S6 12,5% 16,7% 0,0%16,7%8,3%37,5%62,5% S7 8,3%12,5% 8,3%0,0% 16,7%4,2%62,5%75,0% S8 33,3%54,2%8,3%12,5%16,7%20,8%33,3%4,2%8,3% S9 25,0%41,7%16,7%25,0% 20,8%33,3%8,3%0,0%4,2% S10 45,8%66,7%12,5%16,7%20,8%8,3%4,2%0,0%16,7%8,3% S11 45,8%62,5%12,5% 16,7%0,0%12,5% S12 33,3%62,5%12,5%16,7%25,0%16,7%8,3%4,2%20,8%0,0%