1. Dr. Terence Etchells t.a.etchells@ljmu.ac.uk Computing and Mathematical Sciences Liverpool John Moores University, UK. Generating Online Assessment Questions with Derive and Perception

2. Important (Videos) In order that you can view the videos in this presentation you will need the TechSmith Video Codec that can be found at: http://download.techsmith.com/tscc/tscc.exe Alternately, you can find the tscc.exe on this CD. Simply run the exe file from the CD or the internet download.

3. Where LJMU is!

6. Liverpool John Moores University

7. My office

8. What is Perception? A Package for Delivering Assessments over the internet. Assessments can take many forms. e.g. multiple choice, text matching, numerical values.

9. What is Perception? A Package for Delivering Assessments over the internet. Assessments can take many forms. e.g. multiple choice, text matching, numerical values.

10. What is Perception? A Package for Delivering Assessments over the internet. Assessments can take many forms. e.g. multiple choice, text matching, numerical values.

11. What is Perception? A Package for Delivering Assessments over the internet. Assessments can take many forms. e.g. multiple choice, text matching, numerical values.

12. What is Perception? 4 Main parts to Perception –Authoring the Questions –Constructing Assessments Selecting groups of questions –Setting Schedules dates, how many attempts, who? –Reporting What scores did they get.

13. What is Perception? 4 Main parts to Perception –Authoring the Questions –Constructing Assessments Selecting groups of questions –Setting Schedules dates, how many attempts, who? –Reporting What scores did they get.

14. What is Perception? 4 Main parts to Perception –Authoring the Questions –Constructing Assessments Selecting groups of questions –Setting Schedules dates, how many attempts, who? –Reporting What scores did they get.

15. What is Perception? 4 Main parts to Perception –Authoring the Questions –Constructing Assessments Selecting groups of questions –Setting Schedules dates, how many attempts, who? –Reporting What scores did they get.

16. What is Perception? 4 Main parts to Perception –Authoring the Questions –Constructing Assessments Selecting groups of questions –Setting Schedules dates, how many attempts, who? –Reporting What scores did students get.

17. What is Perception? The software is well developed and used all over the world in Education and Business. It is very secure. Detailed info on Perception can be found at http://www.questionmark.com

18. What is Perception? The software is well developed and used all over the world in Education and Business. It is very secure. Detailed info on Perception can be found at http://www.questionmark.com

19. What is Perception? The software is well developed and used all over the world in Education and Business. It is very secure. Detailed info on Perception can be found at http://www.questionmark.comhttp://www.questionmark.com

20. Why Use Perception? Large Classes, NO MARKING! Students can do assessments in their own rooms/home. Students can do assessments in their own time.

21. Why Use Perception? Large Classes, NO MARKING! Students can do assessments in their own rooms/home. Students can do assessments in their own time.

22. Why Use Perception? Large Classes, NO MARKING! Students can do assessments in their own rooms/home. Students can do assessments in their own time.

23. Why Use Perception? Large Classes, NO MARKING! Students can do assessments in their own rooms/home. Students can do assessments in their own time.

24. What are the pitfalls? Authoring the questions is VERY time consuming. Perception has Wizards for constructing the questions, but only one at a time. There are large databases to manage.

25. What are the pitfalls? Authoring the questions is VERY time consuming. Perception has Wizards for constructing the questions, but only one at a time. There are large databases to manage.

26. What are the pitfalls? Authoring the questions is VERY time consuming. Perception has Wizards for constructing the questions, but only one at a time. There are large databases to manage.

27. What are the pitfalls? Authoring the questions is VERY time consuming. Perception has Wizards for constructing the questions, but only one at a time. There are large databases to manage.

28. What are the pitfalls? There are many aspects of the software that need to be mastered. A steep learning curve. Servers can go down! No support at Midnight!

29. What are the pitfalls? There are many aspects of the software that need to be mastered. A steep learning curve. Servers can go down! No support at Midnight!

30. What are the pitfalls? There are many aspects of the software that need to be mastered. A steep learning curve. Servers can go down! No support at Midnight!

31. Overall Positives out way the Negatives. Students like the instant non judgemental (by a human) feedback. Students know their scores and can see their grades for all assessments attempted.

32. Overall Positives out way the Negatives. Students like the instant non judgemental (by a human) feedback. Students know their scores and can see their grades for all assessments attempted.

33. Overall Positives out way the Negatives. Students like the instant non judgemental (by a human) feedback. Students know their scores and can see their grades for all assessments attempted.

34. Overall Positives out way the Negatives. Students like the instant non Judgemental (by a human) feedback. Students know their scores and can see their grades for all assessments attempted.

35. What has this to do with Derive? For large classes there must be many different questions. Students network solutions if there are only a few questions. Must generate many copies of template questions with different values and solutions.

36. What has this to do with Derive? For large classes there must be many different questions. Students network solutions if there are only a few questions. Must generate many copies of template questions with different values and solutions.

37. What has this to do with Derive? For large classes there must be many different questions. Students network solutions if there are only a few questions. Must generate many copies of template questions with different values and solutions.

38. What has this to do with Derive? For large classes there must be many different questions. Students network solutions if there are only a few questions. Must generate many copies of template questions with different values and solutions.

39. What has this to do with Derive? It is possible with Derive that we can generate many different questions and solutions from a set template. However, interfacing Derive with Perception is not trivial . We must be inventive.

40. What has this to do with Derive? It is possible with Derive that we can generate many different questions and solutions from a set template. However, interfacing Derive with Perception is not trivial . We must be inventive.

41. What has this to do with Derive? It is possible with Derive that we can generate many different questions and solutions from a set template. However, interfacing Derive with Perception is not trivial . We must be inventive.

42. How Do We Connect? Perception Questions are written in a mark-up language, QML, which is text. Perception has wizards for producing questions in QML. QML can be imported in Perception Question Databases.

43. How Do We Connect? Perception Questions are written in a mark-up language, QML, which is text. Perception has wizards for producing questions in QML. QML can be imported in Perception Question Databases.

44. How Do We Connect? Perception Questions are written in a mark-up language, QML, which is text. Perception has wizards for producing questions in QML. QML can be imported in Perception Question Databases.

45. How Do We Connect? Perception Questions are written in a mark-up language, QML, which is text. Perception has wizards for producing questions in QML. QML can be imported in Perception Question Databases.

46. So what do we do? Create a Template Question with the Perception Wizard. Extract the QML text and place in a WORD document. Get Derive to generate random values and the solution for the question.

47. So what do we do? Create a Template Question with the Perception Wizard. Extract the QML text and place in a WORD document. Get Derive to generate random values and the solution for the question.

48. So what do we do? Create a Template Question with the Perception Wizard. Extract the QML text and place in a WORD document. Get Derive to generate random values and the solution for the question.

49. So what do we do? Create a Template Question with the Perception Wizard. Extract the QML text and place in a WORD document. Get Derive to generate random values and the solution for the question.

50. So what do we do? Use Word’s mail merge facility to merge the values into the template making hundreds of different versions of the same question. We must Program Derive to produce the values and the solutions. It is not possible to save our values and solution in a form that Word’s mail merge can work with.

51. So what do we do? Use Word’s mail merge facility to merge the values into the template making hundreds of different versions of the same question. We must Program Derive to produce the values and the solutions. It is not possible to save our values and solution in a form that Word’s mail merge can work with.

52. So what do we do? Use Word’s mail merge facility to merge the values into the template making hundreds of different versions of the same question. We must Program Derive to produce the values and the solutions. It is not possible to save our values and solution in a form that Word’s mail merge can work with.

53. A Simple Example Expand the expression (2x+1)(x+2) What is the co-efficient of x?

54. Question Manager Perception has a program called Question Manager. We use this program to Author our questions. We will now Author our simple Question.

55. Question Manager Perception has a program called Question Manager. We use this program to Author our questions. We will now Author our simple Question.

56. Question Manager Perception has a program called Question Manager. We use this program to Author our questions. We will now Author our simple Question.

57. Question Manager Perception has a program called Question Manager. We use this program to Author our questions. We will now Author our simple Question.

60. Generating Parameters and Solutions We now have a template with the parameters a, b, c and d and an answer of 9999. We now turn to Derive to generate many instances of the parameters and their answer. A little programming is needed.

61. Generating Parameters and Solutions We now have a template with the parameters a, b, c and d and an answer of 9999. We now turn to Derive to generate many instances of the parameters and their answer. A little programming is needed.

62. Generating Parameters and Solutions We now have a template with the parameters a, b, c and d and an answer of 9999. We now turn to Derive to generate many instances of the parameters and their answer. A little programming is needed.

63. Generating Parameters and Solutions We now have a template with the parameters a, b, c and d and an answer of 9999. We now turn to Derive to generate many instances of the parameters and their answer. A little programming is needed.

64. Q1(n,counter,list,a,b,c,d,ans):= PROG( list:=[], counter:=1, LOOP( IF(counter>n, RETURN REVERSE(list) ), a:=RANDOM(15)+3, b:=RANDOM(15)+3, c:=RANDOM(15)+3, d:=RANDOM(15)+3, ans:= ad+bc, list:=ADJOIN([counter,a,b,c,d,ans],list), counter:+1 ) Define the function

65. Q1(n,counter,list,a,b,c,d,ans):= PROG( list:=[], counter:=1, LOOP( IF(counter>n, RETURN REVERSE(list) ), a:=RANDOM(15)+3, b:=RANDOM(15)+3, c:=RANDOM(15)+3, d:=RANDOM(15)+3, ans:= ad+bc, list:=ADJOIN([counter,a,b,c,d,ans],list), counter:+1 ) Open a PROG()

66. Q1(n,counter,list,a,b,c,d,ans):= PROG( list:=[], counter:=1, LOOP( IF(counter>n, RETURN REVERSE(list) ), a:=RANDOM(15)+3, b:=RANDOM(15)+3, c:=RANDOM(15)+3, d:=RANDOM(15)+3, ans:= ad+bc, list:=ADJOIN([counter,a,b,c,d,ans],list), counter:+1 ) Define an empty list

67. Q1(n,counter,list,a,b,c,d,ans):= PROG( list:=[], counter:=1, LOOP( IF(counter>n, RETURN REVERSE(list) ), a:=RANDOM(15)+3, b:=RANDOM(15)+3, c:=RANDOM(15)+3, d:=RANDOM(15)+3, ans:= ad+bc, list:=ADJOIN([counter,a,b,c,d,ans],list), counter:+1 ) Set a counter to 1

68. Q1(n,counter,list,a,b,c,d,ans):= PROG( list:=[], counter:=1, LOOP( IF(counter>n, RETURN REVERSE(list) ), a:=RANDOM(15)+3, b:=RANDOM(15)+3, c:=RANDOM(15)+3, d:=RANDOM(15)+3, ans:= ad+bc, list:=ADJOIN([counter,a,b,c,d,ans],list), counter:+1 ) Open a LOOP()

69. Q1(n,counter,list,a,b,c,d,ans):= PROG( list:=[], counter:=1, LOOP( IF(counter>n, RETURN REVERSE(list) ), a:=RANDOM(15)+3, b:=RANDOM(15)+3, c:=RANDOM(15)+3, d:=RANDOM(15)+3, ans:= ad+bc, list:=ADJOIN([counter,a,b,c,d,ans],list), counter:+1 ) Escape when done

70. Q1(n,counter,list,a,b,c,d,ans):= PROG( list:=[], counter:=1, LOOP( IF(counter>n, RETURN REVERSE(list) ), a:=RANDOM(15)+3, b:=RANDOM(15)+3, c:=RANDOM(15)+3, d:=RANDOM(15)+3, ans:= ad+bc, list:=ADJOIN([counter,a,b,c,d,ans],list), counter:+1 ) Randomise the parameters

71. Q1(n,counter,list,a,b,c,d,ans):= PROG( list:=[], counter:=1, LOOP( IF(counter>n, RETURN REVERSE(list) ), a:=RANDOM(15)+3, b:=RANDOM(15)+3, c:=RANDOM(15)+3, d:=RANDOM(15)+3, ans:= ad+bc, list:=ADJOIN([counter,a,b,c,d,ans],list), counter:+1 ) Determine the answer

72. Q1(n,counter,list,a,b,c,d,ans):= PROG( list:=[], counter:=1, LOOP( IF(counter>n, RETURN REVERSE(list) ), a:=RANDOM(15)+3, b:=RANDOM(15)+3, c:=RANDOM(15)+3, d:=RANDOM(15)+3, ans:= ad+bc, list:=ADJOIN([counter,a,b,c,d,ans],list), counter:+1 ) Add the parameters and answer to the list

73. Q1(n,counter,list,a,b,c,d,ans):= PROG( list:=[], counter:=1, LOOP( IF(counter>n, RETURN REVERSE(list) ), a:=RANDOM(15)+3, b:=RANDOM(15)+3, c:=RANDOM(15)+3, d:=RANDOM(15)+3, ans:= ad+bc, list:=ADJOIN([counter,a,b,c,d,ans],list), counter:+1 ) Progress the counter by 1

74. Expand Example We will run the Derive program. Bring the results into Word + NotePad to Format and save the Merge File.

75. Expand Example We will run the Derive program. Bring the results into Word + NotePad to Format and save the Merge File.

77. Expand Example Merge the File with the QML template. Import the merged file into Perception. Test a question at random.

81. Expand Example Merge the File with the QML template. Import the merged file into Perception. Test a question at random.

83. Expand Example Merge the File with the QML template. Import the merged file into Perception. Test a question at random.

85. A more demanding Example Approximate the integral Correct to 5 decimal places.

86. A More Demanding Example Text will not adequately render mathematical expressions of this type. MathML is the Internet Mark Up language fro Mathematics. We can use MathType to create MathML.

87. A More Demanding Example Text will not adequately render mathematical expressions of this type. MathML is the Internet Mark Up language fro Mathematics. We can use MathType to create MathML.

88. A More Demanding Example Text will not adequately render mathematical expressions of this type. MathML is the Internet Mark Up language fro Mathematics. We can use MathType to create MathML.

89. A More Demanding Example Create the basic template Construct the MathML. Insert into Question Template

91. A More Demanding Example Create the basic template Construct the MathML. Insert into Question Template.

93. A More Demanding Example Create the basic template Construct the MathML. Insert into Question Template.

95. A More Demanding Example Now we program Derive to produce the parameters and the answers.

97. Round(x,n,ndec,n1dec,n1digit):= PROG( ndec:=FLOOR(10^n x), n1dec:=FLOOR(10^(n+1) x), n1digit:=n1dec-10 *ndec, IF(n1digit<5, ndec/10^n, (ndec+1)/10^n )

98. Q2(n,counter,list,a,b,c,d,e,f,prec,ans):= PROG( counter:=1, list:=[ ], LOOP( IF(counter>n, RETURN REVERSE(list) ), a:=RANDOM(15)+3, b:=RANDOM(15)+3, c:=RANDOM(15)+3, d:=RANDOM(15)+3, e:=RANDOM(15)+3, f:=e+RANDOM(15)+3, prec:=random(5)+3, ans:=(a·d - b·c)·LN(c·e + d)/c^2 + (b·c - a·d)·LN(c·f + d)/c^2 + a·(f - e)/c, ans:=Round(ans,prec), list:=adjoin([counter,a,b,c,d,e,f,prec,ans],list), counter:+1 )

99. A More Demanding Example Create Merge table as before. Merge into Template

102. A More Demanding Example Create Merge table as before. Merge into Template.

107. Perception Live For the next few weeks or so you can try some of the questions I have developed. http://perception.cms.livjm.ac.uk/q/open.dll Name: Guest Group: DES-TIME

108. Thank You For Tony Peacock, former Principal North Bolton Sixth Form College, UK, died July 2006 Any ideas what this is???