1. Development of Marking-support Soft in Task-given-type Examination
Hello, Mr.( Ms.) chair person.Ladies and Gentlemen.
I am Toshihiko Takeuchi from Aoyama Gakuin University.
My topic is “Development of Marking-support Soft in Task-given-type Examination”
(40 sec)
Toshihiko TAKEUCHI*, Akiyuki SAKUMA*
*Aoyama Gakuin University
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

2. [1]Introduction
1.1 Background of this research -Concept of task-given-type examination-
In this method, the teacher
[1]shows a group of questions to students in advance
[2]makes an examination by selecting some of these questions Q1 Q6 Q9 Q2 Q7
Q10 Q3
Q11 Q8
Q14
Q16
Q13
Q19
Q20
Q17 Q4 Q5
Q15
Q12
Q18
Q11
Q14 Q３ Q７
Q19
Q１７
We propose Task-given-type examination.
Task-given-type examination means that
[1]the teacher gives a set number of questions to students in advance.
[2]On the examination day, the students are given questions selected among these questions.
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

3. [1]Introduction
1.1 Background of this research -The merit of Task-given-type examination-
（1）Increasing of motivations towards self-teaching
（2）Improving qualities of examinational questions　
The merit of Task-given-type examination is as follows:
[First]　Increasing of motivations towards self-teaching
[Second]　Improving qualities of examinational questions
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

4. 1.1 Our aim and Research goals
[1]Introduction
1.1 Our aim and Research goals
ordinaly examination
task-given-type examination Q1 Q2 Q3 Q1 Q2 Q3 Q4 Q5 Q6
In this research, we aim at making a software to help markers.
In task-given-type examinations, longer time is needed to mark the answer sheets.
The reason: In task-given-type examinations, students should have read the questions in advance.
So, less time may be needed when they figure out the questions,
and as a result, more questions are required than ordinary examinations.
This may lead to an increase in time and errors in marking.
So marking support software is important in task-given-type examinations.
In this research, we developed a software
to make the marking work of written examinations more labor-efficient,
which is done by using a scanner with Auto Document Feeder.
The outline of this software is,
　Arranging answers to every question,and allocating them into score boxes.
more questions are required
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

5. 2.1 The conditions where this system is adoptable
[2]The marking-support system
2.1 The　conditions where this system is adoptable
What is the thing you can easily produce with Excel while it is very difficult to produce with Word?
I will explain the conditions where this system is adoptable. All students must fill in one type of answer sheet,
and they must put their answers into a particular section of the answer sheets.
Students are not permitted to put their answers into other sections of the sheet or write in any blank areas.
To make use of this software, the setups of a scanner and ADF or digital camera(s) is required.
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

6. 4. Experiments by Software by Hand [4]Experiments
To make sure of this software's efficacy,
we experimented on one model case to compare this software
with a normal hand-based type marking on the time consumed.
by Software
by Hand
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

7. 4.1. The procedure of the experiment
[4]Experiments
4.1. The procedure of the experiment
by Software
by Hand
5 sheets
5 sheets
preliminary
We divided this experiment into two parts:
one is the preliminary examination for subjects to get used to this software,
and the other is the experiment on the time consumed.
We explained to the subjects about the outline of our software,
and made the subjects mark 5 sheets in order to get used to using it. On average it took then 10 minutes for them to understand everything.
After that, we made them mark the answer sheets by hand; they had to grade 5 sheets with a red pen and write the total score on the papers.
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

8. 4.1.1. Preliminary examination
[4]Experiments
Preliminary examination
answered by words
multi-option type
This examination there contains various types of questions
such as ones answered by words, a TF type, multi-option type, correcting type, and describing type.
multi-option type
correcting type
TF type
describing type
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

9. 4.1.2. The Experiment by Software by Hand final [4]Experiments
For the final experiment, we provided 17 answered sheets and a textbook answer sheet.
The questions were roughly the same as the ones on the preliminary examination.
However, the subjects who answered the questions were totally different.
That is, complately different people answered the former examination and the latter.
17 sheets
17 sheets
final
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

10. 4.1.2. The Experiment ・Resizing of the scanned images of answer sheets
・Cutting answers out of the image
・Marking answer sheets
・Grading and making a model answer sheet
・Confirming grade records
・Time to mark
・Time to open a file of students’ list
(CSV file) and fill it
in with total scores of each student.
・Time to confirm the total score
Experimenters timed and recorded each step along the side of the subjects, such as:
Software-based type marking
・[step 02] Resizing of the scanned images of answer sheets
・[step 03] Cutting answers out of the image of answer sheets
・[step 04] Marking answer sheets
・[step 05] Grading and making a model answer sheet
・[step 07] Confirming grade records
(B) Hand-based type marking
・Time to mark
・Time to open a file of students’ list (CSV file) and fill it in with total scores of each student.
・Time to confirm the total score
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

11. Table 1 Result of the experiment
[4]Experiments
4.2. Results of the experiment
Table 1 Result of the experiment
software
545
sec
This is the result of a graph of the total time of using soft-based marking and hand-based marking.
hand
535
sec
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

12. 4.2. Results of the experiment
[4]Experiments
4.2. Results of the experiment
We also asked the 14 subjects to evaluate
which type is “easier”, “more accurate” and “faster” by pointing from 1 to 7.
The larger number implies a more affirmative feeling for this software.
The average of these results were 4.9, 5.4, 4.6.
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

13. [5]Conclusion
5. Conclusion
[1]This software requires almost the same amount of time (1.04 times) as a hand-based type of marking [2]Users preferred this software to hand-based marking, because they thought that this software enables them to mark easier, more accurately and faster.
We developed a marking-support software for written examinations.
We marked excel examinations both with this software and by hand, while timed.
The result shows that almost the same amount of time is needed.
Also there are many users who felt that this soft-based type of marking is easier and more accurate.
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

14. end
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

15. 2.2 The main screen of this software
This is the main screen.
We would like to talk about each button as a way of explaining the process of marking.
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

16. OCR sofware (Yomitori Kakumei)
[3]How to use this software and the prosess of marking
3.1 Starting up the scanner software
OCR sofware.
Initial start up of the OCR software which is set in the "set" screen.
Scans answer sheets into hard discs as bmp images by using a scanner and OCR sofware.
OCR sofware (Yomitori Kakumei)
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

17. 3.2 Resizing of scanned answer sheets
[3]How to use this software and the prosess of marking
3.2 Resizing of scanned answer sheets
Resizes images of answer sheets into 90% of resolution.
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

18. 3.3 Cutting answer sections from the image of the answer sheets
[3]How to use this software and the prosess of marking
3.3 Cutting answer sections from
the image of the answer sheets
All students are supposed to fill in one type of answer sheet, and all questions must be written in each specified section.
In this step, users should specify the section where they want to cut out.
They should specify these kinds of sections:
Information about students (such as their names), answers,
and a special "check" area where you can confirm that the scanning is all correct.
One area is represented by a pink rectangle and is shown.
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

19. 3.4 Marking by the image of the answer sheet(1)
[3]How to use this software and the prosess of marking
3.4 Marking by the image of the answer sheet(1)
When markers push the "mark" button, a screen of marking answer sheet is displayed.
In this step, we would like to explain how to grade the answer sheets.
First, markers should click "question N" which is on the left side of screen.
Then, the images of the question number clicked are arranged and displayed on the screen. When you want to mark a certain image, click the image and turn it to pale blue,
and push the button "classify to here" on the side of the score which you want to mark.
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

20. 3.4 Marking by the image of the answer sheet(2)
[3]How to use this software and the prosess of marking
3.4 Marking by the image of the answer sheet(2)
Markers must not mark and grade students' names.
However, it is necessary to make the system recognize
which answer sheet belongs to whom, when reading the score in the paper.
So, push the button "Distribute by names"
The program requires students' names and mail-addresses,
which are prepared by users, in order to display the roll of names
on the main screen of “distributing by names”.
The program requires
students' names and mail-addresses, which are prepared by users.
In the main display of the roll of names,
images of names are displayed on the left side, with the name list on the right.
Users click on the image of the name and turn it into pale blue,
and allocate the image of the same name on the right side.
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

21. 3.5 Marking, and making a model answer sheet
[3]How to use this software and the prosess of marking
3.5 Marking, and making a model answer sheet
By pushing this button, the marking and making of a model answer sheet are carried out.
Thus the results of marking are written into the jpg-images of the answer sheets.
This is an example of the marked answer sheet.
At the same time, the system draws up a model answer sheet,
which is the medley of different students who scored the best in each question.
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

22. [3]How to use this software and the prosess of marking
3.6 Grade record
This button opens a file which is specified
in the "set" of "CVS file of grade record" by a related software...for Examle, Excel.
In the CVS file of the grade record, total score, ranking of the score, T-score, and points of each question are written.
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

23. 3.7 Covering the model answer
[3]How to use this software and the prosess of marking
3.7 Covering the model answer
The model answer sheet consists of each student's answers, so it belongs to nobody.
So users cover it using seals on the personal information
and make use of it as a model answer sheet which can be published.
5/21/2019
ITCC 1-024　　　Apr, 27, 2003

24. 3.8 Make web pages (for the itself and each student)
[3]How to use this software and the prosess of marking
3.8 Make web pages (for the itself and each student)
The make “web pages” the button displays two kinds of pages:
the examination itself and each student's.
5/21/2019
ITCC 1-024　　　Apr, 27, 2003