1. Phil Davies School of Computing University of Glamorgan “Super U”
Why should students perform Peer-Assessment? The Need to provide a Computerized Framework to support Peer-Assessment
Phil Davies
School of Computing
University of Glamorgan “Super U”

2. Computerised Peer-Assessment
CAP System
Permits students to mark & comment the work of other students (also self-assess)
Internet, not Web-based system (developed in Visual Basic / Access)

4. Having done the marking, what next?
Students should receive feedback
What feedback?
Marks
Comments
Which is most important?

6. What should the marker do? Reflect
Look at essay again
Take into account the essay owner’s comments
Further clarification (if it is needed, then is this a ‘black mark’ against the marker?)
Try to ‘appease’ the essay owner?
Modify mark based upon reflection?
Give more feedback

8. Peer-Assessment Example
What are the major advantages and disadvantages in using peer assessment?
2 minutes
Mark the Answer & Comment
Mark the marking

9. Bloom’s Taxonomy Evaluation Synthesis Analysis Application
Comprehension
Knowledge
Where does ‘mark for marking’ fit in?
Where does your initial marking fit in?
Where does creation of your answer fit in?

10. Must be rewarded for doing the ‘mark for marking’ process
How to judge?
Standard of expectation (self-assessment)
Marking consistency
Commenting, quality, measure against mark
Discussion Element
Need for additional comments – black mark?
Reaction to requests / further clarification

12. How easy is it to do?
Statistically fairly easy to create a mark for marking based upon marks
Take into account high and low markers
Standard of expectation
Consistency … judge against final mark awarded for an essay (compensated median)
What about the comments?

13. Feedback Index
Produce an index that reflects the quality of commenting
Produce an average feedback index for an essay
Compare against marker in a similar manner to marks analysis
Where does this feedback index come from and is it valid?

16. Time Consuming? Can we formulate the marking process
Take away need for quantification process of analyzing comments
Is it still peer-assessment if the students are told what to say?

18. Some points outstanding
What should students do if they identify plagiarism?
Is it ethical to get students to mark the work of their peers?
Provide each student with a quantified database of comments of their own
Let them provide their own scales for comments.
Is a computerised solution valid for all?
At what age / level can we trust the use of peer assessment?
How do we assess the time required to perform the marking task?