5th International CDIO Conference Singapore, June , The Role of Peers in the Assessment of Students’ CDIO Skills Ivan D’haese Johan D’heer University College Ghent, Belgium

5th International CDIO Conference Singapore, June , Outline Challenges Peer and self assessment Assessment criteria Online tool Students’ and teachers’ perception Guidelines for practitioners Overall conclusion

5th International CDIO Conference Singapore, June , Challenges Group work (e.g. first-year design-implement experiences, capstone projects, …) How to differentiate group marks? How to develop evaluation skills in students? How to develop self-evaluation skills? Selection of user friendly method and tool Opinions of students and teachers/coaches on selected assessment tools

5th International CDIO Conference Singapore, June , Peer assessement and self assessment Peer assessment: Each member of a team evaluates the other team members according to fixed criteria Self assessment: Each member of a team evaluates his/her self according to the same criteria

5th International CDIO Conference Singapore, June , Assessment Criteria Is alert, participates in the reasoning process, follows the train of thoughts, is task oriented Takes initiative, is willing to engage in tasks Is well prepared for meetings, contributes with useful information Structures his/her information and gives a neatly arranged summary Adds new ideas to the discussion Has a critical attitude Shows constructive engagement in problem solving, proposes appropriate solutions, is willing to accept compromises Gives own views Listens to the others and makes efforts to understand them Contributes to a positive group climate

5th International CDIO Conference Singapore, June , Online tool (1)

5th International CDIO Conference Singapore, June , Online tool (2)

5th International CDIO Conference Singapore, June , Online tool (3)

5th International CDIO Conference Singapore, June , Online tool (4)

5th International CDIO Conference Singapore, June , Online tool: strenghts Free choice of evaluation criteria Adjustable scale Start and end date of peer assessment Anytime anywhere Immediate availability of results Online feedback

5th International CDIO Conference Singapore, June , Students’ and teachers’ perception (1) According to literature: valuable and widely accepted method Confirmation from our students and teachers? Questionnaire: 5-point Likert type scale (complete agreement – complete disagreement) Students: n = 211 Teachers/coaches: n = 9

5th International CDIO Conference Singapore, June , Students’ and teachers’ perception (2) Questionnaire Peer assessment helps clarifying assessment criteria Peer assessment offers students a wider range of feedback Peer assessment encourages students to critically analyse work done by others Feedback via peer assessment is as useful as assessment and feedback by teachers Peer assessment more closely parallels possible career situations where judgement is made by a group Peer assessment enables students to learn from each other Peer assessment reduces the marking load on teachers

5th International CDIO Conference Singapore, June , Students’ and teachers’ perception (3) Additional workload from peer assessment is worth the effort Students may not take it seriously, allowing friendships to influence their marking in peer assessment Fellow students can assess each other honestly and correctly Students may lack the skills to evaluate each other Students may not like peer assessment because of the group pressure when giving marks

5th International CDIO Conference Singapore, June , Students’ and teachers’ perception (4) Student and coaches: peer assessment is an authentic evaluation method, closely paralleling a possible career situation peer assessment encourages students to critically analyse work done by others. friendship marking might influence the peer assessment peer assessment offers a wider range of feedback, i.e. more people and more criteria are involved in the marking compared to more traditional evaluation methods.

5th International CDIO Conference Singapore, June , Students’ and teachers’ perception (5) Students: peer assessment helpful for clarifying assessment criteria peer assessment can be a way to learn from each other Coaches: students have the necessary skills to evaluate each other peer assessment is certainly a way for students to learn from each other

5th International CDIO Conference Singapore, June , Guidelines for practitioners (1) Combine peer assessment with self assessment Allow for adjusting scores by teachers/coaches (co- assessment) Determine assessment criteria jointly with staff and students Organise a try-out with your students Allow for negative markings Ensure anonymity, especially when summative

5th International CDIO Conference Singapore, June , Guidelines for practitioners (2) Students should be able to justify their marks Explain purpose and benefits Avoid paper based forms of peer assessment

5th International CDIO Conference Singapore, June , Overall conclusion Coaches and students have a positive attitude towards peer assessment Peer assessment adds a new dimension to the overall evaluation process by allowing for “process” evaluation through marking personal and interpersonal skills