The perceived added value of peer marking in formative assessment: a cross-disciplinary study Tom Bartlett ENCAP Paul Crosthwaite ENCAP Helen Jones BIOSI.

Slides:



Advertisements
Similar presentations
THE WRITINGS ON THE WALL: USING POSTERS TO ASSESS FOR LEARNING MUHAMMAD ASAD SIDDIQUI 1, ADEEL AHMED KHAN 2, ZEESHAN AHMED 3 1 Queen Margaret University,
Advertisements

Peer-Assessment. students comment on and judge their colleagues work.
The Journey – Improving Writing Through Formative Assessment Presented By: Sarah McManus, Section Chief, Testing Policy & Operations Phyllis Blue, Middle.
Being explicit about learning Focusing feedback on improvement Gathering evidence of learning Handing on responsibility for learning Participation Dialogue.
Directorate of Human Resources Examples of blended course designs Oxford Centre for Staff and Learning Development
Experience of using formative assessment and students perception of formative assessment Paul Ong Greg Benfield Margaret Price.
Completing the cycle: an investigation of structured reflection as a tool to encourage student engagement with feedback Jackie Pates Lancaster Environment.
The Cost of Authoring with a Knowledge Layer Judy Kay and Lichao Li School of Information Technologies The University of Sydney, Australia.
Peer peer-assessment & peer- feedback
The Great NUS Feedback Amnesty Aaron Porter, Vice President (Higher Education) | NUS.
Enhancing Student Engagement with Feedback Stuart Hepplestone and Helen Parkin, Learning and Teaching Institute.
Assessment, Marking & Feedback
I NTERNATIONAL S TUDENTS : ONE SIZE DOES NOT FIT ALL Mr Phil Lewis – Coventry University Dr Gill Cooke – Coventry University.
School Based Assessment and Reporting Unit Curriculum Directorate
Colleen Connor, Dean of Learning and Teaching LEARNING & TEACHING WORKSHOP- ASSIGNMENT FEEDBACK.
Peer dialogues: A new approach to developing feedback practises? Dr. Sarah Richardson Ian Gwinn Sam McGinty.
Importance of Questioning and Feedback Technique in developing 3 Cs
Using technology to enhance student engagement with feedback Stuart Hepplestone and Helen Parkin Quality Enhancement & Student Success.
Parallel Session Presentation Mini Conference April 2013 D2-LP-14 Dr LAM Bick Har Department of Curriculum and Instruction The Use of Formative.
Feedback to students: What do we know about feedback and learning?
Using assessment for learning
Assessment for learning: the benefits of generating feedback David Nicol Professor of Higher Education Centre for Academic Practice and Learning Enhancement.
23 June 2009 Assessing Project Based Learning in Groups Peter Willmot.
Engaging Learners at Multiple Levels: Innovations to support the development of professional practice in e-learning Adrian Kirkwood, Robin Goodfellow &
Wynne Harlen. What do you mean by assessment? Is there assessment when: 1. A teacher asks pupils questions to find out what ideas they have about a topic.
Planning to Support Mixed Ability Teaching
Peer assessment and group work event and practical workshop RSC WM Stimulating and supporting innovation in learning.
Ipsative assessment: comparison with past performance
What is the meaning of Meaning?. Is this a good question?
Assessment Assessment should be an integral part of a unit of work and should support student learning. Assessment is the process of identifying, gathering.
Growing Success Overview
VARIETY VERSUS FAMILIARITY IN ASSESSMENT TASK TYPE IN HIGHER EDUCATION Neil Currant.
5th International CDIO Conference Singapore, June , The Role of Peers in the Assessment of Students’ CDIO Skills Ivan D’haese Johan D’heer.
© Cambridge International Examinations 2013 Component/Paper 1.
Providing Constructive Feedback
Assessment in Higher Education Linda Carey Centre for Educational Development Queen’s University Belfast.
LINC 2007 M-Learning from a Cell Phone: Improving Students’ EMP Learning Experience through Interactive SMS Platform By: Jafar Asgari Arani
Goal Understand the impact on student achievement from effective use of formative assessment, and the role of principals, teachers, and students in that.
Learning Development and Innovation Overview and Updates Steve Wyn Williams March 2013.
(SJS[date]) 1 (Assessment and) Feedback - introduction The role of assessment: –Extract from ALOE resource –Assessment audit tool Receiving.
Marion Webb January  By the end of the session, participants will be able to:  Discuss the role of assessment for learning  Describe key assessment.
Is PeerMark a useful tool for formative assessment of literature review? A trial in the School of Veterinary Science Duret, D & Durrani,
LECTURE 2 - DTLLS Assessment. Research into the impact of assessment tells us that students learn best when assessment is:  Evenly timed  Represents.
Preparing students as effective assessors Enabling learning beyond graduation David Nicol Professor of Higher Education Centre for Academic Practice and.
Centre for Academic Practice University of Strathclyde
Assessment Introduction Unit for the Enhancement of Learning and Teaching.
A review of peer assessment tools. The benefits of peer assessment Peer assessment is a powerful teaching technique that provides benefits to learners,
Results Student Engagement : Students generally found logbooks easy to use and practical in the hospital setting. Purpose : There appeared to be a perceived.
Human Resources Brookes Assessment Compact Dr Chris Rust, Head, Oxford Centre for Staff and Learning Development Deputy Director, ASKe.
Formative and Summative Evaluation. Formative Evaluation The goal of formative assessment is to Monitor student learning Provide ongoing feedback Improve.
The selection of appropriate assessment methods in a course is influenced by many factors: the intended learning outcomes, the discipline and related professional.
 T-Flip September 3rd The use of peer assessment encourages students to believe they are part of a community of scholarship. In peer assessment.
An Introduction to Formative Assessment as a useful support for teaching and learning.
1 WebCast # 1 October 17, Inquiry – A Starting Point Educators with an inquiry habit of mind do not presume an outcome; instead they allow for.
Feedback in University Teaching Prof. Arif Khurshed Division of Accounting and Finance.
Re-engineering Assessment Practices in Scottish Higher Education [REAP] Dr David Nicol, Project Director Centre for Academic Practice and Learning Enhancement.
Acadia Institute for Teaching and Technology Peer Review.
Assessment Information Evening 17 th September 2015.
STUDENT ENGAGEMENT THROUGH AUTHENTIC INTEGRATED STAGE ASSESSMENT Wayne Inwood and Andrew Weeding.
CERTIFICATE IN ASSESSING VOCATIONAL ACHIEVEMENT (CAVA) Unit 1: Understanding the principles and practices of assessment.
Creating Assessments that Engage Students & Staff Professor Jon Green.
Good teaching for diverse learners
Aims of the Day To support teachers, lecturers and assessors in their understanding of national standards for external assessment in Dance at both National.
Assessing Young Learners
Assessment and Feedback – Module 1
Business School Economics division
CEA Case Study Marianne Farrugia.
Lily Zhang Shantou University
Providing feedback to learners
A Moodle-based Peer Assessment Tool
Presentation transcript:

The perceived added value of peer marking in formative assessment: a cross-disciplinary study Tom Bartlett ENCAP Paul Crosthwaite ENCAP Helen Jones BIOSI Henrietta Standley BIOSI

Formative assessment Assessment that is specifically intended to generate feedback on performance to improve and accelerate learning Nicol and Macfarlane-Dick Studies in Higher Education 31,

Formative assessment clarifies what good performance is facilitates development of self- assessment informs students about their learning encourages teacher and peer dialogue increases motivation and self-esteem provides opportunities to close the gap between current and desired performance aids teachers in shaping their teaching Nicol and Macfarlane-Dick 2006; see Sadler, Assessment in Education 5,

Peer assessment Assessment of students by other students, both formative reviews to provide feedback and summative grading Bostock Higher Education Academy.

Peer assessment gives a sense of ownership of the assessment process encourages students to develop as autonomous learners treats assessment as part of learning enables practice of transferable skills promotes metacognition encourages deep rather than surface learning Bostock Higher Education Academy.

Methodology 1.Students undertake a formative assessment linked to a module. 2.Assess one anothers work following clear criteria provided by staff. 3.Complete a questionnaire on the process: 10 Likert scale responses Open questions Judgement of quality of paper marked

School and subject YearNumber of participants / total number of students BIOSI (Medicine) / /298 ENCAP (Language i.e. Linguistics) 117/150 ENCAP (English literature) /25 1/115 Relative rates of student participation

Data collection Medicine Optional formative exam sat under exam conditions Compulsory multiple choice and short answer questions Compulsory peer marking of all answers Language Optional formative exam sat under exam conditions Compulsory short answer questions Optional peer marking

Q1. Before carrying out this peer assessment exercise, I anticipated that I would find it educationally valuable. Both groups anticipated that the exercise would be beneficial.

Q7. Reflecting on this exercise, I found it to be of educational value. This benefit was validated afterwards – more strongly in medicine than language

Q2. Knowing that this exercise was a formative assessment, I was happy for my work to be marked by another student. Both groups were happy for their formative assessment scripts to be marked by peers.

Q8. If this assessment had been summative, I would have been happy for my work to be marked by another student. Both groups disliked the idea of summative assessments being marked by peers - medical students particularly strongly.

Q3. 95% of language students and 96% of medical students strongly agreed or agreed that the exercise had increased their understanding of the assessment criteria. However -

Q4. Based on the marking criteria, I was confident that the marks I awarded for the open question section of the test were accurate and reflected the quality of the answer. Language students were more confident than medical students when peer assessing short questions with objective answers.

Conclusion based on the Likert scale analysis The students felt they had benefited from the exercise. But -

A comparison of the Likert responses with the open comments The majority of positive comments were based around the benefit of the formative assessment. The majority of negative comments centred on the peer marking process: doubts about the reliability of peer assessment wanted staff to go through answers instead preferred to mark their own papers anxieties about confidentiality (medics)

Possible explanations for students distrust of peer assessment Anxiety about the responsibility of marking a peers work (albeit anonymously). Discomfort at the prospect of another student viewing their work. The marks and feedback they would receive from other students might be substandard or misleading. The exercise places additional demands on the students time, for which they will receive little tangible reward.

Possible explanations for exceptionally poor interest from English Literature students Essays place greater intellectual demands on markers. Writing essays may be perceived by students to be particularly self-revealing. Comparatively solitary nature of study may foster an atmosphere in which students see themselves as autonomous learners working towards individual goals.

Some positive comments were made regarding the peer assessment Seeing different ways of approaching a question. Interacting with other students and discussing and agreeing on marks.

Overall conclusions Despite implicit gain from the exercise as a whole, the students perceived that: The formative assessment would improve their future performance. The peer marking element was incidental, of little benefit, and merely a way for staff to avoid extra marking loads.

Recommendations for improving student attitudes towards peer assessment 1.Introduce it from the start of year 1. 2.Engage students and staff with the process and its benefits. 3.Consider marking the peer feedback. 4.Use codes to preserve anonymity. 5.Staff moderation of a sample of scripts. Adapted from Ballantyne et al., Assessment and Evaluation in Higher Education 27,