Is PeerMark a useful tool for formative assessment of literature review? A trial in the School of Veterinary Science Duret, D & Durrani,

Slides:



Advertisements
Similar presentations
1 Enhancing international student experience with innovative assessment and feedback Helena Snee (GBS BL champion and SL in Economics) Dr Esyin Chew (SL.
Advertisements

A Masters in Education in eLearning The University of Hull.
Implementation of a Scientific Literacy Project in a Large First Year Biology Class -Fiona Rawle.
Top Tips for Using Turnitin for Originality Checking and Online Marking A Quick Overview Humanities eLearning Team
Andrea Han and Joanne Fox
Portfolio Review Process Georgia Alternate Assessment.
Dr Teresa McConlogue UCL © Dr Teresa McConlogue This presentation is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike.
Presenter: Han, Yi-Ti Adviser: Chen, Ming-Puu Date: Jan 19, 2009 Sitthiworachart, J. & Joy, M.(2008). Computer support of effective peer assessment in.
Fiona Russell SASS. Diploma in Housing Studies  Blended learning  Full-time and Part-time students  Postgraduate but includes non-graduates  Assignment.
Assessing Learning in the Gifted Classroom
Using Student-Produced Videos to Enhance Learning Engagement in a Chemical Engineering Thermodynamics Course Douglas Ludlow Professor of Chemical Engineering.
NWACC Library Instruction Program Teaching information literacy skills for academic success and lifelong learning.
Learning Objectives, Performance Tasks and Rubrics: Demonstrating Understanding and Defining What Good Is Brenda Lyseng Minnesota State Colleges.
Exploration of Students & Mentors Experiences of Grading Student Competence in Practice. Janet ScammellVanessa Heaslip Senior Academic.
Recording Excellence Nicole Duplain School of Humanities.
What is Turnitin? Text-matching software –It compares your written academic work to a database of other works to check if your work is original Online.
October 22, 2009 Report to the Faculty Senate Professor John Stevenson Senator Sandy Jean Hicks UCGE-Subcommittee on Assessment of General Education (SAGE)
Research Papers Instructor: Frode Eika Sandnes Room
Using tutor feedback Study Skills Workshop. By the end, you should understand… What is the purpose of tutor feedback What it really means How you should.
Grading Group Projects Taryn Vian. Why do group projects? Increases student engagement through applied learning Allows us to give more complex assignments.
Make your papers disappear!?! 1. The Paperless Classroom! A presentation by Ronald Stephenson & Stephanie Berridge 2.
Thoughts on Teaching Public Health and the Health Work Force University of Medical Sciences Thimphu February 26, 2015.
Doctor of Education (EdD). Programme Objectives March EdD Program 1  The Doctor of Education (Ed.D) is designed to produce high quality academics.
External Examiners’ Briefing Day Assessment Policy Tuesday 6 th January 2015.
Introducing small-group workshops as formative assessment in large first year psychology modules Suzanne Guerin School of Psychology, University College.
ZUZANA STRAKOVÁ IAA FF PU Pre-service Trainees´ Conception of Themselves Based on the EPOSTL Criteria: a Case Study.
Chemistry B.S. Degree Program Assessment Plan Dr. Glenn Cunningham Professor and Chair University of Central Florida April 21, 2004.
Asynchronous Discussions and Assessment in Online Learning Vonderwell, S., Liang, X., & Alderman, K. (2007). Asynchronous Discussions and Assessment in.
Challenges in Formative Assessment across ENCAP, HISAR, and CARBS Melanie Bigold, Rob Gossedge, Casper Hoedemaekers, Tracey Loughran, and Maki Umemura.
ACADEMIC LEARNING DEVELOPMENT Plagiarism 1 Academic Learning Development, Learning and Teaching Enhancement Unit.
Student Forum March5, pm - Collaborate Students will share their thoughts on topics including: --experiences with online courses --ways instructors.
Alison Hayes Independent Learning Materials March 2012.
Learning from students: Using Peer Mark as part of an online research portfolio Dr Cath Jones Head of Research Informed Teaching Catherine Naamani – Head.
Action Research Use of wikispaces to improve levels of independent learning in AS Physics Cath Lowe.
BIO1130 Lab 2 Scientific literature. Laboratory objectives After completing this laboratory, you should be able to: Determine whether a publication can.
2015 DEE Conference Carlos Cortinhas, University of Exeter.
E- ASSESSMENT Why use it.. whatever it is? Phil Davies School of Computing University of Glamorgan.
Students’ and Faculty’s Perceptions of Assessment at Qassim College of Medicine Abdullah Alghasham - M. Nour-El-Din – Issam Barrimah Acknowledgment: This.
Directorate of Human Resources The use of the Nominal Group Technique in evaluating student experience Diana Williams OCSLD.
Using a Classroom Response System to Transform Student Engagement HEA Annual Conference, Warwick 3 July 2013 Jeff Waldock Department of Engineering and.
David Steer Department of Geosciences The University of Akron Learning objectives and assessments May 2013.
Utility for > 15,000 Universities & Schools worldwide.
An Orientation: General Psychology Online. The Course Menu Shown on the far left is the menu used to navigate our Psychology course.
Interdisciplinary Writing Unit: Narrative Kim Stewart READ 7140.
Blogging - assessment & feedback Dr Jessie Paterson, School of Divinity, University of Edinburgh
BS 3992 Researching Contemporary Management Issues -an alternative to the Final Year Project Dr Adam Palmer Dr Beverley Hill.
Adapted from “Best Practices for Student Learning, Assessment in Online Courses”“Best Practices for Student Learning, Assessment in Online Courses”
Module, Course and Unit Evaluations Module, course or unit evaluations give you the opportunity to make your voice heard by giving feedback about your.
Assessment Careers: getting better value out of feedback Dr Gwyneth Hughes and Dr Holly Smith.
Adapted from “Best Practices for Student Learning, Assessment in Online Courses”“Best Practices for Student Learning, Assessment in Online Courses”
Feedback in University Teaching Prof. Arif Khurshed Division of Accounting and Finance.
Chapter 14: Affective Assessment
Acadia Institute for Teaching and Technology Peer Review.
Welcome!!!. Let’s start with introductions Introduce yourself, stating your name, and your some of your favorite books or movies. My name is Alyssa and.
Building Resources for Teaching Computer Architecture Through Peer Review Edward F. Gehringer Dept. of Electrical & Computer Engineering Dept. of Computer.
Tips on Discussing the Standards & Giving Peer Feedback February 2010.
Innovative Applications of Formative Assessments in Higher Education Beyond Exams Dan Thompson M.S. & Brandy Close M.S. Oklahoma State University Center.
SVM Education Day: On-Line Discussion Site and other Tools Kristen A. Bernard, DVM, PhD.
A MEMBER OF THE RUSSELL GROUP. Denis Duret School of Veterinary Science University of Liverpool Denis.
Learning Technology Development. edgehill.ac.uk/ls David Callaghan September 2013 “How I engaged my students” One tutor’s experience that produced outstanding.
Creating Assessments that Engage Students & Staff Professor Jon Green.
Look listen and learn…again Do students learn by looking at and listening to feedback? Matt Prichard – Ray Stoneham.
Turnitin More than Plagiarism Detection Using Turnitin for Electronic Mark-Up and Peer Review October 20, 2015 Mike Scheuermann, PhD AVP – ITS Drexel University.
Documenting Your Teaching and Student Evaluations
PeerWise Student Instructions
Institute for Learning Innovation and Development
Peer Evaluation of Teammates
Impact of viewing personalised feedback on final assignment marks
Tutors: providing feedback Students: using tutor feedback
A Moodle-based Peer Assessment Tool
Presentation transcript:

Is PeerMark a useful tool for formative assessment of literature review? A trial in the School of Veterinary Science Duret, D & Durrani, Z School of Veterinary Science, University of Liverpool INTRODUCTION RESULTS The peer review task was accepted by the students with some reservations. Our experience shows that this process can successfully be implemented in large classes for formative assessments and it has been demonstrated in another study (Ballantyne et al., 2002). The feedback received from the students’ initial experience has been most useful as it will enable us to improve the peer review task for the next academic year. CONCLUSION REFERENCES NICOL, D., THOMSON, A. & BRESLIN, C Rethinking feedback practices in higher education: a peer review perspective. Assessment & Evaluation in Higher Education, 39, BALLANTYNE, R., HUGHES, K. & MYLONAS, A Developing Procedures for Implementing Peer Assessment in Large Classes Using an Action Research Process. Assessment & Evaluation in Higher Education, 27, The key steps of the PeerMark ©, peer review process Students submitted their literature review via Turnitin GradeMark © The instructor creates a PeerMark © assignment and sets two reviews for each student to be reviewed. The student writes a review anonymously for each assigned paper by responding to the open ended (written) and/or scale (ranked) questions selected by the instructor Once the PeerMark © assignment due date passes, the instructor reviews all the comments and adds few comments On the PeerMark © assignment post date, reviews of the students’ papers become available for the papers’ authors to view Comments included that:  “It helped show which specific areas needed improvement ”  “I think it was good exercise. I didn’t know how to reference properly. I was glad to be told how to reference properly”.  “I actually thought it was good. My style of writing and ability to reference has changed significantly”  “Instructor feedback was good to highlight the areas that need improvement and has definitely made a massive difference” And also:  “I was given conflicting feedback by the peers, one person said my referencing was good whilst another said it was wrong”. The instructor’s feedback helped me in identifying the correct feedback”. In general, the undergraduate students have very little experience of scientific writing and providing constructive feedback to their peers. In the PeerMark © system, we asked the students to provide constructive feedback by responding to both open ended and scaled questions, and also encouraged them to make specific comments where necessary. The entire process was set to be anonymous for students and the feedback and grades were provided following completion of the process. “Feedback is a troublesome issue in higher education” (Nicol et al., 2014). In the last National Student Survey (NSS), the BVSc programme (School of Veterinary Science, University of Liverpool) scores much lower than expected for feedback, with some students having noted they do not get feedback! This issue is being addressed considerably by the School with various exercises and activities. In addition to the primary feedback received from the course tutor, other options have been considered to involve students in the assessment process by setting up a peer review task for them. Essentially, this task allows students to evaluate the quality of work produced by their peers. Furthermore, its is believed that such tasks promote lifelong learning skills as students are actively involved in the assessment process. In the current curriculum, as part of a research skills exercise, second year veterinary undergraduate students have to submit a short literature review (2500 words) with appropriate reference style. In semester 1, as a part of formative assessment all students (n=156) were asked to submit their Literature Review via Turnitin. Each student had to review and critique two submissions of their peers. In addition to the above feedback received from the peers, all students also received feedback and final grades were awarded by the instructor. Turnitin ©, GradeMark ©, & PeerMark © are a suite of tools that enable online assignment submissions, and generates an originality reports for the submitted assignments. It also enables online instant grading & feedback, and have peer marking capabilities In order to evaluate the peer review activity, students were asked to complete an online, anonymous survey, focusing on the feedback they have received. Comments included that:  “Hard to tell as its usefulness is based on the knowledge of the person giving you a review. ”  “I would recommend the use of PeerMark on occasion, but certainly not for every piece of coursework”  “If it’s intended to involve students and engage them in a productive way, then it’s a good system. Quite simple to use”  “It did help to know how to mark others work. It wasn’t completely a dark; It was easy to mark and is obviously a strong point. METHODOLOGY The results show that the feedback received from the peers was “useful” and the feedback received from the instructor has greatly “helped” them in writing a better report. Furthermore, the students prefer to receive feedback from the instructor (red) compared to the feedback received from their peers (blue). The feedback that they gave help them to produce a better report (green). The PeerMark © process was easy but students are equally divided on the usefulness of the exercise and made some recommendations for the future.