Peer review with Aropa in Computing Science

Slides:

Advertisements

Similar presentations

Student Engagement and Retention. Sue Pulko Reader in Numerical Simulation Department of Engineering University of Hull.

Advertisements

1 Enhancing international student experience with innovative assessment and feedback Helena Snee (GBS BL champion and SL in Economics) Dr Esyin Chew (SL.

Assessment. Assessment What is it ? Why assess and for whom? How should we assess? When should we.

Undergraduate Dissertations in Economics A Practical Guide Peter Smith University of Southampton.

JISC Electronic Detection of Plagiarism Pilot Impact of Electronic Plagiarism Detection Software The University of Aberdeen Experience.

Peer Review: A Conduit for Developing Graduate Attributes? Judy Pate & Sheena Bell – The Business School Helen Purchase & John Hamer – Computing Science.

Advocacy and IPR tutorial Morag Greig Advocacy Manager: Enlighten Glasgow University Library Open Scholarship th October, 2006, Glasgow.

1 Assessing and Giving Feedback. 2 Learning Outcomes By the end of the session, participants should be able to: Identify the purposes and use of different.

Self-directed Learners Dr Sara Preston.

Self-directed Learners Mary Pryor Academic Learning & Study Unit (ALSU)

Use of peer assessment in an MSc course MSc in Sexually Transmitted Infections & HIV- Basic Science module Assessment: 70% end of module essay, 30% peer.

Assessment Design Practical examples. Peer marking using model answers (Forbes & Spence, 1991) Scenario: Engineering students had weekly maths problem.

Refreshing institutional policies around academic integrity: a focus on student training Dr Neil Morris Faculty of Biological Sciences.

Implementation of a Scientific Literacy Project in a Large First Year Biology Class -Fiona Rawle.

Student Peer Review - Improving Feedback and Enhancing Learning Dr Anne Jones Centre for Educational Development Dr Bjoern Elsaesser School of Planning,

Using Team-Based Learning to Support Individual Assignments and Gather Peer Review Feedback in Large First Year Classes Dr. Douglas G Carrie.

Judith Lane Programme Leader MSc (pre-registration) Physiotherapy School of Health Sciences Queen Margaret University.

BMAN10780 – Business and Management Skills: Role of Academic Advisors Simon French Anna Goatman

Teaching Computer Forensics at a Distance HE Academy Workshop on the Teaching of Computer Forensics University of Glamorgan, 27 November 2008 Blaine Price.

Making a Competitive Application

Deterring and detecting plagiarism workshop Judy Cohen, UELT.

Developing coherence in assessment. Relationship to the new C- QEM report* Coherence in the course and assessment *Course quality enhancement and monitoring.

Doc.: IEEE /0564r0 Submission May 2014 Marc Emmelmann, SelfSlide 1 Results of LB 201 on TGai D2.0 Date: Authors:

Working in an international classroom: some things I’ve learned from students Dr Gayle Pringle Barnes College of Social Sciences

Introduction to CEM Pre-16 Computer Adaptive Assessments Glasgow 13 th February 2013

Centre for Translation Studies

Professional Perspectives: Electronic Engineering Paul Spencer Dean of School, Electronic Engineering Kal Winston* Adviser, Study Skills Centre.

Dr Jon Goss, Dr Alison Graham, Dr Christie Harner & Dr Sara Marsham USING GRADEMARK TO IMPROVE FEEDBACK AND INVOLVE STUDENTS IN THE MARKING PROCESS.

Artificial Intelligence 0. Course Overview Course V231 Department of Computing Imperial College, London © Simon Colton.

IB Assessment External assessment – Paper 1 – 45 marks – 1 hour (30% weighting) – Paper 2 – 65 marks – 2 hours (50 weighting) Internal assessment – 20.

EDUC 260: Week 13 Hand-in your Position Paper. Overview Administrivia Ethics of computing in classrooms What did we learn in the course? Course evaluations.

What is Turnitin? Text-matching software –It compares your written academic work to a database of other works to check if your work is original Online.

Is PeerMark a useful tool for formative assessment of literature review? A trial in the School of Veterinary Science Duret, D & Durrani,

Coursework Tutorial for Year 1 Students The purpose of coursework provides a focus for your studies. requires you to prepare, consolidate, rehearse and.

ACADEMIC LEARNING DEVELOPMENT Plagiarism 1 Academic Learning Development, Learning and Teaching Enhancement Unit.

Designing in and designing out: strategies for deterring student plagiarism through course and task design Jude Carroll, Oxford Brookes University 22 April.

Preparing students as effective assessors Enabling learning beyond graduation David Nicol Professor of Higher Education Centre for Academic Practice and.

etools.massey.ac.nz Tools to help lecturers mark assignments John Milne Eva Heinrich.

Distance Learning Programmes: A Case Study about Yarmouk and Sunderland Universities joint MSc Programmes Mohammad Hamdan Chair of Computer Science Dept./

From an e-portfolio to a PLS: Integrating an e-portfolio into PgC in Learning & Teaching in HE. Sarah Chesney Centre for the Development Of Learning &

The pros and cons of using audio feedback to support student learning Dr Darren Comber Centre for Learning & Teaching Dr Lindsay McPherson School of Biological.

Harvard or Vancouver – getting it right all the time Alan Glasper and Colin Rees How to Write Your Nursing Dissertation, First Edition. Alan Glasper and.

Self and Peer Assessment Through DUO Hannah Whaley University of Dundee Hannah Whaley University of Dundee.

A review of peer assessment tools. The benefits of peer assessment Peer assessment is a powerful teaching technique that provides benefits to learners,

ECE 1100: Introduction to Electrical and Computer Engineering Wanda Wosik Associate Professor, ECE Dept. Notes 1 Spring 2011 Slides adapted from lectures.

Electronic marking and feedback using GradeMark OCSLD & Mediaworkshop 2014 Cartoon by Bob Pomfret, copyright Oxford Brookes University.

New Literacies By: Brandon Creswell, Charles Zhang LRC 320.

The Black Death Celia Sertich Antelope Crossing Middle School.

Laura Taylor, Math Instructor Cape Fear Community College Valerie Melvin, Math Instructor Cape Fear Community College Discussion Forums for Online Math.

Building Resources for Teaching Computer Architecture Through Peer Review Edward F. Gehringer Dept. of Electrical & Computer Engineering Dept. of Computer.

Digital Assignments in Moodle. Types of Assignments Offline Assignment Online Text Assignment Journals Upload Single File Assignment Advanced Uploading.

A MEMBER OF THE RUSSELL GROUP. Denis Duret School of Veterinary Science University of Liverpool Denis.

How to write an essay for Social Science Workshops for AID students Academic year 2010/11.

Creating Assessments that Engage Students & Staff Professor Jon Green.

Assessment in HuskyCT Janet Jordan Manager, Instructional Resource Center.

Assessment in Higher Education: Supporting students’ first experiences Rita Headington University of Greenwich.

The Challenging Work of Professional Writers

Media Design Expository English and Composition Gloria Zermeño November 18, 2015.

Moodle Assignments Going digital!. Assignments Allow you to provide assignment instructions Take in digital work Return grades & comments to students.

Biomedical Sciences 1: Facilitating the transition to higher education Dr Allison Wroe, Dr Phil Larkman Edinburgh Medical School: Biomedical Sciences Enhancement.

Northumbria Conference – 9 th September  HE context of ‘learning & teaching’ viewed as:  Learners  Little opportunity to engage with the nature.

“Crowdsourcing” a Textbook: 120 Student Authors Writing on a Wiki

Rebecca Freeman (Life Sciences) & Lynne Bayley (Chemistry)

Assessment – using the Moodle assignment

02086 Writing Inspirations Aalto University

Department of Chemistry

The One-Two-Three Feedback Cycle

Final exam 3rd semester A2018

Diverse use of the web-based peer assessment tool, Aropä, across the University of Glasgow. Elaine Huston, Mary McVey, Susan Deeley, Chris Finlay, John.

Submission Date Reminder!

Presentation transcript:

Peer review with Aropa in Computing Science Dr Simon Rogers Simon.Rogers@glasgow.ac.uk

The course: PSI Professional Skills and Issues: Assignment: L4 and Msc students (>100) Compulsory: Required for BCS accreditation Non-technical: Ethics, IPR, Data protection etc Not the most popular L4 course…… Assignment: 1,500 word essay. 2 stage peer review process. Final mark (from academic) weighted by `engagement factor’

Aropä Peer review management software developed by John Hamer (Auckland & SCS) and Helen Purchase (SCS). helen.purchase@glasgow.ac.uk http://www.dcs.gla.ac.uk/~hcp/aropa Handles everything: Submission (word/pdf, txt) Assignment to reviews Review rubric (design your own) Returning reviews to reviewers Reviewing of reviews Very easy to use. Local support available. Willing to expand system to meet new requirements.

Peer review process Trial exercise Assessed exercise 500 word essay 2 reviews Not assessed (almost 100% response) Assessed exercise Students submit draft essay on one of 3 topics (0.7). Assigned 3 reviewers from same topic. Reviewers assess work (numerical ratings and text justification) (0.05 x 3). Reviews returned to authors who can use them to improve essay. Each student also reviews 3 other reviews (0.05 x 3). Final marking done by academics, weighted by factors (X)

Pros & Cons Pros: Aropa very easy to use – assigning reviews, handling deadlines, monitoring submissions etc. High level of engagement (almost all students completed everything). Massive quantity of feedback (not always high quality) Cons: Between cohort tension (L4 v MsC). `Threat’ of plagiarism (by reviewers). Lack of peer review experience – poor quality of feedback (first use of peer review for 85% of class). Anonymity (.doc files).

Other feedback Only 20% of students would have been happy to be formally assessed by peers. Of those who thought the exercise improved their essay (42%!), 71% felt that the most helpful bit was receiving feedback.