Piloting eFeedback on hand-written exams Jon Shute (School of Law), Anna Verges & Andrew Wilson (eLearning Faculty of Humanities)

Slides:



Advertisements
Similar presentations
Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.
Advertisements

Top Tips for Using Turnitin for Originality Checking and Online Marking A Quick Overview Humanities eLearning Team
Turnitin GradeMark FHSCE experiences over academic year 2011/2012.
Law School 1 Using Blackboard Assignment tool for e-submission, e-marking, e-feedback Jane Daly 21 st March 2013.
EiS – Education iT Services Our passion in EiS is to make a real difference in education and ultimately childrens lives by providing innovative solutions.
Personalised feedback vs consistency : the role of electronic marking and feedback. Maureen Readle & Jak Radice Centre for Educational Development University.
C1 – Manage Assessment. Overview Head of Department(HOD) to setup weightages 1. Student Assessment To view and capture assessment submission dates from.
Online Assignment Submission, Allocation, Marking, Moderation and Return in Blackboard - A Fresh Approach Michael Garner, Griffith University Professor.
Online marking with Turnitin Assignments September 2013 Tracy Donelly, Turnitin Officer.
Enhancing MyUni Progress and Planning – 12 th June 2013.
In-year Assessment – Tools for PTs in Physics and Astronomy Keith Brunton Application Developer / eLearning Support, School of Physics and Astronomy (SOPA)
Blackboard 9.1: Local Systems Meeting July 2011 Hilary Griffiths.
LTI CONFERENCE University of Hertfordshire MAY 6 TH 2010 Karen Clark and Sharon Korek.
LiveText Student Benefits. © 2009 LiveText, Inc. All rights reserved. 2 Your “My Space” for Education Your LiveText Membership One Time Purchase Access.
How can you improve the quality of the feedback that you give to students and also save time in the process? *Colin Pitts, # Roger McNally, # Stephen Aylmer,
E-portfolios for PDP An overview of student and staff perceptions across subject areas Federica Oradini and Gunter Saunders Online Learning Development.
Using Blackboard to support team- based learning: delivery and rollout Moira Sarsfield, Imperial College London.
Feedback on Summative Examinations John Davies (Science and Engineering) Donald Spaeth (Arts) Ruth Cole (Senate Office)
How the assessment landscape is changing in the short and medium term Peter Taylor.
STUDENT SENSITIZATION BY:DAQA ISO 9001:2008 Certified 1.
University Writing Project Faculty Feedback
4 th & 5 th June 2015 Electronic Assessment Feedback Claire Farquharson, Edge Hill University SOLSTICE Conference 2015.
Moodle (Course Management Systems). Assignments 1 Assignments are a refreshingly simple method for collecting student work. They are a simple and flexible.
Enhancing the assessment experience through closer integration between the SRS and VLE University of York, UK Dr Richard Walker bett 2015 January 21 -
Advising to Make the Grade FYE Assignments that Benefit Students and Advisers Veronica Giguere Florida Institute of Technology.
1 Phillips Andover Academy 2/22/2006 – 1:30-3:00 Darek Sady Blackboard Learning System (Release 6.3) Assignments, Gradebook, Performance Dashboard.
A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio.
Thesis Contribution Marilyn Edmond Senior Consultant.
Self and Peer Assessment Through DUO Hannah Whaley University of Dundee Hannah Whaley University of Dundee.
A review of peer assessment tools. The benefits of peer assessment Peer assessment is a powerful teaching technique that provides benefits to learners,
6/2/11 IT-Client Support & Services.  Collect and grade work ◦ Assignments ◦ Tests & Quizzes  Distribute and view grades ◦ Gradebook ◦ Post’Em.
Getting to Grips with Assignments Bronze Level – Compulsory.
Electronic Submission and Marking Tutors and Students Evaluate ‘Crocodoc’
Course Management with Banner August 2009 Banner Key Elements of Banner – Course Management 1.Accessing (& Verifying) your class roster 2. ing students.
Student Guide to WECSERF Online Learning Portal. Before you start – use your ticket
Blackboard 8: Grade Center This workshop is for existing users of Blackboard interested in keeping track of student grades online. Blackboard replaced.
Electronic marking and feedback using GradeMark OCSLD & Mediaworkshop 2014 Cartoon by Bob Pomfret, copyright Oxford Brookes University.
When you first log in, this is the page you will see. It lists all the courses you’re enrolled in – and differentiates between those that are active and.
COLLEGE-READY LEARNER CRITICAL THINKER ADAPTABLE & PRODUCTIVE LEADERRESPONSIBLE DECISION MAKER SKILLED COMMUNICATOR HISD Online Assessment Using Formative.
KEY OUTCOMES By the end of this session you should be able to: Consider the general teaching philosophy that resulted in the student’s feedback for.
Electronic Assessment Management Sue Lee
Moodle Basic Assessment Methods Staff Guide. Adding a Assignment Click Add an Activity or Resource With the course in editing mode...
+ Summer Institute for Online Course Development Institute – Assessment Techniques Presentation by Nancy Harris Dept of Computer Science.
E-MARKING Isabel Millar e-marking at SQA Benefits of e-marking What you can do to assist Q & A Aims.
Welcome CSV Imports Elizabeth Osika Associate Professor and Campus Administrator
Acadia Institute for Teaching and Technology Peer Review.
New Methods of Improving Feedback and Assessment School of Psychology Professor Carol McGuinness Director of Education Professor Cathy Craig Senior Personal.
Moodle My Feedback: Assessment reports for staff and students Jessica Matt MoodleMoot IE/UK 2016.
Learning Technology Development. edgehill.ac.uk Online Submission Workshop edgehill.ac.uk How to create an assignment dropbox? Assignment Template Dates.
Learning Technology Development. edgehill.ac.uk Online Submission Workshop edgehill.ac.uk How to create an assignment dropbox? Assignment Template Dates.
Jessica Matt MoodleMoot IE/UK 2016 Moodle My Feedback: Trialling the My Feedback report at UCL.
+ Fool’s Gold Can the VLE and SRS appear seamless ? Dr Neil Ringan Assistant Head of Learning & Research Technologies (Learning Innovation) Manchester.
Edgehill.ac.uk/ls. Successfully managing online marking – A guide to using the Grade Centre in Blackboard Adrian Cain & David Callaghan.
Financial Management of ECE Programs.  Go to “Tools”  Click on “Personal Information” to edit your personal information (including address) or.
Electronic marking and feedback using GradeMark Digital Services Workshop 2015 Cartoon by Bob Pomfret © Oxford Brookes University.
Blackboard Assignments & Feedback Rubrics
Simplification of work
Access additional e-learning resources and support via the Bb Support Tab in shuspace. You can also contact the faculty's e-learning Development Team.
Level 1 Childcare Sharon Thompson
Learning Skill Course Dept. of Medical Education College of Medicine
Assessment – using the Moodle assignment
EMA :Collaboration Session
Proficient Level Training Workshop
The School Point of View
Managed Learning and Assessment Environments A strategic approach for the provision of Transnational Education Dr Ray Stoneham Professor Mayur Patel Faculty.
The Narnian Virtues Character Education English Curriculum:
Improving assessment and feedback processes with OCR technology
Important information about your assessment in 2017/18
UL Student Employee Rubric + Blackboard Organization Tutorials
Role of the External Examiner
Presentation transcript:

Piloting eFeedback on hand-written exams Jon Shute (School of Law), Anna Verges & Andrew Wilson (eLearning Faculty of Humanities)

Faculty perspective Examination remains the second major form of summative assessment across Faculty. Source: Campus Solutions Assessment typeInstances% of total Coursework/Assignment/Essay1, Exam Presentation Test Report Practical Oral Portfolio Project Dissertation Other 2852

Faculty Perspective Timeliness and quality of feedback on examinations is not only a challenge in large cohorts but arguably a key contributor to student satisfaction and attainment. A small pilot conducted in Criminology shows that electronic delivery of feedback increases student engagement with feedback provided on examinations.

Academic perspective Motives Pilot: LAWS10432 Psychology, Crime & Criminal Justice (n= ) Half the class randomly allocated to receive electronic feedback Feedback comments entered into Excel marking sheet (anonymous/offline) Spreadsheet uploaded into Blackboard

Academic perspective Personal experience & evaluation 37/76 (48.7%) of cohort checked exam score in feedback via ‘My Grades’ in Blackboard No date on paper feedback views Evaluation then and now

Process (Demo) 1. Preparing the Grade Centre hiding the name and surname column in the Grade Centre; create a new column in the Grade Centre and hide it to users (so that grades are not released as marking is underway) 2. Anonymous marking: Marker enters grade and comments via ‘Quick Comment’ in Bb or marks offline using Excel. 3. Not anonymous marking: Marker enters grade and comments via ‘View Grade Details’. A rubric can be created and associated to a Grade Centre column. Marker can mark by either:  Entering a grade only  Entering comments  Ticking a rubric cell 4. Release grades: visibility of grades controlled manually by making Grade Centre column visible or not. No selective release can be set on Grade Centre columns.

Pros & Cons ProsCons Administrative savings for academic and PSS staff Grades can be returned quicker and time to arrange feedback viewing not required Students: No need for students to physically collect scripts with feedback (feedback available online) Increased likeliness that students collect feedback Upload of grades from Bb to CS is uncontroversial Initial time investment required to set up anonymous marking conditions and configure grading sheets - Grade Centre (anonymous, create columns) Anonymity conditions can be easily reverted Protocols are required for online marking to ensure strict observation of student anonymity Offline marking requires full attention to formatting aspects (downloading & uploading from Grade Centre to Excel)

Next steps Larger sample/evidence Expand pilot to other courses Gathering student views on preference for full e-exams vs. hand-written examinations

QUESTIONS?