Electronic marking and feedback using GradeMark OCSLD & Mediaworkshop 2014 Cartoon by Bob Pomfret, copyright Oxford Brookes University.

What’s it like to use? What’s the point? Are there any drawbacks? Can I have a go? Session outline What does the student see? What does the tutor do?

Overview Hosted by Turnitin Runs in Moodle Functions include QuickMark (bank/set of module comments) General Comments In-line comments Rubric (with grade calculation) Grading Audio feedback (feed-forward)

Example of the functions GradeSimilarity score Quickmark set Comments Add general comment Add rubric

Activity 1: Review a marked up assignment  Open the exemplar assignment titled ‘Activity 1 – a marked up assignment to review’  Check all of the markers’ feedback and grades  If you were second marker, how would you proceed? Note: please do NOT edit/markup this assignment

Pros Paperless No need for students to submit or collect in person More readable feedback for students Richer feedback is possible High levels of control over release of grades & feedback Easy access for second markers and external examiners Range of multi-modal feedback/feed-forward options Easy to use Can save marking time Allows for peer evaluation (observation) of marking across a module/programme Marking via tablet device (iPad)

Cons Heavily reliant on internet connection (although offline marking can be done using mobile app) Additional screen time No ‘blind’ second marking, need to establish system for second markers to annotate papers Symbols, images, cannot be used in feedback Association with Turnitin plagiarism detection Potential for ‘spying’? Moodle tutor/seminar groups need to be set up so that tutors can easily locate just their students’ submissions (from large group) Requires change to previous marking practice

Anonymous marking Plan carefully with summative assignments that are being marked anonymously!  If at any time anonymity is turned off (by anyone), it cannot be turned back on again for that assignment!  Plan to accommodate mitigating circumstances extensions and resits (return of grades/feedback removes anonymity)  extend the assignment post date, or  create new assignment(s) for extensions and/or resits

What a student sees Originality report General comments section Audio- feedback Switch between Originality & GM In-text comments In-text comment about highlighted text

Locate a set of assignments Click here to see submissions

What does the tutor do? Submissions can be searched by author, originality reading or submission number Tutors click on pen icon under grade Indicates student has collected the marked assignment

Locate a set of assignments Click here to see submissions

Choose group of assignments to mark Choose your tutor/seminar group assignments

Open an individual submission Click on pen icon Originality report turned off by module leader

Mark away Choose your QM set or create a new one Use QM manager to edit, import or export QM sets Personalise or colour-code QM comments Move to General Comments or Rubric

Use the rubric function Select criterion & level achieved As you scroll to a criterion scale, its descriptor will appear below.

Add a general comment & audio message General comments section Record a message – up to 3 minutes Written comments

Activity 2: Import a quickmark set; mark an assignment You have been provided with a quickmark file (exported from a manually created quickmark set) to import. Import the quickmark set Select one of the ‘mock students’ Open up their assignment & use the GM functions to give written & oral feedback / feed-forward Discussion: How can course quickmark sets be updated each semester/year?

Activity 3: Create and apply a rubric to an assignment  Select an assignment to mark  Create a new rubric (using your own marking criteria)  Apply the rubric to this assignment  Export the rubric and share it with a colleague  Import your colleague’s rubric

Resources  Jisc Electronic Management of Assessment project website at  Maguire, G. & Pearson, R. (2012) Case Study – Turnitin GradeMarkhttps://weblearn.ox.ac.uk/access/content/group/f4390f96-516a- 4ab0-ac61-8a963b312453/docs/Turnitin_grademarkv1.pdfhttps://weblearn.ox.ac.uk/access/content/group/f4390f96-516a- 4ab0-ac61-8a963b312453/docs/Turnitin_grademarkv1.pdf  Oxford Brookes University (2012) What is GradeMark?