Improving assessment and feedback processes with OCR technology QAA Scotland 18 March 2015
HP TeleForm TeleForm is a form processing software solution which captures images and data from forms and other documents. TeleForm uses text recognition software to identify the document type and extract the information using industry-leading OCR (Optical Character Recognition), ICR (Intelligent Character Recognition) and OMR (Optical Mark Recognition) software, ready for export to a database.
TeleForm Answer Sheet
Data capture Data verification Student views grade and answer sheets on Moodle Administrators record grades into course spreadsheet and MyCampus student record system Data export
Benefits Markers Students Administrators 78% agreed/strongly agreed the answer sheets are easy to use for marking. No need to add up marks and convert marks into a grade. Permit remote marking of assessments. Students Ease and speed of getting grades and feedback online. Transparency in grades/marks awarded. 92.5% agreed/strongly agreed that the opportunity to review exam answers with the exam paper and generic feedback will help prepare for future assessments. Administrators No sorting of attendance sheets and script books into student number order. No manual entry of grades. Reduced transcription error.
Challenges Resources TeleForm expertise, hardware and software (11K for 1 PC, scanner, TeleForm Desktop Licence and support) Students New answer sheet and instructions Administrators Steep learning curve (new set of processes) Inconsistencies Marking in grades and/or marks Multiple conversion tables for Multiple Choice Questions and written exams Exam weightings - question/exam level totalling to 100%
Lessons learned Don’t implement while you are developing Communication – face to face, drop-ins, training, emails Academic leadership Management support and investment User guides and process documentation Standard conversion tables Standard exam paper rubrics and question weighting Tools to give administrators control over all aspects of managing grades Improve quality of hand-written fields
TeleForm website bit.ly/1BpfQDi Hooi Ling Eng (Project Manager) HooiLing.Eng@glasgow.ac.uk Malcolm Goldie (Analyst) Malcolm.Goldie@glasgow.ac.uk
Discussion question: Systems development uncovers existing working practices. How would you anticipate these issues and how would you resolve them?