Paul Nisbet, CALL Scotland University of Edinburgh Accessible Digital Assessment for Learners with Additional Support Needs

CALL Scotland Strategic Leadership Pupil Assessment and Support CPD and Training Information and advice: books, guides, resources, videos, web site Loan of assistive technology Knowledge Transfer, research and development

Real pupils, real challenges “Over the last 20 years the Centre has achieved an international reputation for its expertise, quality and depth of advice, and its innovative developments.” Professor Martyn Roebuck, Review of the CALL Centre, 2004

EXAMS!!

SQA Assessment Arrangements “Assessment arrangements allow candidates who are disabled and/or who have been identified as having additional support needs appropriate arrangements to access the assessment without compromising its integrity.” Introduction to Assessment Arrangements for Schools and Colleges SQA January 2010, revised June 2013

2002need for Digital Question Papers identified research into specification; development of papers evaluation in 6 schools pilot trials # students used digital papers in 105 examinations pilot trials # candidates used 490 digital papers in 200 examinations Research, Development and trial

Total number of requests41,454 Assessment ArrangementNumber of requests Percentage of requests Extra Time33, % Reader15, % Scribe14, % PA Referral3, % Use of ICT2, % Transcription with correction1, % Coloured Paper1, % Calculator % Transcription without correction % Enlarged Print % Question Paper signed to candidate920.22% Candidate Signs Responses380.09% Use of tape recorder for responses260.06% Braille190.05% Type of Assessment Arrangements requested, 2005

Nature of disability or difficultyNumber of requests Number of candidates Specific Learning Difficulties/Dyslexia (SpLD)23,0685,353 Specific Learning Difficulties/Other3, Mild/Moderate Learning Difficulties (MLD)2, Specific Learning Difficulties/Dyspraxia1, Visual/Hearing Impairment1, Other Health Problems1, Visual Impairment1, Autistic Difficulties1, Other Social, Emotional and Behavioural Difficulties (EBD) Speech and Language Impairments Attention Deficit Hyperactivity Disorder (ADHD) Hearing Impairment Blank Concentration Difficulties Epilepsy19150 Myalgic Encephalomyelitis (M.E.)15243 Disability/difficulty of candidates requiring Assessment Arrangements, 2005

Type your answers Click to tick Use on-screen drawing tools Read questions with text-to-speech SQA Digital Question Papers

Digital Answer Booklets Only ‘Question and Answer’ papers (most Intermediate and National 5’s) have the red answer boxes To answer most Higher and Advanced Higher papers use Digital Answer Booklets in PDF or Word. Digital Answer booklets are downloaded and made available from SQA’s web site

Staff evaluations 2006 trials

Reduced accommodation “We had 2 rooms set up with double sized tables to allow a comfortable amount of room for laptop and papers. Each candidate was allocated a table which was the same for each exam. All tables were numbered and we made use of screen dividers which created a booth effect and cut down distractions and gave a certain amount of privacy in the small classroom. We had 9 candidates sitting the exam in digital format and 2 writing in the same room for the Standard Grade English exam.”

Pupils’ comments 2006 & 2007 Prefer it to using a scribe. Easier to give answers. Easy to do. You can see both the questions and the text at the same time. Enjoyed using it! I would prefer to have split screens so that I could see questions and tables together instead of having to refer to another page.

Pupils’ comments 2006 & 2007 Papers are simpler to use. You do not have to fiddle about with different papers. By switching windows, you can see both the question and the text at the same time. Because it is much easier to use than a reader

SQA Assessment Arrangements 2013 requests Requests for Assessment Arrangements made for 17,263 candidates (11.3% of candidates) Requests made for 61,680 entries (8.3% of all entries)

2013 assessment arrangements Extra Time 47,038 Calculator 639 Separate accommodation 37,584 Transcription without correction 534 Reader 19,058 Referral of script to the PA 271 Scribe 14,905 Modified Content (e.g. text description of images) 233 Use of ICT (inc DPs) 11,844 Adapted Certificate (e.g. in Large Print / Braille) 100 Prompter / Practical Helper 3,351 Paper signed to candidate 66 Rest Period 2,410 Candidate Signs Responses 37 Coloured Paper 1,968 Live presentation 36 Transcription with correction 1,327 Braille 23 Enlarged or Adapted Print 1,310

Digital Paper Requests Number of requests 5141,1672,0002,8323,6944,291 Number of centres Number of candidates ,0691,3271,677 Mean number of requests per centre Mean number of candidates per centre Mean number of requests per candidate

Digital Question Papers

AA trends (number of requests)

AA trends (% of total requests)

Staff comments, 2010 Increases candidates’ feelings of independence and control over their speed of progress. Helps with confidence to face next step, e.g. college, work. Digital Papers provide an excellent opportunity for more able pupils with additional needs to work independently without a scribe. Help cut down the number of readers/scribes and invigilators... a significant cost saving for the centre. Use further in the future with the aim of completely replacing readers and scribes for some subject exams.... very worthwhile – provide increased independence and a real sense of achievement which the ethos of Assessment for All would promote.

Staff comments, 2011 The pupils selected for digital papers during this diet provided us with evidence that they could show their potential and complete their papers independently. They all felt satisfaction at being independent. Our Academy has suffered a drastic cutback on SfL staff and this will have the knock on effect of making us work harder to have the pupils use Digital Papers instead of having a reader. The pupils really like the independence the digital exams give them. It was also good to have the answer books. This was the first time our centre had used digital exams. I was pleased by how easy, user friendly the process was. It was a great benefit to several of our students and we are going to develop the use of these further through the school.

Staff comments, 2012 I enthusiastically endorse the use of digital papers for pupils with ASN - Specific learning difficulties with reading, writing, spelling. We have used the CALL Centre website and materials to train staff via twilight courses. Now virtually every department in the school has one person trained, plus there are 2 classroom assistants and 2 ASN assistants who can now create digital prelims from Word documents using Adobe Professional which has been installed on computers. There were still pupils in school who were more comfortable with Reader and Scribe this year because this is the method they were familiar with. However, I am encouraging most of ASN pupils to consider this method in the future. This is our second year of using digital and I am convinced it is the way ahead. I have encouraged English Department to prepare S2 Close Reading Assessments in digital format so that this becomes the norm for pupils as they move through the school and undertake assessments. Science is also beginning to develop this method for pupils.

Staff comments, 2013 Intending to direct more pupils towards digital papers as much as possible especially with readers / scribes not being permitted for the literacy element of Nat. 4 & 5. Pupils will require to be up to speed with alternatives to R / S. Intending to try and digitalise assessments within the lower school for training purposes. I think the digital exam system is an excellent option for pupils with ASN and gives them more independence. Digital exams are growing to a vast level, very difficult to manage the increased numbers, especially with IT crashes that happen on occasion. I am hoping to switch to digital assessments for all learners with ASD, ADHD and dyslexia/dyslexic-type needs. It would be very helpful if assessment materials on the secure site for CfE courses were available in digital format.

Not a panacea! Digital versions of paper assessments. Some questions do not ‘translate’ particularly well to the screen. Only ‘question and answer’ papers have answer boxes. Options for drawing and for writing mathematical and scientific notation are limited. Text-to-speech can’t read maths and science and makes occasional mis-pronunciations (but getting better …. )

All papers to be in question-and-answer format with answer boxes. All learners to be able to use DQPs (or online assessment). A practical mechanism for completing maths and science papers digitally. More computers, more staff, more money, free beer, peace on earth… What the customers want…

To use the papers: Adobe Reader (free) MS Office (in schools) To use text-to-speech: Adobe Read Out Loud (free) Ivona MiniReader (free) Scottish computer voices (free from CALL To revise and practice: Digital Past Papers from SQA Free, cheap or already in schools = better access for all

Partnership

SQA have provided DQPs since 2008…... RUK boards will start this year Scottish learners can use free high quality Scottish computer voices… … only FE/HE (not schools) in England have free English voices; there is a free Welsh language voice; no other nations make such provision) Pride

Costs of readers/scribes 19,058 reader requests; 14,905 scribe requests ~ 36,000 individual exams ~ 54,000 hours Say average £20/hour for reader/scribe? = £1,080,000 Say £10/hour for invigilator? = £540,000 £1.62mTOTAL = £1.62m in Scotland last year

Impact on practice

“In relation to the National Literacy Units at all levels: (i)exemption from demonstrating any of the four assessed skills of reading, writing, listening or talking will not be a reasonable adjustment and (ii)(ii) using human readers and scribes will not be reasonable adjustments where reading and writing abilities are being explicitly assessed.” Narional Literacy Assessment

Reasonable Adjustments “In order to minimise the disadvantage faced by some disabled learners in attaining the National Units in Literacy, the use of word processors and other assistive technologies such as screen readers, spell checkers or speech-recognition software would be acceptable as reasonable adjustments.”

A 6 th year pupil at Denny High in Falkirk was assessed using the Neale Analysis, reading with and without text-to-speech. Reading herself, her comprehension age was 6 years 9 months. With text-to-speech, it was over 13 years.

Curriculum for Excellence How can you be a: Successful learner Successful learner - if you can’t read books and learning materials? Confident individual Confident individual - if you depend on others to read to you, write for you or talk for you? Responsible citizen Responsible citizen - if you don’t have access to information? An effective contributor An effective contributor - if you can’t speak, write or communicate?

Use ICT! Reliant on Readers? Stuck with Scribes? or Independent with ICT?