1. @sparqs_Scotland #sparqsColReview Preparing for your College Review Hannah Clarke David Scott Simon Varwell Simon Jones

2. @sparqs_scotland #sparqsColReview Learning Objectives By the end of today you will: Have developed a deeper understanding of the college review process Have gained an understanding of the role of the Learner Engagement Questionnaire Have developed skills to enable effective engagement with your students Be able to plan for involvement in a college review

3. @sparqs_scotland #sparqsColReview Agenda 14:10- 14:30How does the college review work? 14:30- 15:15The Learner Engagement Questionnaire 15:15- 16:00Gathering student responses 16:00- 16:45Planning for your review 16:45 - 17:00Conclusions and close

4. @sparqs_scotland #sparqsColReview 2015-16Reviewsparqs contact Newbattle Collegew/b 9-Nov-15Simon Jones Perth Collegew/b 23-Nov-15Simon Varwell City of Glasgoww/b 11-Jan16David Scott West Lothianw/b 25-Jan-16Simon Jones Dumfries & Gallowayw/b 8-Feb-16Simon Jones North Highlandw/b 22-Feb-16Simon Varwell Invernessw/b 7-Mar-16Simon Varwell Forth Valleyw/b 14-Mar-16Simon Jones

5. Document title Transforming lives through learning

6. Document title Transforming lives through learning Preparing for your college review HMI Margaret Rose Livingstone Student Team Member – Julia Fitzgerald

7. Preparing for your college review Transforming lives through learning Themes Who we are and what we do Pre-review Review week Post review

8. Preparing for your college review Transforming lives through learning Education Scotland - who we are and what we do … Part of the directorate that deals with Lifelong learning and post- 16 provision. We review or inspect - Colleges Private colleges and English language schools Prison education Community learning and development Career information, advice and guidance services Modern apprenticeship providers

9. Preparing for your college review Transforming lives through learning The context HM Inspectors undertake reviews of standards and quality in Scotland’s colleges on behalf of SFC

10. Preparing for your college review Transforming lives through learning What is the main purpose of the review? to support and promote quality enhancement in colleges to provide the best possible experience for the learner; to provide information to Scottish Ministers and the public on the quality of colleges and the education and training they provide; to complement college-led internal review and self- evaluation; and to identify excellent practice.

11. Preparing for your college review Transforming lives through learning Working with colleges: three key principles: High quality learning: Learner engagement Quality culture

12. Preparing for your college review Transforming lives through learning Evaluative activities Annual engagement Subject based or thematic aspect reports External reviews of colleges

13. Preparing for your college review Transforming lives through learning High quality learning How effective are the college’s learning and teaching processes? How well are learners progressing and achieving relevant, high quality outcomes?

14. Preparing for your college review Transforming lives through learning Learner engagement How well are learners engaged in enhancing their own learning and the work and life of the college?

15. Preparing for your college review Transforming lives through learning Quality culture How well is the college led and how well is it enhancing the quality of its services for learners and other stakeholders?

16. Preparing for your college review Transforming lives through learning Pre-review phase Managing inspector: meets Principal and Chair of the Board/Regional Lead, staff and learners; agrees essential documentation from college or access to college intranet; arranges for the return of the Learner Engagement Questionnaire;arranges for the return of the Learner Engagement Questionnaire; liaises over arrangements with College Nominee.

17. Preparing for your college review Transforming lives through learning Review week (varies depending on size and nature of college) 3 x full days in college: Monday all day Tuesday all day Wednesday all day Evening classes as appropriate Outreach classes as appropriate Team meeting at the end of each day – in college (attended by college nominee)

18. Preparing for your college review Transforming lives through learning Arriving at evaluations discussions with learnersdiscussions with learners and other stakeholders discussions with staff and managers observations of learning and teaching review essential documentation such as learning and teaching packs, internal review or self-evaluation reports, achievement information, including PI data

19. Preparing for your college review Transforming lives through learning Discussion of findings Friday – MI, one colleague and STM: student president.discussion of findings with Principal, SMT and student president.

20. Preparing for your college review Transforming lives through learning From draft to final report summary evaluations two weeks after external review draft report sent, accuracy check meeting, Principal and Chair/Regional Lead publication of report on the Education Scotland website learners’ version of the reportdevelopment of a learners’ version of the report

21. Preparing for your college review Transforming lives through learning What will the report say? Overarching statement of effectiveness; Effective Limited effectiveness Not effective Plus supporting statements to provide detail

22. Preparing for your college review Transforming lives through learning After the external review College prepares action plan SFC determines whether follow-up required College HMI visits college and monitors progress on Main Points for Action and areas for development Within a year – college BoM publishes response Annual engagement process by Education ScotlandAnnual engagement process by Education Scotland

23. Preparing for your college review Transforming lives through learning What will the report say? Overarching statement of effectiveness; Effective Limited effectiveness Not effective Plus supporting statements to provide detail

24. Preparing for your college review Transforming lives through learning the principle of student engagement implies … that colleges … support the development of students as co-creators of their learning who take responsibility for their own learning … and … are involved in decision-making about their curricula, teaching and learning, and all aspects of the student experience. - ‘Final report of the Scottish Funding Council’s Joint Quality Review Group’, 2008

25. Preparing for your college review Transforming lives through learning Quality improvement and enhancement beyond the review … Learners Reviewers (HMIs, AAs and STMs) Co-creators of learning Co-evaluators of the learner experience Staff Co-evaluators of the learner experience

26. Preparing for your college review Transforming lives through learning Annual engagement visits

27. Preparing for your college review Transforming lives through learning Any questions? MargaretRose.Livingstone@educationscotland.gsi.gov.uk

28. Preparing for your college review Transforming lives through learning Education Scotland Denholm House Almondvale Business Park Almondvale Way Livingston EH54 6GA T +44 (0)141 282 5000 E enquiries@educationscotland.gov.uk www.educationscotland.gov.uk

29. @sparqs_Scotland #sparqsColReview The Learner Engagement Questionnaire

30. @sparqs_scotland #sparqsColReview Learner Engagement Questionnaire Aim: To become familiar with the Learner Engagement Questionnaire. By the end of this session you will; – Understand the purpose of the Learner Engagement Questionnaire – Be familiar with the content of the Learner Engagement Questionnaire – Have begun to develop questions that will help you answer the Learner Engagement Questionnaire.

31. @sparqs_scotland #sparqsColReview Important things to remember Need to say how you’ve consulted and how many with. Need to ensure that you engage with a range of the student body. Need to generalise feedback. Learner voice needs to be central throughout. Use the prompts that are outlined in the Learner Engagement Questionnaire.

32. @sparqs_scotland #sparqsColReview Activity: Learner Engagement Questionnaire In small groups: Look at the example response and think about its strengths and weaknesses? What would you change or do differently?

33. @sparqs_scotland #sparqsColReview Remember! “The Questionnaire aims to capture and reflect the collective views of the whole student body across the college” – so the feedback gathered by your students’ association should be representative and balanced Feedback that is perceived as being representative and balanced is more likely to lead to change and enhancement, which is the reason we have the review!

34. @sparqs_scotland #sparqsColReview Gathering Student Responses In this session we will discuss the most effective ways to gather student feedback for the Learner Engagement Questionnaire.

35. @sparqs_scotland #sparqsColReview Consultation tools In small groups: Select 2-3 examples of consultation and list the pros and cons of each. Consider how different students can be engaged via different methods. What would work best at your college?

36. @sparqs_scotland #sparqsColReview Surveys Pros: Easy to collate or transcribe data Can reach lots of students at once Depersonalised Cons: Data will not be ‘rich’ We already get so many surveys Can be a lot of work to administer

37. @sparqs_scotland #sparqsColReview Focus Groups Pros: Interviewer can interact and ask follow-up questions Data is very rich and contextualised Quicker than interviewing people separately Cons: Small groups make it hard to be representative They can definitely go off topic Slower than a big survey!

38. @sparqs_scotland #sparqsColReview Student Interviews Pros: Extremely rich, detailed feedback Can ask questions that might get a different response in group settings Easier to explain the purpose and context of the engagement Cons: Not representative Harder to get balanced feedback Time consuming

39. @sparqs_scotland #sparqsColReview Asking questions In small groups: Go through the sample LEQ and come up with questions that are specific to your college and can be used for your response. (use the worksheet on pages 6 & 7) Think about what methods would you would use. – Would you utilise other sources?

40. @sparqs_scotland #sparqsColReview Using existing data Internal college survey data (Learner satisfaction surveys/pre-exist survey) Course rep feedback Staff/student liaison committee reports/minutes Outcomes of students’ association campaigns Annual Engagement Reports Previous Education Scotland review reports

41. @sparqs_scotland #sparqsColReview Hints and tips Use methods that you feel comfortable with. Ensure you triangulate the data. Use methods which are suitable for your student body. Use at least two different methods. Make sure you have enough time to carry out consultation. Don’t do it on your own – utilise students and staff to help gather opinion.

42. @sparqs_scotland #sparqsColReview Remember… It is important to consult across the college. To leave adequate time for each stage of the research. There is no right or wrong way to collate responses. To keep feedback accurate, balanced, constructive and depersonalised. To get help from the student body or support staff. The Student Team Member is available for guidance.

43. @sparqs_scotland #sparqsColReview Planning for your review This final session will help you plan how best to get the most out of the review and the additional resources you should draw on to do this.

44. @sparqs_scotland #sparqsColReview Consultation Toolkit Aim: what do you want to find out and why? Target population: who do you want to consult with and why? Methods & approaches: what tools are you going to use and how? Partners: who would you involve? Timescales: what do you need to do and by when?

45. @sparqs_scotland #sparqsColReview Activity: timescales On your own: Make notes within the consultation toolkit to assist you in planning for your review. – What methods will you use? – What information can you already utilise? – Who will you inform? – How long will you need for each aspect?

46. @sparqs_scotland #sparqsColReview Planning for your review Find out when the review is taking place. Meet with others involved in the review. Find out who the Student Team Member is. Consider the challenges at the start. Familiarise yourself with the LEQ. Ensure methods are relevant to the student body. Utilise other students and staff members. Utilise methods already being used. LET STUDENTS KNOW IT’S HAPPENING!

47. @sparqs_scotland #sparqsColReview Utilising the outcomes What do you want to get out of the review? What will be the most important outcomes for learners? How will you use the results to make positive change within the college? Who will you share the outcomes of the review with?

48. @sparqs_scotland #sparqsColReview Thank you! Hannah.Clarke@sparqs.ac.uk David.scott@sparqs.ac.uk Simon.Varwell@sparqs.ac.uk Simon.jones@sparqs.ac.uk

49. @sparqs_scotland #sparqsColReview 2015-16Reviewsparqs contact Newbattle Collegew/b 9-Nov-15Simon Jones Perth Collegew/b 23-Nov-15Simon Varwell City of Glasgoww/b 11-Jan16David Scott West Lothianw/b 25-Jan-16Simon Jones Dumfries & Gallowayw/b 8-Feb-16Simon Jones North Highlandw/b 22-Feb-16Simon Varwell Invernessw/b 7-Mar-16Simon Varwell Forth Valleyw/b 14-Mar-16Simon Jones