1 © Ipsos MORI Canolfan Cymraeg i Oedolion De- orllewin Cymru / Welsh for Adults Centre South West Wales Responses to the Learner Voice Wales survey 2013: Learners in Welsh for Adults centres April 2013

2 © Ipsos MORI Contents Click on the hyperlinks to navigate the report Background and methodologySlide 3 Sample profile………………...Slide Slide 9 Provider summary……………Slide 12 Level of study summary…….Slide 18 Topic summary………………..Slide 2Slide 21 Appendix – demographics…...Slide 27

3 © Ipsos MORI Background and methodology

4 © Ipsos MORI Background What is the Learner Voice Wales survey? A 10 minute survey for learners enrolled in further education, work-based learning, adult community learning and Welsh for Adults centres across Wales. Commissioned by Department for Education and Skills (DfES), it forms part of the 'Responsiveness' element of the Quality and Effectiveness Framework. The survey will establish a consistent set of 'core' questions, enabling benchmarking of learner satisfaction. Learners have the opportunity to give their views on: the information, advice and support provided to them; provider responsiveness, learning environment and student well-being; the quality of teaching and training; and overall satisfaction. Results will help providers create a better experience for their learners by seeing how they compare to other providers in their sector. It will also assist the Welsh Government in monitoring quality of provision; moreover, it will replace the learner surveys carried out by Estyn prior to inspection.

5 © Ipsos MORI Methodology - 1 How was the data in this report collected? Fieldwork was conducted between 14 January and 23 February The survey was available in English and Welsh, and in paper-format or online. Questions were designed in consultation with providers and cognitively tested with learners. Questions were tailored for the different learning context in FE, WBL, ACL and WfA. Learners were asked to specify their age, gender, ethnicity, and course level. A separate Excel file of learner verbatim responses (from the open questions at the end of the survey) has also been provided alongside the PowerPoint reports. An online reportal will be available in May 2013 with full access to subgroup, and course level data.

6 © Ipsos MORI Who is included in this report? This report provides the results for all your WfA responses. This report provides data at the centre level; where applicable, a breakdown by provider will be available in the online reportal. How many took part? In total, 53,918 learners took part across Wales – 1,815 within the WfA sector. We received a total of 415 responses for your centre (200 online and 215 paper). Methodology - 2

7 © Ipsos MORI Using the report - 1 How should I interpret the report? Refer to ‘Report Guidance’ section for more information on how to read the charts presented in this report. Refer to ‘Sample profile’ to see how the profile of learners who have taken part compares with your learner population overall. The Provider Summary gives an overview of the survey findings. This is followed by a summary of performance by Level of study and for specific topics. The appendix gives detailed breakdown of responses for each question by key demographics, including age, gender, ethnicity and Level of Study. The Provider Summary should be used to give you an indication of areas of particular strength or weakness, which can then be examined further in later slides. We would suggest that if you are using these slides in your own presentations, you should include the Provider Summary, plus more detailed slides that show areas of strength or weakness for your centre. Composite scores have been created for each of the five main survey themes, based on an average of ‘very good’ response to all the questions within that theme. Composite scores are a useful starting point but it is important to analyse the findings for specific questions as well, including the spread of responses from ‘very good’ – ‘very poor’.

8 © Ipsos MORI Using the report - 2 Notes Note that the data has not been weighted to match your learner population. Where percentages do not sum to 100% this is due to rounding. The ‘base size’ is the total number of learners answering each question. This may be less than the total learners taking part due to some learners not answering a question. Sub-group base sizes of below 10 should be treated as indicative only. Those below 5 have been suppressed to protect learner confidentiality. RAGing of the percentage responses ‘very good’ is for illustrative purposes only. A red cell/circle illustrates a score of greater than 5 percentage points below average; a green cell/circle illustrates a score of greater than 5 percentage points above average. It should be noted that learners submitting paper responses were more positive about their experience than those submitting responses online, most notably in the proportion answering ‘very good’. This difference may be explained by a number of valid reasons (for example the profile of learners submitting paper responses); nonetheless, further work to explore the existence of any mode effect will take place in year 2 of the survey.

9 © Ipsos MORI Sample profile

10 © Ipsos MORI Sample profile – used for weighting This table shows how the profile of those submitting responses to the survey compares to your overall learner population as of January Your results to the Learner Voice Wales survey have not been weighted, please note a slight variation in the proportion of learners identified as ‘advanced’, ‘proficiency’ or ‘other’. *Some learners may have chosen not to specify their age or gender. **Some learners may have chosen not to specify their course level. Learner Groups Number of complete responses % of survey responses% of your learner profile as of Jan 2013 Gender Male152 37%32% Female256 62%68% Learners that could not be allocated a gender*7 2%n/a Age Aged under 25 years14 3%6% year olds118 28%35% year olds176 42%48% %19% Learners that could not be allocated an age*92%n/a Course level Entry level13833%35% Foundation level9824%17% Intermediate Level8220%13% Advanced/Proficiency/Other Level64 15% 36% Learners that could not be allocated a course level** 338%n/a

11 © Ipsos MORI Subgroup base sizes Level of studyBase size Entry level 138 Foundation level 98 Intermediate level 82 Advanced level 54 Proficiency level 6 Other level Below 5 The tables below outline the base sizes achieved for your centre across key sub groups. These categories match those used to break down question responses later in this report. Where a base size falls below 10, this has been highlighted in red. Results for such subgroups should be treated with caution and seen as indicative only. Those below 5 have been suppressed in the report to maintain learner confidentiality. Key demographicsBase size Male 152 Female 256 Under White 393 Ethnic minority 17 LLDD 20

12 © Ipsos MORI Provider summary

13 © Ipsos MORI 13 53% very good Q8. Could you now rate your provider overall? (Base: 409) Q9. Is this course what you expected it to be? (Base: 411) 92% better than / as expected Provider result WfA sector benchmark Overall rating and expectations of course Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd 2013.

14 © Ipsos MORI 14 Information and Advice Teaching and Training 29% say the information and advice they get is ‘very good’. This is in line with the sector average of 30%. A further 36% say it is ‘good’. Responsiveness Health and Wellbeing Help and Support Provider summary – key themes 36% say the help and support they receive is ‘very good’. This is in line with the sector average of 38%. A further 26% say it is ‘good’ 38% say that the college is ‘very good’ at ensuring you feel safe. This is lower than the sector average of 44%. A further 22% say it is ‘good’ 44% say that the responsiveness to learners is ‘very good’. This includes things such as respect from staff, listening and acting on learner views. This is in line with the sector average of 49%. A further 23% say it is ‘good’ 67% report that the teaching and training they receive is ‘very good’. This is in line with the sector average of 68%. A further 23% say it is ‘good’ % giving a score of ‘very good’ (followed by % giving a score of ‘good’) Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 415. Base size for individual questions can be found in the appendix.

15 © Ipsos MORI Provider summary – question by question Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 415. Base size for individual questions can be found in the appendix. * Health and wellbeing % giving a score of ‘very good’ InfoSupportResponsiveH*Teaching and Training Your score

16 © Ipsos MORI % ‘very good’ WfA benchmark 5356 Overall rating – by key demographics Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 409. Base size for individual subgroups can be found on slide 11. Q8. Could you now rate your college overall? Key demographics % very good WfA benchmark % ‘very good’ WfA benchmark Level of study

17 © Ipsos MORI % ‘better than / about what’ WfA benchmark 9294 Expectations of course – by key demographics Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 411. Base size for individual subgroups can be found on slide 11. Q9. Is this course what you expected it to be? Key demographics %’better than / about what’ WfA benchmark % ‘better than / about what’ WfA benchmark Level of study

18 © Ipsos MORI Level of study summary Of composite scores and the teaching and learning question set. A further breakdown by Level of study can be found for each question in the appendix. RAGing is presented on internal benchmarks against the overall score for your centre.

19 © Ipsos MORI Provider summary – by Level of study Q8. Overall rating Information and Advice SupportResponsive- ness Health and Wellbeing Teaching and training Your score overall % ‘very good’ 53%29%36%44% 38 % 67% Entry level 51%24%35%44%38%71% Foundation level 55%21%31%42% 67% Intermediate level 54%31%33%39%31%64% Advanced level 64%47%51%56%50%68% Proficiency level 33% 17%50%33%56% Other level Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 415. Base size for individual subgroups can be found on slide 11. Overall rating and composite scores for key themes

20 © Ipsos MORI Level of study summary – teaching and learning Q6a (Talking about learning aims); Q6b (Explaining the work you have to do); Q6c (Listening to you); Q6d (Giving you feedback); Q6e (Making sure others don’t disturb your work); Q6f (Treating you fairly and with respect); Q6g (Making good use of your time); Q6h (Delivering the course in a way that keeps you interested) Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 415. Base size for individual subgroups can be found on slide 11. Q6a.Q6b.Q6c.Q6d.Q6e.Q6f.Q6g.Q6h. Your score overall % ‘very good’ 54%71%68%65%56%81%74%71% Entry level 60%75%73%72%56%84%77%76% Foundation level 54%69%68%65%56%83%74%66% Intermediate level 48%70%64%60%54%78%73%68% Advanced level 57%67%63%64%63%81%74% Proficiency level 50% 95%67% Other level

21 © Ipsos MORI Topic summaries

22 © Ipsos MORI Benchmark % ‘very good’ Your score WfAACLFEWBL All provi ders Results summary – Information and advice (412) (409) Please rate each of the following... Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 415. Base size for individual questions shown in brackets. For ease of reading, figures below 2% are not shown on the chart.

23 © Ipsos MORI Benchmark % ‘very good’ Your score WfAACLFEWBL All provi ders Results summary - Support (411) (412) (407) (408) (411) (409) Q3a Help settling in Q3b Informing where to go for support Q3c Providing specific help and support Q3d Providing extra learning support Q3e Ensuring right equipment Q3f Providing support for personal issues Q3. How would you rate your provider for each of the following... Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 415. Base size for individual questions shown in brackets. For ease of reading, figures below 2% are not shown on the chart.

24 © Ipsos MORI Benchmark % ‘very good’ Your score WfAACLFEWBL All provi ders Results summary - Responsiveness (411) (407) (405) Q4. Please rate your provider for each of the following...? Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 415. Base size for individual questions shown in brackets. For ease of reading, figures below 2% are not shown on the chart.

25 © Ipsos MORI Benchmark % ‘very good’ Your score WfAACLFEWBL All provi ders Results summary – Health and Wellbeing (412) Q5. How do you rate your provider for the following... Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 415. Base size for individual questions shown in brackets. For ease of reading, figures below 2% are not shown on the chart.

26 © Ipsos MORI Benchmark % ‘very good’ Your score WfAACLFEWBL All provi ders N/A53 Results summary – Teaching and Training (415) (413) (412) (409) (413) (409) Q6. How would you rate your teachers and tutors at each of the following...? Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 415. Base size for individual questions shown in brackets. For ease of reading, figures below 2% are not shown on the chart.

27 © Ipsos MORI Appendix Results breakdown by key demographics for questions 1-6

28 © Ipsos MORI % ‘very good’ WfA benchmark 3336 Question 1 – Information when choosing course Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 412. Base size for individual subgroups can be found on slide 11. Q1. Please rate the information given by your provider when you were choosing your course, was it…? Key demographics % very good WfA benchmark % ‘very good’ WfA benchmark Level of study

29 © Ipsos MORI % ‘very good’ WfA benchmark 25 Question 2 – Information and advice on future options Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 409. Base size for individual subgroups can be found on slide 11. Q2. Please rate the information offered by your provider about options once you have completed your course, was it…? Key demographics % very good WfA benchmark % ‘very good’ WfA benchmark Level of study

30 © Ipsos MORI % ‘very good’ WfA benchmark 5257 Question 3a – Help settling in Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 411. Base size for individual subgroups can be found on slide 11. Q3a. How would you rate your provider for … Helping you settle into your course? Key demographics % very good WfA benchmark % ‘very good’ WfA benchmark Level of study

31 © Ipsos MORI % ‘very good’ WfA benchmark 4041 Question 3b – Information on support Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 412. Base size for individual subgroups can be found on slide 11. Q3b. How would you rate your provider for… Informing you of where to go for support, within and outside your provider? Key demographics % very good WfA benchmark % ‘very good’ WfA benchmark Level of study

32 © Ipsos MORI % ‘very good’ WfA benchmark 4346 Question 3c – Course-related help and support Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 407. Base size for individual subgroups can be found on slide 11. Q3c. How would you rate your provider for… Providing specific help and support with issues related to your course? Key demographics % very good WfA benchmark % ‘very good’ WfA benchmark Level of study

33 © Ipsos MORI % ‘very good’ WfA benchmark 2122 Question 3d – Extra learning support Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 408. Base size for individual subgroups can be found on slide 11. Q3d. How would you rate your provider for… Providing extra learning support services such as reading, writing or maths? Key demographics % very good WfA benchmark % ‘very good’ WfA benchmark Level of study

34 © Ipsos MORI % ‘very good’ WfA benchmark 4447 Question 3e – Equipment and materials Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 411. Base size for individual subgroups can be found on slide 11. Q3e. How would you rate your provider for… Making sure you have the right equipment and materials for your course? Key demographics % very good WfA benchmark % ‘very good’ WfA benchmark Level of study

35 © Ipsos MORI % ‘very good’ WfA benchmark 1719 Question 3f – Support for personal issues Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 409. Base size for individual subgroups can be found on slide 11. Q3f. How would you rate your provider for… Providing support for personal issues that help you stay on your course, for example finance, childcare, transport and health issues? Key demographics % very good WfA benchmark % ‘very good’ WfA benchmark Level of study

36 © Ipsos MORI % ‘very good’ WfA benchmark 7883 Question 4a – Respect shown by staff Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 411. Base size for individual subgroups can be found on slide 11. Q4a. Please rate your provider for… The respect shown to you by all staff within the provider (your teacher or tutor and any other s you have talked to)? Key demographics % very good WfA benchmark % ‘very good’ WfA benchmark Level of study

37 © Ipsos MORI % ‘very good’ WfA benchmark 3543 Question 4b – Giving views about the college Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 407. Base size for individual subgroups can be found on slide 11. Q4b. Please rate your provider for... Asking you to give your views about the provider, for example surveys or questionnaires? Key demographics % very good WfA benchmark % ‘very good’ WfA benchmark Level of study

38 © Ipsos MORI % ‘very good’ WfA benchmark 2024 Question 4c – Feedback after views given Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 405. Base size for individual subgroups can be found on slide 11. Q4c. Please rate your provider for… Telling you what has happened as a result of the views given? Key demographics % very good WfA benchmark % ‘very good’ WfA benchmark Level of study

39 © Ipsos MORI % ‘very good’ WfA benchmark 3844 Question 5a – Ensuring you feel safe Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 412. Base size for individual subgroups can be found on slide 11. Q5a. How do you rate your provider for… Making sure you feel safe whilst on your course? Key demographics % very good WfA benchmark % ‘very good’ WfA benchmark Level of study

40 © Ipsos MORI % ‘very good’ WfA benchmark 5458 Question 6a – Talking about learning aims Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 415. Base size for individual subgroups can be found on slide 11. Q6a. Please rate your teachers and tutors at…Talking about your learning aims? Key demographics % very good WfA benchmark % ‘very good’ WfA benchmark Level of study

41 © Ipsos MORI % ‘very good’ WfA benchmark 71 Question 6b – Explaining work Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 415. Base size for individual subgroups can be found on slide 11. Q6b. Please rate your teachers and tutors at... Explaining the work you have to do? Key demographics % very good WfA benchmark % ‘very good’ WfA benchmark Level of study

42 © Ipsos MORI % ‘very good’ WfA benchmark 6869 Question 6c – Listening to you Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 413. Base size for individual subgroups can be found on slide 11. Q6c. Please rate your teachers and tutors at... Listening to you and what you need to help you learn? Key demographics % very good WfA benchmark % ‘very good’ WfA benchmark Level of study

43 © Ipsos MORI % ‘very good’ WfA benchmark 65 Question 6d – Giving feedback on how to improve Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 412. Base size for individual subgroups can be found on slide 11. Q6d. Please rate your teachers and tutors at... Giving you feedback on how to improve? Key demographics % very good WfA benchmark % ‘very good’ WfA benchmark Level of study

44 © Ipsos MORI % ‘very good’ WfA benchmark 5655 Question 6e – Ensuring work not disturbed Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 409. Base size for individual subgroups can be found on slide 11. Q6e. Please rate your teachers and tutors at... Making sure other learners do not disturb your work? Key demographics % very good WfA benchmark % ‘very good’ WfA benchmark Level of study

45 © Ipsos MORI % ‘very good’ WfA benchmark 8184 Question 6f – Treating you fairly and with respect Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 413. Base size for individual subgroups can be found on slide 11. Q6f. Please rate your teachers and tutors at... Treating you fairly and with respect? Key demographics % very good WfA benchmark % ‘very good’ WfA benchmark Level of study

46 © Ipsos MORI % ‘very good’ WfA benchmark 7476 Question 6g – Making good use of your time Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 413. Base size for individual subgroups can be found on slide 11. Q6g. Please rate your teachers and tutors at... Making good use of your time including starting and finishing classes on time? Key demographics % very good WfA benchmark % ‘very good’ WfA benchmark Level of study

47 © Ipsos MORI % ‘very good’ WfA benchmark 7174 Question 6h – Keeping you interested Learner Voice Wales Survey Fieldwork conducted Jan 14 th – Feb 23 rd Total base size: 409. Base size for individual subgroups can be found on slide 11. Q6h. Please rate your teachers and tutors at... Delivering the course in a way that keeps you interested? Key demographics % very good WfA benchmark % ‘very good’ WfA benchmark Level of study

48 © Ipsos MORI Report guidance

49 © Ipsos MORI Interpreting topic summary slides Use this slide to give you a sense of how your centre is performing within a specific topic of learner voice. Here the full break down of responses from ‘very good’ to ‘very poor’ can be seen for each question asked in the survey. These figures represent the base size: ie the total number of learners who have given an answer. It may be that some of those completing a paper questionnaire have left this question blank. This table shows you how your % ‘very good’ compares to sector averages and the national average across Wales The figures have been ‘RAGed’ against the average in your sector.

50 © Ipsos MORI Interpreting demographic breakdown slides This chart provides a breakdown of % ‘very good’ responses by Level of study and compares it to the average in your sector.. This chart provides a breakdown of % ‘very good’ for several key demographics. The sector benchmark for each of these learner groups is also presented. Use this slide to see how individual questions break down by key learner subgroups. The top part of the slide replicates the information shown in the topic summary, showing the full range of responses and comparing the % ‘very good’ to the sector benchmark. Note that the base sizes for the demographic subgroups can be found on slide 11.

51 © Ipsos MORI Thank you © Ipsos MORIThis work was carried out in accordance with the requirements of the international quality standard for market research, ISO 20252:2006 and with the Ipsos MORI Terms and Conditions which can be found herehere