Measures of Graduate Success Graduate outcomes, LEO and more

Who am I? @Nao_Oosman www.linkedin.com/in/naomioosmanwatts

Today An overview of some of the key data sets and the national picture What these changes mean for institutions What these changes mean for Careers Services The role of Information Teams Discussion, sharing , Q&A

The measures: DLHE LEO Graduate Outcomes Graduate Labour Market Survey What else? High Fliers, QS, etc

Recent Policy Changes TEF: Core metrics, split metrics and supplementary metrics Focus on Social Mobility Degree Apprenticeships, Two Year degrees: increased scrutiny on outcomes and VFM

DLHE – A fond farewell Just closed the last ever DLHE survey This data will be with us until 2020 at least A known entity with good understanding, engagement and trust across the sector Not perfect – a snapshot in time, not ideal for all disciplines

Graduate Outcomes – New kid on the block 15 months post graduation First survey population already graduated – details to be shared soon Outsourced from the institution – trust in the data set Still a lot of questions and uncertainty Change of working practices for many Careers Services

Graduate Outcomes – New kid on the block

LEO – The experiment Longitudinal Education Outcomes Data – released by the DfE in June 2017 Links HMRC PAYE Data to the student record to measure outcomes from degree courses by subject at 1, 3 and 5 years Will form part of the additional metrics for the next TEF New analysis released by DfE in March (not by institution) Currently there are still significant flaws in the data set: No regional weighting for salary No consideration for economic fluctuations or changes in the labour market Can be differentiated by gender but does not take into consideration the impact of gender to career progression All subjects/career trajectories in one ‘basket”

Graduate Labour Market Survey – The big picture Outcomes of graduates compared to non-graduates based on the Labour Force Survey Employment and earnings outcomes Uses Employment Rate and Highly Skilled Employment Rate (proportion of all grads rather than ‘employed grads’) Two populations: Working Age Population – all individuals domiciled in England aged 16-64. Young Population – all individuals domiciled in England aged 21-30. Whole of England – not specific by institution but does show region and can be analysed by specific characteristics.

And the rest League Tables KIS The press

Impact on institutions Increased focus on outcomes which means increased scrutiny on Careers and Employability provision More granular/bespoke data required A clearer understanding of rankings and reputation Careers Teams in the limelight: pros and cons

Impact on Careers Services Increased scrutiny meaning more reporting required Clear impact measures Teams need to understand the data and its caveats But we also need to be aware of our duty of care to students Sometimes – access to better resourcing, if leveraged

The role of Information Teams Understanding the limitations of the data Ensuring information is accurate and data is dealt with ethically to provide impartial information Curation Using the data to add a new dimension to information provided Early adopters Anything else?

How do you use data? What can you measure? What should you measure? What impact do different measures have? How would you like to use your data? Questions, issues and training needs

Graduate Outcomes A discussion

Discussion What are the pros and cons of Graduate Outcomes? Are you aware of any preparations for the new survey? What concerns have you got? Feedback on the new survey: positives, areas for improvement, areas of concern