LEAGUE TABLES AND NEW KPIs VC’s OPEN MEETING Anita Wright Head of Planning November 2013

League Tables and Rankings Why are League Tables Important? League Tables are here to stay New Tables e.g. Which?, Unistats Increasing evidence that they inform choice Students and parents Staff (to a lesser extent) Reputational Impact More significant in a competitive market Student recruitment Research grants Partnership activity

University of Liverpool Headlines The Good News University of Liverpool is in the top 1% of International Universities The Bad News Ranking deteriorated in 2013 compared to 2012

League Table Performance How are we doing? Performance in many metrics remains generally stable Continue to see a drop in rankings Failing to keep pace with other HEIs Context RAE results are fixed until REF 2014 published Research assessment highly weighted (1.5 times) REF performance is critical Need to gain in other measures (e.g. SSR, Spend) to improve our rank

Performance - Strengths Where do we do well? Staff Student Ratio Top 10 in the sector but downward trend Staff Student Ratio Top 10 in the sector but downward trend Academic Services Spend Top 10 in the sector Academic Services Spend Top 10 in the sector Completion Rate Stable performance, predicted, fluctuation Completion Rate Stable performance, predicted, fluctuation Entry Tariff Improved performance, only maintained rank Quality vs student numbers Entry Tariff Improved performance, only maintained rank Quality vs student numbers

Performance - Weaknesses Where do we do less well? Good Honours Relatively stable, losing position Good Honours Relatively stable, losing position Student Satisfaction Overall improvement, primary indicator, maximum weighting Student Satisfaction Overall improvement, primary indicator, maximum weighting Graduate Prospects Local students, less graduate opportunities Graduate Prospects Local students, less graduate opportunities Facilities Spend Improving, poor rank Facilities Spend Improving, poor rank Reputational Surveys Difficult to influence? Reputational Surveys Difficult to influence?

University of Liverpool Performance – THE World University Rankings

University of Liverpool What can you do? Subject Performance Performance in individual subject areas critical Measures in overall league tables are adjusted for subject mix Overall University score depends on performance in each subject table Understand performance in your area and which measures need improving Outstanding Areas Areas for Improvement

KEY PERFORMANCE INDICATORS Why do we need them? The Right KPIs are critical Linked to our Strategic Plan Define and evaluate success against progress with strategic aims Broader context than what's in the league tables only Essential to understanding our current position, where we sit against our competitors and predict future performance to inform our Plans Facilitate performance improvement and progress against agreed Strategic Vision and direction Make adjustments or take corrective action where necessary through effective monitoring and reporting

New KPIs – Framework Link to Strategy and Vision Vision Purpose and Vision Core Values Brand Strategy Strategy to Achieve our Vision Key Priorities Priorities KPIs Cross-cutting

New KPIs – Agreed Approach Including Other Supporting Measures KPIs Strategic and in line with Priorities and Vision Small Number (i.e. 6-10) SPIs More detailed measures in support of KPIs Specific SPIs for Strategic Committees and Planning Units MI Detailed MI in support of activity and performance monitoring by Schools/Institutes

Agreed KPIs and SPIs Research and KE KPIs Research Quality and Impact Citations/Publications PGR Students Innovation SPIs Applications, Awards, Success Rates ‘Prestigious’ Projects (e.g. Fellowships) Income Large Grants

Agreed KPIs and SPIs Student Experience KPIs Degrees Awarded Employability/Destinations Satisfaction (L&T and services) Diversity SPIs Contact Time and Quality League Table metrics (e.g. SSR, Spend) Applications and Conversions Progression/Retention

Agreed KPIs and SPIs Widening Participation KPIs As Student Experience SPIs HEFCE Benchmarks Access Agreement Value Added

Agreed KPIs and SPIs Enablers KPIs Financial Health and Sustainability Staff Satisfaction SPIs Staff (retention, progression, diversity) Condition of the Estate and Space Utilisation Alumni and Fundraising Activity

KPIs and SPIs Reporting Framework – Dashboard Examples MI Dashboards and Explorer for KPIs and SPIs to support analysis Performance against Target Comparator Performance Trend over Time Drill down capability

KPIs and SPIs Reporting Framework – R&KE Example MISPIKPI Research Quality % 3* and 4* outputs Eligible Staff Research Grants Awarded ApplicationsSuccess Rates Source of Funds Prestigious Projects FellowshipsLarge Grants

Next Steps Current Development Areas Define and Specify KPIs and SPIs Link between KPIs, SPIs and MI – Three Tier Approach Report through dashboards and explorer Defined reporting calendar/timeline Develop Operational MI Validate by modelling historical data Agree Targets/Milestones Actual value vs. RG position Challenging but Realistic Identify appropriate National and International benchmarks Integrate in to PPC and Quarterly Performance Reports

Where Next? Overall Vision and Strategy Move from MI to BI…. MI is used to: Inform decisions Define strategy Change behaviour Leading to improved performance……. More to follow ……your help in assessing our ‘BI Maturity’

Questions