Stop and Measure the Roses AGCAS Heads of Service Conference 7 January 2009 Aminder K Nijjar

Introduction How UK university CSs measure their effectiveness & success HECSU funding PROP University of Leicester & personal time Independent Today 1. Rationale 2. Overview findings 3. Recommendations 4. Seek your expertise phase 2 image taken from photobucket.com

Curiosity

image taken from photobucket.com Perceptions

image taken from photobucket.com Surveys – DLHE, League Tables et al

image taken from photobucket.com

Agendas (Watts & Butcher 2008) Employer Engagement EnterpriseEmployability PDP

image taken from photobucket.com Research Aims 1. KPIs currently used 2. Expectations of senior managers 3. Need for measurable outcomes 4. CSs conceptualisation of effectiveness & success More reporting than critical analysis

Methodology 20 UK universities  Location  Size UG FT  Type New, 1994 Group, Russell Group‏ One - to - one semi - structured interviews 20 HoS‏ 3 senior managers HoS report 2 UK graduate recruitment & training organisations 1 US university HoS May – Nov 08 image taken from photobucket.com

Findings – DLHE Mixed feelings Institution - wide responsibility Collect, report, recommend, improve Central Default Affected activities top 100 grad rec Proactive engagement – Improved perception – Leverage image taken from photobucket.com

Activity Volumes – GUESS High 11+Medium 5-10Low - less than 5 1. Students on placements ( volunteer / overseas / work experience ) 2. Career development programmes in academic schools 3. Student waiting times 4. Student type ( subject, year, nationality, ethnicity, gender … ) 5. New initiative proposals 6. Successful proposals with funding 7. Careers fairs 8. Vacancies

image taken from photobucket.com Answers High 11+ Medium 5-10 Low - less than 5 1. Students on placements ( volunteer / overseas / work experience ) – MEDIUM 2. Career development programmes in academic schools – HIGH 3. Student waiting times – MEDIUM 4. Student type (subject, year, nationality, ethnicity, gender … ) – LOW 5. New initiative proposals – LOW 6. Successful proposals with funding – LOW 7. Careers fairs – HIGH 8. Vacancies – HIGH Busyness ---- Competitive advantage ---- Relevant ---- Popular

image taken from photobucket.com Feedback & satisfaction High Quality Feel-good factor CS staff High Annual planning Training Low Views Other Methods Income generationInnovation Low Self-funding Targets Medium New Bids Awards High: 11+ Medium: 5-10 Low: below 5

image taken from photobucket.com Other Methods Quality High Review Benchmarking Matrix Surveys High ISB NSS Low AGR Profile High Events Reputation Low Publicity Relationships - schools High Curric devpt Low Real life activity High: 11+ Medium: 5-10 Low: below 5

image taken from photobucket.com Issues & Challenges Measurement Evidence - impact, fit for purpose Inputs & processes - outputs & outcomes Formal targets Accountability / autonomy / responsibility Resource limitations IT, time Competing expectations Public policy, stakeholders, satisfaction Ownership of employability Academic depts, students Senior management role Planning, competition, vision, HoS Stats, anecdotes, visibility Nature of students Background, grades, motivation CS perception Undersell, brand

image taken from photobucket.com Ways Forward Information Student data collection & analysis Job applications & success rates by university Research Benchmarking Institutional factors accountability, expectations Performance mgt & measurement Support In / formal support network Stronger QAA employability & C Ed steer audits & reviews Training “ Leadership development” “Dealing with big egos” “How league tables work” Recruiters’ Perspective Business-like Relationships outweigh rankings A US Perspective Clear mission ‘Ease’ with DLHE Learner outcomes Demonstrating impact TechnologyAGCAS

image taken from photobucket.com Conclusions Understanding & interest More measurable outcomes Incorporated Relationships Confidence & assertiveness Mgt info & skilled staff Question & define purpose Evidence value Open communication Successful strategies

image taken from photobucket.com Recommendations 1. Consider necessity of demonstrating rate of return 2. Develop KPI tools, techniques & frameworks for CSs (phase 2) 3. Work collaboratively ( institution & national ) to understand & agree KPI definitions 4. Encourage evidence based / practitioner research & share findings 5. Conduct research into international context & senior managers’ expectations 6. Collate & place in shared space reports & research articles 7. Address KPIs & related topics nationally 8. Further develop networking & benchmarking groups 9. Develop specialist training to support HoS 10. Proactively work with institutional PIs ( DLHE, NSS, IBS ) 11. Include CSs in university strategic planning & development 12. Develop effective data collection & analysis methods

Your Comments & Reflections ? image taken from photobucket.com

Activity – phase 2 In pairs please: 1.Identify a possible outcome ( impact / effect / improvement / benefit / change ) for an activity ( e.g. careers fair, vacancy, workshop ) How could this be measured ? How could this be observed ? 2.What impact ( effect / improvement / benefit / change ) do you want your Careers Service to have? What activities contribute ? How does it ( do they ) contribute ?

What Next? Stage 2 Identify KPI tools, techniques, frameworks for university CSs Jan – Dec 09 International perspective Australia, New Zealand, USA Other professions note & leave behind Results spring 2010 Your Expertise Read report & provide feedback consideration Contribute to stage 2 info, resources, contacts … London participant Leave your business card / contact details / Aminder: …

– Research Reports available next week OR can be sent to you THANK YOU