Evaluation Matt Shreeve 29 July 2009 Relationship Management Programme Meeting
CC394P003 – 0.1 / Slide 2 What is evaluation? Collecting evidence… Reporting success… Doing research… Reflection… Identifying lessons… Confirming benefits… Specific to your project and its success
CC394P003 – 0.1 / Slide 3 Why evaluate? Your funding agreement tells you to! Improve your chances of success Reporting becomes easier Sell your achievements to your institution Learn from your experiences Funders like it
CC394P003 – 0.1 / Slide 4 Evaluation at many levels Project and programme-level Formative, summative, etc
CC394P003 – 0.1 / Slide 5 A note on “failure”… Projects might not meet their original aims… … but new learning or lessons is always a success
CC394P003 – 0.1 / Slide 6 Project self-evaluation Projects conduct their own self-evaluation You are responsible for this! Evaluation plan in project plan Final report Completion report Advice and support is available from Paul and team You can ask me too!
CC394P003 – 0.1 / Slide 7 Programme-level evaluation Evaluates the programme, not your projects Based on your information
CC394P003 – 0.1 / Slide 8 Programme-level evaluation timeline
CC394P003 – 0.1 / Slide 9 What do you need to do? For the programme-level evaluation Nothing yet! For your self-evaluations Refine your plans, get started and get feedback
CC394P003 – 0.1 / Slide 10 Where to get help Paul and his team Each other! Me JISC project management handbook Section 16 of the Project Management Guidelines Six Steps to Effective Evaluation
CC394P003 – 0.1 / Slide 11 The six steps 1.Identify stakeholders 2.Describe project and understand programme 3.Design evaluation 4.Gather evidence 5.Analyse results 6.Report findings
CC394P003 – 0.1 / Slide 12 The six steps take you through a process
Example: HYpothetical Project for Evaluative Reasoning (H.Y.P.E.R.) Outputs CRM process maps between Dept A and Dept B Plan for future cross-departmental CRM Case study Final and completion report Evaluation plan End of project debrief Peer review of outputs CC394P003 – 0.1 / Slide 13
H.Y.P.E.R. (2) Actual desired outcomes Close collaboration between Depts A and B “Business” culture to better exploit partnering opportunities Evaluation plan Question: Are Depts A and B ready to work more closely together? Methods: Interviews and focus groups Timing: Start, middle and end Additional benefits Staff engagement in overall progress Improved understanding at start Progress check halfway through Can easily report at end CC394P001 – 0.1 / Slide 14
CC394P003 – 0.1 / Slide 15 Top tips Refine but don’t perfect your plan Try to be self-critical Flag up "issues“ Private channels if necessary Be descriptive and prepare to reason why
CC394P003 – 0.1 / Slide 16 More top tips Talk to others Sharing benefits you all Accumulate evidence as you go Use your blog postings
CC394P003 – 0.1 / Slide 17 Key messages Consider what project success means to you Understand how you will know you’ve achieved success Be assured in the above
CC394P003 – 0.1 / Slide 18 Thank you for listening… Contact me or In confidence, if necessary