1. www.efquel.org Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference 2013 14 th September 2013 – Ohrid, Macedonia

2. www.efquel.org What‘s in a Name? AuditExpert-Review ObjectiveSubjective Precise standardsBroad guidelines Verifies account of clientInterprets account of client Requires detailed knowledge of administrative procedures Requires detailed knowledge of the subject area concerned standards-based review

3. www.efquel.org Who is a peer? an expert in the field an expert in what field? e-learning! what is e-learning?

4. www.efquel.org Features of an Expert-Peer experience in course design and delivery familiar with best-practice comparative perspective sense of mission natural communicator

5. www.efquel.org A reviewer is a communicator University Agency Review Team

6. www.efquel.org Inter-subjectivity different subjective perceptions, taken from different viewpoints, give an objective view of reality the quality basis of an external review requires consensus consensus is not a diplomatic nicety but an essential pre-requisite of quality

7. www.efquel.org Learning from self-assessment

8. www.efquel.org There is no such thing as objective quality

9. www.efquel.org How to learn from self- assessment 1.Read the quality standard 2.Understand the quality standard 3.Ask Questions 4.DO NOT fill it in 5.Discuss it – with all stakeholders in the institution a.How do we meet the standard? b.What can we do better? c.Does it apply in all areas? 6.Discuss it some more – do some implementation 7.Have you internalised standard? 8.Now fill in the questionnaire

10. www.efquel.org A look at the Quality Cycle DoCheck PlanAct アク ション 計画 実行 チェッ ク CHECK should be read as STUDY in English Check implies ‚to hold back‘ (Deming, 1980)

11. www.efquel.org A Need to Prioritise DoCheck PlanAct アク ション 計画 実行 チェッ ク

12. www.efquel.org Be Honest „Most Quality Managers are Magicians“ Look Here don‘t look here!

13. www.efquel.org What will self-assessment produce A time to think, communicate and strategize A better understanding of institutional processes An overview of where we are and hopefully where we need to go A report

14. www.efquel.org Learning from peer-review

15. www.efquel.org The Show-Off The Politician The Grumpy The Bored Don’t be one of these people….

16. www.efquel.org How to approach a peer-review Understand the purpose of the review Understand your role in the review –Your impressions –Of your part in the instituion Be candid and informative Don’t try to hide things (you’ll be caught)

17. www.efquel.org Main result of peer-review an external evaluation of your institutional quality (procedures) a report a certificate

18. www.efquel.org Run the cycle again DoCheck PlanAct アク ション 計画 実行 チェッ ク

19. www.efquel.org Remember NO process is without errors There is ALWAYS room for improvement

20. www.efquel.org What to do with the report 1.Read the report 2.Understand the report 3.Ask Questions 4.Discuss it – with all stakeholders in the institution a.What did we miss in our Self-Assessment? b.Have our assumptions been confirmed or refuted? c.How can we do it better 5.Discuss it some more – do some implementation 6.Have you internalised the recommendations? 7.Now start the cycle again.

21. www.efquel.org EFQUEL’s e-Quality Services E-Quality Review Services Expert Reviews ECBCheck E-Quality Label Certification for Short Courses and Training Programmes E-Quality Label for Programmes Certification for Academic Programmes UNIQUe E-Quality Label Certification for Institutions and Institutes

22. www.efquel.org THANK-YOU for your attention Feedback is welcome! Released under a Creative Commons Attribution ShareAlike 3.0 Belgium License You are free: to Share — to copy, distribute and transmit the work to Remix — to adapt the work Under the following conditions: Attribution — You must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work). Share Alike — If you alter, transform, or build upon this work, you may distribute the resulting work only under the same or similar license to this one. 13 th June 2013 – VISIR Session – The Joy of Learning EDEN Conference - OSLO www.efquel.org „Learning from Peers: An introduction to peer review“ Anthony F. Camilleri anthony@camilleri.com http://www.slideshare.net/anthonycamilleri/