Learning from Peers An introduction to peer-review Anthony F. Camilleri 5 th ICT Innovations Conference th September 2013 – Ohrid, Macedonia

What‘s in a Name? AuditExpert-Review ObjectiveSubjective Precise standardsBroad guidelines Verifies account of clientInterprets account of client Requires detailed knowledge of administrative procedures Requires detailed knowledge of the subject area concerned standards-based review

Who is a peer? an expert in the field an expert in what field? e-learning! what is e-learning?

Features of an Expert-Peer experience in course design and delivery familiar with best-practice comparative perspective sense of mission natural communicator

A reviewer is a communicator University Agency Review Team

Inter-subjectivity different subjective perceptions, taken from different viewpoints, give an objective view of reality the quality basis of an external review requires consensus consensus is not a diplomatic nicety but an essential pre-requisite of quality

Learning from self-assessment

There is no such thing as objective quality

How to learn from self- assessment 1.Read the quality standard 2.Understand the quality standard 3.Ask Questions 4.DO NOT fill it in 5.Discuss it – with all stakeholders in the institution a.How do we meet the standard? b.What can we do better? c.Does it apply in all areas? 6.Discuss it some more – do some implementation 7.Have you internalised standard? 8.Now fill in the questionnaire

A look at the Quality Cycle DoCheck PlanAct アク ション 計画 実行 チェッ ク CHECK should be read as STUDY in English Check implies ‚to hold back‘ (Deming, 1980)

A Need to Prioritise DoCheck PlanAct アク ション 計画 実行 チェッ ク

Be Honest „Most Quality Managers are Magicians“ Look Here don‘t look here!

What will self-assessment produce A time to think, communicate and strategize A better understanding of institutional processes An overview of where we are and hopefully where we need to go A report

Learning from peer-review

The Show-Off The Politician The Grumpy The Bored Don’t be one of these people….

How to approach a peer-review Understand the purpose of the review Understand your role in the review –Your impressions –Of your part in the instituion Be candid and informative Don’t try to hide things (you’ll be caught)

Main result of peer-review an external evaluation of your institutional quality (procedures) a report a certificate

Run the cycle again DoCheck PlanAct アク ション 計画 実行 チェッ ク

Remember NO process is without errors There is ALWAYS room for improvement

What to do with the report 1.Read the report 2.Understand the report 3.Ask Questions 4.Discuss it – with all stakeholders in the institution a.What did we miss in our Self-Assessment? b.Have our assumptions been confirmed or refuted? c.How can we do it better 5.Discuss it some more – do some implementation 6.Have you internalised the recommendations? 7.Now start the cycle again.

EFQUEL’s e-Quality Services E-Quality Review Services Expert Reviews ECBCheck E-Quality Label Certification for Short Courses and Training Programmes E-Quality Label for Programmes Certification for Academic Programmes UNIQUe E-Quality Label Certification for Institutions and Institutes

THANK-YOU for your attention Feedback is welcome! Released under a Creative Commons Attribution ShareAlike 3.0 Belgium License You are free: to Share — to copy, distribute and transmit the work to Remix — to adapt the work Under the following conditions: Attribution — You must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work). Share Alike — If you alter, transform, or build upon this work, you may distribute the resulting work only under the same or similar license to this one. 13 th June 2013 – VISIR Session – The Joy of Learning EDEN Conference - OSLO „Learning from Peers: An introduction to peer review“ Anthony F. Camilleri