1 Briefing on Institutional and Program Standards Review Project s 24 June 2013 Oman Academic Accreditation Authority (OAAA) Oman Academic Accreditation Authority (OAAA)

2 Briefing Outline 1.Background (Salim) 2.Standards Review Projects (Salim) 3.Approach to HEI Accreditation (Tess/Anna) 4.Approach to Program Accreditation (Susan/Janice) 5.Process/Milestones (Tess) 6.Consultation Process (Tess) 7.Next steps (Salim) OAAA

3 1.Background OAAA

4 Background: ROSQA First iteration of institutional (HEI) standards and accreditation process was developed as part of Requirements for Omans System of Quality Assurance (ROSQA), introduced in 2004, based on an international model. In 2004/2005 two HEIs and their programs went through the accreditation process. The results of these processes and initial feedback from the sector suggested that a review of the approach was necessary. A review was carried out in 2006 and the outcomes suggested that the sector needed support to meet internationally-benchmarked standards. OAAA

5 Background: Quality Plan In 2006, a Draft Quality Plan was developed. It proposed a significant revision of ROSQA, setting out a comprehensive system, OSQA, to align Omans HE sector with international best practice and ensure the system is appropriate to the context. A two-stage approach to institutional accreditation (Quality Audit and Standards Assessment) was introduced to enable HEIs to build their internal quality systems while providing a means for public accountability. A revised approach to program accreditation was proposed. OAAA

6 2.Standards Review Projects OAAA

7 Projects aims and outcomes Projects aims and outcomes To review and revise –the HEI and program standards as set out in ROSQA to improve its relevance to Omani context and to reflect current regional and international best practice. –the accreditation processes outlined in ROSQA To produce –a revised set of HEI standards –a set of generic standards for programs –Standards Assessment and Program Accreditation Manuals which include process, approach to accreditation decisions and guidelines for HEIs and external reviewers OAAA

8 Definition of terms The original ROSQA document contained definitions for institutional and program accreditation, although not a definition for standard. Definitions of institutional and program accreditation were also included in the draft Quality Plan. While reviewing these earlier definitions, the OAAA is also looking at international benchmarks to help prepare a glossary to support a shared understanding of terminology used in the accreditation processes. OAAA

9 What are standards? It emerged that the use of the word standard was open to a wide range of interpretations across languages. In the UK the word refers to a level of achievement measured against a reference point. In France and Germany its translation is used to indicate an average or norm. Crozier, F., Curvale, B., Dearlove, R., Helle, E., Hénard, F. Terminology of quality assurance: towards shared European values? ENQA 2006 OAAA

10 What are standards? Standards: The level of requirements and conditions that must be met by institutions or programs to be accredited or certified by a quality assurance or accrediting agency. These conditions involve expectations about quality, attainment, effectiveness, financial viability, outcomes, and sustainability. Glossary of Key Terms, Council for Higher Education Accreditation, USA OAAA

11 Features of HEI and Program Standards Recognition that responsibility for quality lies with HEIs Based on ROSQA but includes standards areas not included in ROSQA Align with the scope of the QAM and reflect quality audit findings Internationally benchmarked and reviewed Acknowledge the diversity of HE provision in Oman Encourage good practice – HEIs can consider developing target standards Developed through a consultative process OAAA

12 1.Governance & Management 2.Student Coursework 3.Student Research 4.Staff Research & Consultancy 5.Community Engagement 6.Academic Support Services 7.Students & Student Support Services 8.Staff & Staff Support Services 9.General Support Services & Facilities 1.Mission, Goals & Objectives 2.Governance & Administration 3.Learning & Teaching 4.Student Services 5.Learning Resources 6.Facilities & Equipment 7.Financial Planning & Management 8.Staffing & Employment Procedures 9.Research 10.Community Relationships QAM SCOPE ROSQA SCOPE QAM v ROSQA Scope OAAA

13 Minimum standards set criteria that may define the minimum acceptable inputs, process designs or outputs. Complying with minimum standards may raise the quantity of activity below the standard to an acceptable level. Quality Measure Quantity Measure Control Standard + + – – Quality Measure Quantity Measure Control Standard + + – –

14 Target standards can be set to stretch virtually the whole organisation. Implementing the target standard may encourage wide-scale progress towards it, because it potentially applies to everybody. Quality Measure Quantity Measure + + – – Quality Measure Quantity Measure + + – – Target Standard Target Standard

15 3.Approach to HEI Accreditation OAAA

16 HEI QA Processes HEI Accreditation Stage2:Standards Assessment HEI Accreditation Stage1:Quality Audit HEI Standards Reassessment Appeal HEI Accreditation Terminated First cycle commenced 2008 HEI Accreditation Certificate Met HEI Licensure 4 years Process Document Start/End KEY Not met 1-2 years on Probation OAAA

17 STAGE 1: QUALITY AUDIT HEI QA Processes HEI Accreditation Stage2:Standards Assessment HEI Accreditation Stage1:Quality Audit HEI Accreditation Certificate Pass 4 years Self Study Quality Audit Portfolio Self Study Activities External Review Quality Audit Report External Review Activities OAAA

18 A Quality Audit Panel at work. To date, over 50 HEIs have been through the first part of the institutional accreditation process and 33 reports have been published on the OAAA website. By the end of 2013, 80% of HEIs will have been through Quality Audit.

19 STAGE 2: STANDARDS ASSESSMENT HEI QA Processes HEI Accreditation Stage2:Standards Assessment HEI Accreditation Stage1:Quality Audit HEI Accreditation Certificate Pass 4 years Self Assessment Assessment Application Self Assessment Activities External Assessment Standards Assessment Report External Assessment Activities OAAA

20 HEI status/ accreditation outcomes HEI status/ accreditation outcomes Licensed Audited On probation Accredited Accredited with merit Not accredited (after Standards Reassessment) OAAA

21 Purpose of HEI Standards Purpose of HEI StandardsOAAA HEI Standards Provide assurance that the HEI is competent to provide quality higher education OAAA Accreditation Decisions Students and Employers Confidence MOHE Licensing Decisions EQAs and Qualifications Authorities Recognition Decisions HEIs Organisational Development and Review

22 Approach to developing HEI standards (1) Mapped ROSQA standards to the QAM scope Carried out comprehensive international benchmarking using institutional standards from seven countries Reviewed MoHE licensing standards Reviewed findings from 33 published Quality Audit Reports; these are reflected in the standards OAAA

23 Approach to developing HEI standards (2) Considered role of national and ministerial protocols in development of standards e.g. health and safety, entrepreneurship, human rights Reviewed standards to ensure not too numerous and repetitive (Area statement/standard/criteria) Considered types of evidence to be submitted (both qualitative and quantitative) OAAA

24 Features of the Standards Assessment process Takes into consideration the HEIs response to Quality Audit Report Quantitative and qualitative evidence will be considered as part of the process Potential outcomes and a transparent approach to the decision-making process need to be clearly communicated Encourage the use of ADRI National schedule based on audit schedule with some flexibility OAAA

25 OAAA

26 4.Approach to Program Accreditation OAAA

27 Program QA Processes OAAA

28 Approach to Program Accreditation (1) Institutional Accreditation is not a pre- requisite for Program Accreditation All programmes to undergo national accreditation National schedule for Programme Accreditation to be developed Accreditation by Institution or by Subject Area? OAAA

29 Approach to Program Accreditation (2) Standards covering the nine areas of scope used for Institutional Accreditation Generic standards – applicable to all programmes HEIs responsible for subject specific benchmarking and addressing professional requirements International / professional body accreditation encouraged OAAA

30 Purpose of Program StandardsOAAA

31 5.Process/Milestones OAAA

32

33 Key milestones (1) 1Recruitment of QACs; development of Conceptual Design Framework (CDF) Jan – June Circulation of CDF and draft of two areas of HEI standards for feedback End June Circulation of CDF and draft of two areas of program standards for feedback Aug Circulation of draft for all HEI standards for feedback Sept Circulation of draft for all program standards for feedback Mid-Oct National Symposium for Institutional and Program Standards Review 30 – 31 Oct 2013 OAAA

34 Key milestones (2) 1Circulation of final draft for all HEI standards and Institutional Accreditation Stage 2: Standards Assessment Manual for feedback Nov/Dec Circulation of final draft for all program standards and Program Accreditation Manual for feedback Nov/Dec Approval by OAAA BoardEarly Proposed pilots and first Standards Assessment Proposed pilots and first Program Accreditation2014 OAAA

35 6.Consultation process OAAA

36 International consultation International consultation OAAA The OAAA has formed an external panel of experts to provide an international perspective: Prof Malcolm CookUK Dr Michael HillyardUSA Prof Debbie ClaytonAustralia Prof Zita Mohammed FahmiMalaysia Dr Wafa Al MansouriBahrain Prof Badr Abu ElaUAE Representative from EQUISUSA

37 National consultation National consultation What opportunities are being provided for national consultation? –Formation of a Consultative Committee to facilitate comprehensive consultation with the HE sector –Working in partnership with MoHE –Dialogue with external stakeholders (including Education Council, MoM, MoH, MoD, MoE) –Publication of drafts on OAAA website with discussion board –National Symposium October (to which CC, stakeholders, professional body, employer and student representatives will be invited) OAAA

38 ToR for Consultative Committee ToR for Consultative Committee Familiarity with ROSQA and concept of standards-based assessment Act as a liaison between the HEI and the OAAA, soliciting views of colleagues in their institutions at all stages of the projects Circulate the draft versions of the standards and accreditation process and provide HEIs feedback to the OAAA. Contribute to face to face meetings and online discussions Attend the National Symposium in October 2013 OAAA

39 How to disseminate drafts How to disseminate drafts Through internal meetings/presentations Through setting up steering committee/working group with representation from departments Through intranet/college Through internal online discussion Through link to OAAA discussion board Other ideas? OAAA

40 7.Next steps OAAA

41 Next steps Develop final drafts of standards and Manuals Approval from OAAA Board Dissemination of approved standards Training for the sector on standards and the Standards Assessment process Pilot Standards Assessments National schedule for Standards Assessments Training local external reviewers Formal Standards Assessments Decision to be made on fees to be charged OAAA

42