Conducting Multi-program Visits with On-line Accreditation Management System Jung Soo Kim Hongik University WOSA 2018 September, 2018

CONTENTS Accreditation in Korea Accreditation Objectives Accreditation Process An ICT Tool : Accreditation Management System Outcomes

I. Engineering Education in Korea (Source: Korea Education Statistics Service, 2017) ⊕ Number of Engineering Programs in Universities Architectural 353 Civil · Urban 199 Traffic · Transportation 135 Mechanical · Metal 196 Electrical · Electronic 297 Precision · Energy 129 Material Computer · IT 678 Chemical 126 Industrial 120 Others 213 Total 2735

I. Accreditation statistics ⊕ Accreditation Committees Classification Engineering Accreditation Committee (EAC) Computing Accreditation Committee (CAC) Engineering Technology Accreditation Committee (ETAC) Year established 1999 2004 2009 Program duration 4-year 3-year/2-year No. of Programs (as of Feb. 2018) 459 (78 universities) 54 (44 universities) 25 (6 universities) Relevant Accords Washington Accord Seoul Accord Sydney/Dublin Accord (8 programs/25 programs) No. of Discipline-based Program Criteria 18 criteria (mechanical, electrical, etc.) 5 criteria (multimedia, IT etc.) n/a

I. Accreditation Statistics ⊕ Number of Accredited Programs (EAC&CAC) ⊕ Number of Accredited Program Graduates (EAC&CAC)

II. Accreditation Objectives Each year, evaluate ~170 programs (~26 HEIs) Manage overall process and meet deadlines Maintain consistency: between programs within an HEI, between HEI’s, between programs within a discipline Manage information flow: from HEI to ABEEK, within ABEEK, from ABEEK to HEI Use time efficiently during accreditation visit Distribute work load (i) among players (ii) over time

II. Players (Roles and Progression) Roles (share “Work Load”) Program Evaluator: peer review (discipline expertise) Chair (Deputy Chair): moderate (accreditation expertise) manage visit, liaise with HEI, train PEV’s Editor 1: consistency in application of criteria, editing Editor 2: consistency in overall process Staff: lodging, transportation, scheduling, ICT tool Progression - PEV (3 times)  Deputy Chair (1~2 times)  Team Chair

III. Accreditation Process : Stages ⊕ Six Stages of Evaluation Process – Steps 4 & 5 Planning and preparation for the upcoming accreditation evaluation cycle STEP 1 STEP 2 STEP 3 STEP 4 STEP 5 STEP 6 Selection of institution/ program and formation of evaluation team Submission of Self-Study Report by programs Pre-visit Evaluation followed by On-site Evaluation Post-visit Moderation and Accreditation Decision Follow-up

III. Accreditation Process : Timeline Submit Self- study Report On-site visit Evaluation (3-day) Submit 14-Day Response Institution Pre-visit Evaluation Submit Pre-Visit Evaluation Report Submit On-site Evaluation Report Submit Review of 14-Day Response Accreditation Decision ABEEK Supplementary Info Jan May Apr Mar Jun Jul Aug Sep Feb Dec Pre-visit Consulting Final Evaluation Report

III. Accreditation Process : Consistency & Training ⊕ 4-Tier Consistency Checks Consistency checks on discipline-based program criteria Consistency check 1 Consistency checks and editing of findings and expressions in Evaluation Reports check 2 Consistency checks across different institutions check 3 Consistency checks across different accreditation cycles check 4 ⊕ Training of Program Evaluators Training session for initial pool of program evaluator candidates Step 1 Additional training session for program evaluators selected for the year Step 2 On-the-job training (OJT) by Team Chair during pre-visit evaluation stage Step 3

III. Accreditation Process : Work Load Sharing

IV. An ICT Tool: Overview Real-time Evaluation and Moderation Entry, retrieval and report generation in real-time Access to ABEEK Criteria, Guidelines Access to Program/HEI submissions Tables to support moderation & consistency checking Information Flow, Archiving, Statistical analysis Document uploading by program/HEI Communications, performance appraisal Data collection for statistical analysis

On-line, Menu-driven Process

Entry & Editing of Accreditation Findings

Access to Accreditation Guideline

Accreditation Findings against Accreditation Guideline

Accreditation Status by Criterion at Different Stages

Checking Progress & Meeting Deadlines

Generation and Archiving of Various Reports

Communication within Accreditation Team

Access to Forms & References

Personal History of Accreditation Activities

V. Outcomes of On-line ICT Tool Each year, on average, ~170 programs (~26 HEIs) Per HEI: ~7 programs; some >15 (30+ member teams) For each program, start with 20~30 potential shortcomings, end with 5~15 final shortcomings With on-line system, Team Chair(me!) can perform real-time review/moderation of 7~8 programs during visit With the help of deputy chair(s) for large delegation, can handle visits involving >15 programs Information flow, archiving & statistical analysis Documentation chores handled automatically

WOSA 2018, New Delhi September, 2018 Thank you for your time!