Developing a process of electronic question banking in 2 nd and 3 rd year courses Dalal ALQahtani; BDS,MSc,M ed Oral and Maxillofacial Pathologist Lecturer College of Dentistry King Saud University, Riyadh Kingdom of Saudi Arabia ©2014 Vice Rector for Education and Academic Affairs Center for Excellence in Learning and Teaching - CELT
GOAL Develop an effective process of question banking by applying it on small scale “course level”, then transferring it into a large scale (department, college, etc).
Old exams ? Question bank PROCESS
Objectives Enhance the content validity of examination by matching the questions to the curriculum that is taught Banked questions are monitored on each exam occasion, this is particularly useful when developing and trailing questions Electronic banking making it easy to design the structure of the question bank to suit course ‘intended learning outcomes. Get a graphical overview of how questions are matching course objective. It also shows the questions past exam performance.
How can we achieve this ?
The developed process of question banking
Phase I: Selecting the suitable system Reviewing the available systems in question banking and item analysis Testing the systems and process of approving
OMR SCANNER OMR SHEETS Question bank and Item analysis software
Phase II: Questions review Design Question Check List Review available questions for approval
Phase III: Questions review Input questions into the question bank using an excel template Title; Question Text; Keyword; Course Skill; Subject ; Objective; Question Style, Time for Completion( expected time to spent in solving this question), Cross Reference,;Correct Response;
Reviewing process for banked questions
Phase IV: Questions output Produce assessment blueprint Choose exam format Gather results Reporting
-Correct answer report -Absentee report -Item analysis report -Score distribution -Audit report -Performance breakdown
Item analysis
Phase V: Evaluation and continues improvement of question banking
SYSTEM SHEETS IT SUPPORT HIGH EFFORT AND TIME CONSUMING Training COST
As summary, through the phases of this project, we achieved the following: A well-organized set of questions. The questions were organized into subjects, skills and other specified attributes. Easy access to questions based on search parameters. Search parameters included subject, keywords, or other attributes of a question. Minimising the time and energy required to construct a test. Monitoring the performance of question across varying testing criteria Gathering of exam statistics Provision to update the question based on analysis of students’ responses to the question
Recommendations Generalize the project’s experience from course to a college level Develop a question bank for more than MCQs, but for other formats also (Short Answer, Modified Essay Question, Extended Matching Questions, OSCE, etc.) Create an auditing system to enhance the quality of banked questions
Developing a question banking process is NOT only about the electronic system because it is only a tool which needs protocol so it can run efficiently
W would like to thank Center for Excellence in Learning and Teaching – CELT for supporting and funding this project
Thank you Perfection is not attainable, but if we chase perfection we can catch excellence * Vince Lombardi