April 2004IADR Honolulu Nikos Mattheos Nikos Mattheos Malmö University, Sweden Interactive software and self-assessment skills.

Slides:

Advertisements

Similar presentations

Knowledge Dietary Managers Association 1 PART II - DMA Certification Exam Blueprint and Exam Development-

Advertisements

Random Case Analysis Ramesh Mehay. Aims: to remind you about RCA To help refine your skills To revisit JoHari.

A Strategy to Enhance Assessment and Feedback Sheila Oliver Director of Assessment School of Dentistry.

Anders Jönsson (LUT) & Nikos Mattheos (OD) Malmö University Dynamic assessment and Interactive Examination.

Designing Scoring Rubrics. What is a Rubric? Guidelines by which a product is judged Guidelines by which a product is judged Explain the standards for.

TAP-ET: TRANSLATION ADEQUACY AND PREFERENCE EVALUATION TOOL Mark Przybocki, Kay Peterson, Sébastien Bronsart May LREC 2008 Marrakech, Morocco.

Antonis Lionarakis, Hellenic Open University Considerations for Distance Learning: ‘what students learn’, ‘how they learn’ and ‘what they are able to do.

Assessment of Clinical Competence in Health Professionals Education

Correlation between EI and PE Introduction Method EI and age correlated positively, r(51) = +.41, p =.003. Students above age 33 had EI scores well above.

PPA Advisory Board Meeting, May 12, 2006 Assessment Summary.

PORTFOLIO AS A LEARNING TOOL FOR MEDICAL STUDENTS Kirsti Lonka, Ph.D., Professor of Medical Education, Centre for Cognition, Understanding, and Learning.

2001ADEE Bern - Nikos Mattheos Nikos Mattheos Centre for Oral Health Sciences Malmo, Sweden Flexible Learning in Dental Education.

2003IADR Gothenburg Nikos Mattheos Nikos Mattheos Centre for Educational Research and Technology in Oral Health, University of Malmö, Sweden The Interactive.

ASSESSING & DEVELOPING YOUR WORKPLACE COMMUNICATION SKILLS Professional Year Program - Unit 1: Workplace Communication.

Information Technology and interaction in learning interaction in learning Nikos Mattheos Centre for Educational Technology and Research in Oral Health.

6 th semester Course Instructor: Kia Karavas.  What is educational evaluation? Why, what and how can we evaluate? How do we evaluate student learning?

Conducting a Job Analysis to Establish the Examination Content Domain Patricia M. Muenzen Associate Director of Research Programs Professional Examination.

Assessment Tools. Contents Overview Objectives What makes for good assessment? Assessment methods/Tools Conclusions.

Assessing Teamwork in the Trauma Bay: Introduction of a Modified NOTECHS Scale for Trauma Supported by a grant from the American College of Surgeons and.

Establishing Content Validity of a Novel Written Examination to Assess Medical Students on the Surgery Clerkship A Berlin MD, A Reinert BA, A Swan-Sein.

Technology Integration Planning Guidelines for Development A Visual Guide.

Bob Woodwards SAC Chair, Oral and Maxillofacial Surgery.

NQF Inclusive pilot run – Chance B rd meeting Copenhagen.

EDU 385 Education Assessment in the Classroom

Learner Assessment Win May. What is Assessment? Process of gathering and discussing information from multiple sources to gain deep understanding of what.

Understanding Meaning and Importance of Competency Based Assessment

Student assessment AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences.

The Effects of Strategy Instruction on Written Expression of Students With Disabilities Leigh Ann Sutton Ronald H. Pannell April 15, Alternative.

VCE Assessment PE Curriculum II Tutorial 3. Delivery of VCE material Lecture Tutorial  Worksheets – concept maps (software - inspiration  Discussion.

Patricia A. Mahoney, MSN, RN, CNE

Basic Sewing BY: Phibie S. Bate Cathyrine F. Gonzales.

International Diabetes Federation (IDF) East Mediterranean and Middle East Region (EMME) Workshop on Professional Educational Methodology in Diabetes

Lesson 3 Skills for Healthy Living Self-Assessment 3 Skills for Healthy Living Self-Assessment L E S S O N.

Assessment Tools.

Dr. Othman Ali Alghtani Tabuk University, K.S.A.

Self-assessment Accuracy: the influence of gender and year in medical school self assessment Elhadi H. Aburawi, Sami Shaban, Margaret El Zubeir, Khalifa.

Vocabulary. examining one's talents, skills and aspirations/goals the first step in career planning.

ELEMENT 7 - PLAN EVALUATION 73. ____ Workplace injury/illness data are effectively analyzed. The OSHA 300 log, safety committee minutes and baseline surveys.

Presented By Dr / Said Said Elshama  Distinguish between validity and reliability.  Describe different evidences of validity.  Describe methods of.

Doing It Differently in Science - An Evaluation of the Process Sharon Fraser and Elizabeth Deane University of Western Sydney, Nepean April, 28th 2000.

Assessment. Workshop Outline Testing and assessment Why assess? Types of tests Types of assessment Some assessment task types Backwash Qualities of a.

Core Competencies for Adolescent Sexual and Reproductive Health Performance Assessment and Human Resources Toolkit.

Assessment Formats Charlotte Kotopoulous Regis University EDEL_450 Assessment of Learning.

1 Testing and Evaluation. Testing and Evaluation - ISFSI2 Testing and Evaluation Purpose of Tests –measure instructor ability –discover student weakness.

Master in Law LEFIS WG2 Postgraduate Studies 16 th June 2006.

Exercises in Assessment for World History Classrooms Patrick Manning University of Pittsburgh April 23, 2011.

Training the Trainers Assessing the Learner Progress By Dr Malik Zaben IMET

Application Individualization and Differentiation in Czech Primary Schools - One of the Characteristic Features of Inclusion Application Individualization.

PEER ASSESSMENT AND SELF- ASSESSMENT. Peer assessment  The practice is employed to save teachers time and improve students' understanding of course materials.

Neuroblend Curriculum and Learning Paths. Introduction Project Description Professional neuroscience nursing ECP Curriculum Description Pedagogical background.

Prior Learning Assessment (PLA) Pilot Project At VSU Prepared by the PLA Assessors Group.

Self-assessing with adaptive exercises Chye-Foong Yong & Colin A Higgins University of Nottingham.

Introduction. The Purpose of the Class In this class, we will be writing. We will explore the writing process. We will learn what does it take to write.

Assessing Competence in a Clinical Setting GRACE Session 12.

Practical approaches to……………… Provide quality feedback to children on their learning in computer lessons. Engage children in assessing their learning in.

CERTIFICATE IN ASSESSING VOCATIONAL ACHIEVEMENT (CAVA) Unit 1: Understanding the principles and practices of assessment.

Health Information Competencies of Information Age Students: Results from the Interactive Online Research Readiness Self- Assessment (RRSA) Lana Ivanitskaya.

APPROVED CLINICAL INSTRUCTOR WORKSHOP Evaluation.

Student Learning Outcomes Assessment Montgomery College Fall 2011 Orientation.

Competencies and consequences … choices to make April

Unit 1 Language testing. About test: What is testing?  A procedure for critical evaluation; a means of determining the presence, quality, or truth of.

Designing Scoring Rubrics

This project has been funded with support the European Commission

E-learning Module Simulated Patient Encounters; Assessment and Reflection Clare Whelan Date 22/03/2017.

Training in Classroom Assessment Related to the CEFR

Automated Essay Scoring Tools – New approaches in Editing Process

teachers The English Language Centre EPORTFOLIOS!

Performance Evaluations: Providing feedback in organizations

OSCE Interest group 3rd April 2009 Barry Ricketts

Student Learning Outcomes Assessment

Presentation transcript:

April 2004IADR Honolulu Nikos Mattheos Nikos Mattheos Malmö University, Sweden Interactive software and self-assessment skills

April 2004IADR Honolulu Nikos Mattheos Self assessment ability: Evaluate professional actions – process /outcomeEvaluate professional actions – process /outcome Compare to standards Compare to standards Identify weaknesses Identify weaknesses Define new learning objectives Define new learning objectives

April 2004IADR Honolulu Nikos Mattheos self assessment ability reflectionfeedback

April 2004IADR Honolulu Nikos Mattheos The Leo: A free Internet-based platform for assessing and training of self-assessment skills in oral health education (A. Nattestad – R. Attström)

April 2004IADR Honolulu Nikos Mattheos

April 2004IADR Honolulu Nikos Mattheos

April 2004IADR Honolulu Nikos Mattheos

April 2004IADR Honolulu Nikos Mattheos Student’s essay Primary feedback: Expert’s essay reflection improvement ?

April 2004IADR Honolulu Nikos Mattheos Leon=26 Staticn=26 BaselineBaselineBaselineBaseline week 1 week 2 week 3 week 4 week 5 AssessmentAssessmentAssessmentAssessment Case1 Case1 1 1 Case2Case3Case4 Case2Case3Case

April 2004IADR Honolulu Nikos Mattheos BaselineBaselineBaselineBaseline background data, demographics background data, demographics competence with computers (score 1-50) competence with computers (score 1-50) Baseline measurements:

April 2004IADR Honolulu Nikos Mattheos Weekly evaluations: use of the softwareuse of the software attitudes, acceptance, expectations attitudes, acceptance, expectations (Visual Analogue Scale 1-16) (Visual Analogue Scale 1-16)

April 2004IADR Honolulu Nikos Mattheos AssessmentAssessmentAssessmentAssessment The Interactive Examination: self assessment as staring point (Internet) self assessment as staring point (Internet) oral + essay + written comparison with expert oral + essay + written comparison with expert Mattheos N, Nattestad A, Falk Nilsson E, Attström R. The Interactive Examination: Assessing students’ self-assessment ability. Med Educ 2004, in press.

April 2004IADR Honolulu Nikos Mattheos Results Improved performance in general Improved performance in general No significant difference between groups No significant difference between groups (moderate agreement between 2 assessors) (moderate agreement between 2 assessors) Time on task correlates to written performance Time on task correlates to written performance Computer competence correlates to written performance Computer competence correlates to written performance

April 2004IADR Honolulu Nikos Mattheos students judged 3 out of 4 cases as “easy” students judged 3 out of 4 cases as “easy” students were positive on Internet cases, but some complained about workload students were positive on Internet cases, but some complained about workload Attitude swifts Attitude swifts Results

April 2004IADR Honolulu Nikos Mattheos 1. What do you think of the Internet application you used? (VAS 1-16) Leo groupNon Leo groupdifference mean after case 1 10,15 8,3 p>0,05 mean after case 4 10,510,8 p>0,05 differencep>0,05p = 0, How much do you think that the software you used will help you at the exams? Leo groupNon Leo group difference mean after case 1 11,28,8 p = 0,0091 mean after case 4 10,99,9 p>0,05 differencep>0,05 3. How much have you learned through the Internet cases? Leo groupNon Leo groupdifference mean after case 1 6,75,43 p>0,05 mean after case 4 109,43 p>0,05 difference p = 0,0032 p = 0,0004

April 2004IADR Honolulu Nikos Mattheos 1. What do you think of the Internet application you used? (VAS 1-16) Leo groupNon Leo groupdifference mean after case 1 10,15 8,3 p>0,05 mean after case 4 10,510,8 p>0,05 differencep>0,05p = 0, How much do you think that the software you used will help you at the exams? Leo groupNon Leo group difference mean after case 1 11,28,8 p = 0,0091 mean after case 4 10,99,9 p>0,05 differencep>0,05 3. How much have you learned through the Internet cases? Leo groupNon Leo groupdifference mean after case 1 6,75,43 p>0,05 mean after case 4 109,43 p>0,05 difference p = 0,0032 p = 0,0004

April 2004IADR Honolulu Nikos Mattheos 1. What do you think of the Internet application you used? (VAS 1-16) Leo groupNon Leo groupdifference mean after case 1 10,15 8,3 p>0,05 mean after case 4 10,510,8 p>0,05 differencep>0,05p = 0, How much do you think that the software you used will help you at the exams? Leo groupNon Leo group difference mean after case 1 11,28,8 p = 0,0091 mean after case 4 10,99,9 p>0,05 differencep>0,05 3. How much have you learned through the Internet cases? Leo groupNon Leo groupdifference mean after case 1 6,75,43 p>0,05 mean after case 4 109,43 p>0,05 difference p = 0,0032 p = 0,0004

April 2004IADR Honolulu Nikos Mattheos Reflections… Human feedback irreplaceable? Human feedback irreplaceable? Content and cases too easy? Content and cases too easy? Time not enough? Time not enough? Assessment procedure not sensitive enough ?Assessment procedure not sensitive enough ?

April 2004IADR Honolulu Nikos Mattheos ” ”The Kiss”. Gunnar Lundh, Malmö, 1949