university of california, san francisco school of medicine Concept Mapping for Assessment in Medical Education Arianne Teherani

Creative Commons License Attribution-NonCommercial-Share Alike 3.0 Unported You are free: to Share — to copy, distribute and transmit the work to Remix — to adapt the work Under the following conditions: Attribution. You must give the original authors credit (but not in any way that suggests that they endorse you or your use of the work). Noncommercial. You may not use this work for commercial purposes. Share Alike. If you alter, transform, or build upon this work, you may distribute the resulting work only under a license identical to this one. See for full license.

university of california, san francisco school of medicine Overview Provide an overview of: –What a concept map is –Uses of a concept map –Concept maps for assessment (knowledge and attitudes) Considerations Scoring Benefits and limitations

university of california, san francisco school of medicine What is a concept map?

university of california, san francisco school of medicine Background What does it mean when a learner says “I understand’ or “I believe” Does it mean the same thing to him/her than it does to you or another learner? How can a learner demonstrate their understanding/beliefs

university of california, san francisco school of medicine Concept Map is: Tangible way to display how your mind “sees” a topic Reflect on what you know Nodes = Rectangles/circles Arrows/lines Linking = Word/phrase on arrows

university of california, san francisco school of medicine Criteria for Concept Maps Proposition (semantic units) Hierarchies Cross links Examples Novak and Gowin

university of california, san francisco school of medicine Constructing a Concept Map 1.Brainstorm and list (5 mins) 2.Organize and group (10 mins) 3.Layout (5 mins) 4.Link (5 mins) 5.Finalize (5 mins) Accuracy Organization Appearance Creativity

university of california, san francisco school of medicine Concept Mapping Exercise 2 Read through case. Each group place their concept map on their map on the board

university of california, san francisco school of medicine Concept Mapping for: Teaching Learning Assessment

university of california, san francisco school of medicine Directedness

university of california, san francisco school of medicine Scoring Number (Structural i.e. counting propositions) Accuracy (Quality of propositions) Strength and significance of nodes and linking (Quality and importance of propositions)

university of california, san francisco school of medicine Design & Scoring High vs. low directed maps –Explicit context –Concepts and sub-concepts –Rubric Quality and quantity Pre and post (or interval) measures Key vs. related terms Criterion/Expert map Reliability Concept maps and other measures

university of california, san francisco school of medicine Benefits Train-to-use easy Raters introduce no error in variability Clear concept domain Consistent and appropriate ranking Proportion of valid propositions

university of california, san francisco school of medicine Limitations Decision for type of concept map used is critical Linear and non-visual thinkers Time required to attain computer skills