1. Concept Mapping as a Window into Student Understanding Biology Scholars Program SoTL Institute July, 2010 William Cliff Department of Biology Niagara University

2. Types of Conceptual Learning Meaningful Learning −New concepts are linked to existing knowledge in a highly integrated framework of ideas Rote Learning −New concepts are minimally linked to existing knowledge and are stored in an arbitrary, verbatim and nonsubstantive fashion From: Mintzes J. Concept Mapping in College Science. Mintzes J and Leonard W, eds. Handbook of College Science Teaching. NSTA Press, 2006.

3. A 2D node-link-node diagram that depicts the most important concepts and propositions in a knowledge domain A network of propositions where related concepts are interlinked by labeled lines What is a Concept Map?

4. Concept Map of Concept Mapping Modified from: Novak JD & Canas AJ (2006) http//cmap.ihmc.us/Publications/Research Papers/TheoryUnderlyingConceptMaps.pdf

6. Concept Maps as Measuring Tools Task Student Response Format Scoring System

7. Mapping Tasks Fill-in skeleton map −Fill-in nodes (concepts) −Fill-in links (verbs) −Selected or free response Self generated −Concepts provided −De novo

8. Example of Mapping Task Fill-in Nodes What are the cardiovascular factors that determine mean arterial pressure (MAP)? MAP

9. Example of Mapping Task Fill-in Links

10. Self Generated Mapping Exercise

11. Self Generated Map

12. How can Concept Maps be Evaluated or Scored? Holistically or qualitatively Quantitatively by scoring rubrics −Structural Complexity −Content Validity Comparison with expert maps

13. Scoring Concept Maps

14. Structural Scoring Method McClure, JR et al. J. Res. Sci. Teach. 36:475, 1999 First level of Hierarchy Second level of Hierarchy Propositionsscore1 x 8 = 8 Hierarchies score5 x 2 = 10 Cross-links score10 x 1 = 10 Examples score1 x 2 = 2 Total = 30

15. Concept Map of Concept Mapping Modified from: Novak JD & Canas AJ (2006) http//cmap.ihmc.us/Publications/Research Papers/TheoryUnderlyingConceptMaps.pdf

16. Structural Scoring Rubric McClure, JR et al. J. Res. Sci. Teach. 36:475, 1999 Propositionsscore1 Hierarchies score5 Cross-links score10 Examples score1

17. Concept Map of Concept Mapping Modified from: Novak JD & Canas AJ (2006) http//cmap.ihmc.us/Publications/Research Papers/TheoryUnderlyingConceptMaps.pdf 1 st Level 2 nd Level 3 rd Level Crosslink Example Crosslink Propositionsscore1 x 14 = 14 Hierarchies score5 x 3 = 15 Cross-links score10 x 3 = 30 Examples score1 x 2 = 2 Total = 61

18. Relational Scoring Method West, DC et al. Med. Educ. 36:820, 2002

19. Valid relationscore1 x 0 = 0 Correct relation score2 x 1 = 2 Peripheral relationscore1 x 2 = 2 Core relation score23 x 3 = 69 Total = 74 90% Total relationscore27 x 3 = 81

20. Assessment Exercise

21. Example of Expert Map from Silverthorn D. Human Physiology. An Integrated Approach. 2007

22. Expert Criterion Map

23. Student Maps

24. Cliff, W. Using concept mapping to assess understanding of cardiovascular physiology. FASEB J. 18:300.6, 2004. Causal Links between Cardiovascular Parameters on Student Concept Maps. N= 71 maps

25. Summary and Conclusions

26. Advantages of Concept Mapping for Assessing Student Learning Makes visible the complex structure of student’s declarative knowledge Uncovers student misunderstandings Reveals student conceptual change

27. Recommendations Student Training Task Selection Scoring Analysis

28. Further Resources M. Zeilik. Concept Mapping. [online] www.wcer.wisc.edu/archive/cl1/flag/cat/catframe J. Mintzes and W. Leonard, eds. Handbook of College Science Teaching. NSTA Press, 2006. M. Ruiz-Primo and R. Shavelson. Problems and Issues in the Use of Concept Maps in Science Assessment. J. Res. Sci. Teaching. 33:569-600, 1996. J. Nesbit and O. Adesope. Learning with Concept and Knowledge Maps: A Meta-Analysis. Rev. Edu. Res. 76:413-448, 2006.