1. Yan Zhang University of North Carolina, Chapel Hill Email: yanz@email.unc.edu Introduction Research goals  Help build systems that are able to provide meaningful and context-sensitive cues to facilitate users build mental models  Inform design of congruent interfaces that can anticipate users’ next movement to provide adequate support  Develop learning tools and curriculums to help users move from novice to advanced levels Postulations  Mental models are based on prior experiences with similar systems using analogy or metaphor.  There are gaps between mental models and a system’s conceptual model. A system has an underlying conceptual model that is often hidden from its users.  There are gaps between the system’s conceptual model and its user views or external models. There are often more than one user views targeting different users. Typically, one for novices and one for advanced users. The concept of mental models Measuring mental models: Rationale and instrument Allan, J. (Editor). (2003). Challenges in Information Retrieval and Language Modeling: Report of a Workshop held at the Center for Intelligent Information Retrieval, University of Massachusetts Amherst, September 2002. SIGIR Forum, 37(1), 31-47. Norman, D. A. (1983). Some Observations on Mental Models. D. R. Gentner, & A. L. Stevens Mental Models (pp. 7-14). Hillsdale, NJ: Erlbaum. Wang, P., Hawk, W. B., & Tenopir, C. (2000). Users' interaction with World Wide Web resources: an exploratory study using a holistic approach. Information Processing and Management, 36, 229-251 References Conceptual model User view: appearance documentation structure operations Mental model In the ideal world, the three models match with each other. Framework for measuring MMs of the Web Peiling Wang The University of Tennessee, Knoxville Email: peilingw@utk.edu Web Space Interface Web Space: Information Objects Collections Structure: Hyperlinks Indexing Representing mechanism Search engines Searching: Process input Generate output Interface Navigation tools Access methods Access results User Method—Survey instrument  Search functions  Interface  Experience  Web space  Web structure  A subset of reversed questions  Internal consistency: homogeneity of indicators in each scale Scales: 5 components: Reliability Validity  Criteria related validation: test two groups with apparent different level of mental models in terms of sophistication  Content validity: expert review Work in progress  By observing users interaction with the Web to explore how users apply mental models in interaction with systems.  Mental models are unstable, changing with the increasing of users’ knowledge states. Future research could be conducted to explore how mental models change over time and what are the characteristics of the changes.  More research is needed to probe into the format of mental models and how users drive mental models. Mental model refers to users’ conceptual representation of the system. The Web as an IR system is complex and abstract. End users must have a mental model of the system when interacting with it. Mental models are incomplete, limited, unscientific, unstable and deceptively simple, but they are vitally important. It is the mental models that enable users to interact with and learn in trial-and-error about systems. The purpose of this study is to develop and test instruments for measuring users’ mental models of the Web as an IR system. Interface