1. Searching and Using Electronic Literature III. Research Design

2. 2 Framework for Empirical Research of Human Behavior Paradigms Paradigms positivist positivist naturalistic naturalistic dualistic dualistic Methodologies Methodologies quantitative quantitative qualitative qualitative pluralistic pluralistic A research design is guided by a paradigm using a methodology

3. 3 Classic Method for Observation Experiment (rigid standards exist) Experiment (rigid standards exist) randomization randomization treatment treatment to find cause-effect (relationship between dependent and independent variables) to find cause-effect (relationship between dependent and independent variables) to test hypothesis based on statistical significance of quantitative data to test hypothesis based on statistical significance of quantitative data

4. 4 Alternative Method Naturalistic experiment Naturalistic experiment observing real behaviors in real life observing real behaviors in real life subject's own environment subject's own environment to describe behavior to describe behavior to interpret or model behavior to interpret or model behavior typical data: interactions, verbalized thoughts, diaries, participant- observations, interviews typical data: interactions, verbalized thoughts, diaries, participant- observations, interviews longitudinal longitudinal

5. 5 Research Questions 1.How are electronic literature retrieval systems used in finding useful information for class-related tasks by faculty and undergraduate students? What type of information is used for selecting documents? What type of information is used for selecting documents? What type of information is used for defining topics? What type of information is used for defining topics?

6. 6 Research Questions (cont ’ d) 2.What are the search processes? Which system functions are used and how? Which system functions are used and how? What problems related to system do users encounter during the search? What problems related to system do users encounter during the search? 3.Are there any differences between faculty and students? What are the differences if any?

7. 7 Experimental design Participants Participants Participants from Phase I Participants from Phase I New participants with similar backgrounds New participants with similar backgrounds Simulated class-related tasks Simulated class-related tasks Faculty: conducting a search for literature to design a course assignment Faculty: conducting a search for literature to design a course assignment Students: conducting a search for literature to complete a course assignment Students: conducting a search for literature to complete a course assignment

8. 8 Data Collection Behavior Behavior Search process (video) Search process (video) Think-aloud during searching (audio synchronized with video) Think-aloud during searching (audio synchronized with video) Topic description before searching Topic description before searching Topic description after searching Topic description after searching Post search input Post search input Cognitive trait Cognitive trait Learning style Learning style

9. 9 Data Analysis (Plan) Transcribing data Transcribing data Verbalization (reasons for certain actions) Verbalization (reasons for certain actions) Search formulation / reiteration Search formulation / reiteration Screen action Screen action Selection behavior Selection behavior Coding Coding