1. Experiments and statistics

2. QNT, Paul Cairns, University of York2 Classic “lab” study  Studying cause and effect – “novel navigation for faster task times”  But it might be something else…  Ensure causal chain

3. QNT, Paul Cairns, University of York3 Big problem  People vary – Unlike say gravity or water  Context influences people  Need to isolate causal chain  Need to account for natural variation

4. QNT, Paul Cairns, University of York4 Experimental design  Independent variable (IV) – Causes change in  Dependent variable (DV) – Which is numeric  Confounding variables – Are eliminated

5. QNT, Paul Cairns, University of York5 Statistics  Accounts for natural variation  Assume IV has no effect (null)  Prediction is crucial  Calculate probability of DV data  Unlikely data suggests real effects

6. QNT, Paul Cairns, University of York6 Challenges  Hard concepts: involvement, aesthetics – Construct validity  Context – External/ecological validity  Very small questions

7. Surveys and interviews

8. QNT, Paul Cairns, University of York8 How to ask questions  Questionnaires  Interviews  Focus groups

9. QNT, Paul Cairns, University of York9 Outcomes  Demographics  Reveal thoughts/opinions/experiences  Formulate new hypotheses  Measurement – Questionnaire as instrument

10. QNT, Paul Cairns, University of York10 Asking questions  Closed – Likert scales – Options  Open  Wording

11. QNT, Paul Cairns, University of York11 Bad questions  “Why don’t you like this interface?”  “Isn’t this good?”  “We made this. What do you think of it?”  “I don’t like the colours and would prefer a simpler interaction: Agree?”  “How old are you?”

12. QNT, Paul Cairns, University of York12 Analysis  Closed questions: counting and stats  Open questions: coding – Patterns, themes – Dimensions and attributes – Theoretical sampling

13. QNT, Paul Cairns, University of York13 Challenges  Learning to ask questions  Qualitative analysis  Informing design

14. Case studies

15. QNT, Paul Cairns, University of York15 Misconceptions  Sample of one  “Go in and learn”  Purely descriptive

16. QNT, Paul Cairns, University of York16 Characterising Case Studies  Current  Context and object blur  Multiple sources of evidence  Theoretically informed

17. QNT, Paul Cairns, University of York17 Outline of process  Theoretical prediction  Gather data – Obs, interviews, documents, resources  Analyse – Maintain causal chain  Theoretical development

18. QNT, Paul Cairns, University of York18 Methodological development  Devise method to address problems  Use method in a project  Analyse impact of method  Develop method

19. QNT, Paul Cairns, University of York19 Challenges  No formal analysis methods  Often need intervention  Action Research for HCI? – Notion of participation – Joint solutions