Housekeeping  Seminar topics  Requirements  Sign up by Feb 3rd : https://www.surveymonkey.com/s/MXVQZV3 https://www.surveymonkey.com/s/MXVQZV3  Bonus.

Slides:



Advertisements
Similar presentations
Mobile Data from a Research Perspective Institute of Educational Technology The Open University Agnes Kukulska-Hulme JISC/CNI conference, Edinburgh, 1-2.
Advertisements

Data gathering. Overview Four key issues of data gathering Data recording Interviews Questionnaires Observation Choosing and combining techniques.
CSCI 4163/6904, Summer Diary studies…  Participants collect data about events  As they happen  In the context of the event (in situ)  Can think.
ACTIVELY ENGAGING THE STAKEHOLDER IN DEFINING REQUIREMENTS FOR THE BUSINESS, THE STAKEHOLDER, SOLUTION OR TRANSITION Requirements Elicitation.
Planning efficient recruitment EHES Training material.
Diary studies Rikard Harr November 2010 © Rikard Harr Outline The Diary study: benefits, challenges and alternatives The papers: aims and use of.
Critical Appraisal of Qualitative Research Jenny Tancock, Clinical Librarian, FGH Alison Harry, R+D Co-ordinator,
RTV 440 Week 2 Cell Phones Off and Put Away Chapters 1 & 9 Appendix 1.
Data gathering.
Topics: Interviewing Question Type Interviewing techniques
Interaktionsdesign Session 3 Etnografisk tilgang til kontekst.
Chapter 7 GATHERING DATA.
Observing Learning Helen Bacon and Jan Ridgway Inclusion Support Services.
Chapter 17 Ethnographic Research Gay, Mills, and Airasian
Reading in the Upper Grades
 It is a master plan that specifies the methods and procedures for collecting data and analyzing the needed information (Zikmund et al, 2010)  It involves.
Choosing and Implementing a Research Design Lauren Garcia-DuPlain The University of Akron English Composition 112.
CSCI 4163 / CSCI 6904 – Winter Housekeeping  Write a question/comment about today’s reading on the whiteboard (chocolate!)  Make sure to sign.
Human Computer Interface
The Market Research Process
Diaries KSE966/986 Seminar - Fall 2012/Spring 2013 March 29, 2013 Uichin Lee.
Preparing for Data Collection Need to recognize that data collection is a high level activity that cannot be just passed off to graduate assistant Need.
Questionnaires and Interviews
ACTIVITY. THE BRIEF You need to provide solid proof to your stakeholders that your mobile website meets the needs of your audience. You have two websites.
RTV 440 Week 1 Cell Phones Off and Put Away Chapters 1 & 9 Appendix 1.
Presentation: Techniques for user involvement ITAPC1.
CSCI 4163/6904, summer Quiz  Multiple choice  Answer individually - pass in  Then class discussion.
Data gathering. Overview Four key issues of data gathering Data recording Interviews Questionnaires Observation Choosing and combining techniques.
S-005 Collecting data: What methods to use. Common methods Interviews – Face-to-face – Focus group – Telephone – Skype / video conference Questionnaires.
Qualitative Assessment Methods Session 1.3 Qualitative Approaches for FS Assessments.
Gathering User Data IS 588 Dr. Dania Bilal Spring 2008.
The Business Skills Handbook Roy Horn - Chartered Institute of Personnel and Development The Business Skills Handbook.
Chapter 12 Observing Users Li, Jia Li, Wei. Outline What and when to observe Approaches to observation How to observe How to collect data Indirect observation.
Empathy Proto- typing Feedback Process Inventory How are you doing as an organization/in dividual in these three stages? What are you doing already for.
©2010 John Wiley and Sons Chapter 6 Research Methods in Human-Computer Interaction Chapter 6- Diaries.
Qualitative Research 2 Dr Shona Bettany.
LOOKING FOR EVIDENCE? A CASE FOR THE CASE STUDY DR. GURU NAGARAJAN DR. SARA BHATTACHARJI.
Quality Assessment July 31, 2006 Informing Practice.
CS2003 Usability Engineering Usability Evaluation Dr Steve Love.
Virtual University - Human Computer Interaction 1 © Imran Hussain | UMT Imran Hussain University of Management and Technology (UMT) Lecture 40 Observing.
Dr. Engr. Sami ur Rahman Assistant Professor Department of Computer Science University of Malakand Research Methods in Computer Science Lecture: Data Generation.
RESEARCH METHODS Lecture 20. SURVEY RESEARCH Two approaches to collect primary data 1. Observe  conditions, behavior, events, people, or processes 2.
Internet: Taking Learning Beyond the Classroom Walls Milpitas Christian School January 3, 2005 Gail Lovely –
USING A SPOKEN DIARY AND HEART RATE MONITOR IN MODELING HUMAN EXPOSURE TO AIRBORNE POLLUTANTS FOR EPA’S CONSOLIDATED HUMAN ACTIVITY DATABASE Curry I. Guinn,
CSCI 4163 / CSCI 6904 – Winter Housekeeping  Clarification about due date for reading comments/questions  Skills sheet  Active listening handout.
Housekeeping Seminar Topics doodle poll on facebook page – sign up by tomorrow night (Fri) please, and I’ll make the schedule this weekend Option to propose.
Survey Research.
CSCI 4163/6610 WINTER Housekeeping  Group membership update.
AVI/Psych 358/IE 340: Human Factors Data Gathering October 3, 2008.
Key principles Everything is strange –Question why? –Stop and reflect Members’ point of view –Developer themselves – why do that? No a priori expectations.
Research Methods Observations Interviews Case Studies Surveys Quasi Experiments.
Unit 2: Collecting Data & Survey Design The work of statisticians is highly valued as they provide everything needed by those coming from different background.
Descriptive Research & Questionnaire Design. Descriptive Research Survey versus Observation  Survey Primary data collection method based on communication.
CSCI 4163/6610 WINTER Q1: Observations allow you to: a) Learn about real world behaviours b) Learn about opinions and perspectives c) Both A &
Data gathering (Chapter 7 Interaction Design Text)
Evaluation and Assessment of Instructional Design Module #4 Designing Effective Instructional Design Research Tools Part 2: Data-Collection Techniques.
Chapter 2 Research Methods Please fill in your slides as we proceed.
Observation Direct observation in the field –Structuring frameworks –Degree of participation (insider or outsider) –Ethnography Direct observation in controlled.
Lecture 4 Supplement – Data Gathering Sampath Jayarathna Cal Poly Pomona Based on slides created by Ian Sommerville & Gary Kimura 1.
RTV 440 Week 1 Cell Phones Off and Put Away Chapters 1 & 9 Appendix 1.
02086 Writing Inspirations Aalto University
Lecture3 Data Gathering 1.
Conducting Effective Interviews
Observations contextual inquiry
Evaluation Styles Logic Model Generic Social Developmental
MGT-351 Human Resource Management Chapter-04
Evaluation of Mobile Interfaces
Conducting Design Research
FS Online Module Teacher's Manual
RESEARCH METHODS Lecture 20
Presentation transcript:

Housekeeping  Seminar topics  Requirements  Sign up by Feb 3rd :  Bonus 10% for those who do seminars the 1 st day (Feb 12 th ) and 5% for those who do seminars the 2 nd day (Feb 24 th )

CSCI 4163/6610 W2015

Advertising Diary Activity  Did you remember to fill it out?  When did you do it?  As encountered?  In a batch?  Were the instructions clear?  What was easy/hard about it?  Do you think it captured your exposure to advertising?

Diary studies…  Participants collect data about events  As they happen  In the context of the event (in situ)  Can think of like a small, longitudinal questionnaire  Often used to prompt interview discussion (similar to observations in a contextual inquiry)  Can help understand rare/infrequent events

Data collection methods  Survey style forms  Paper (little training required, but hard to monitor)  Online entry forms  Google docs  Photographs, video  Digital/disposable camera, mobile phone  Audio recording  Voice recorder, mobile phone  Aggregating data online  Blogs (text, audio, video), Twitter  Rich and timely information

Type of data recorded  When  Date/time  Duration  Activity/task  What  Activity/task  feelings/mood  Context (environment/setting)

When is data recorded?  Randomly  In response to prompts  At specific intervals  Based on activity

General types of diary studies  Unstructured  Ask participants to report on everyday activities  Trying to elicit general themes  Structured  Ask participants to report on everyday activities by answering specific questions about the activity  Combination of question types  Can also be used as a form of usability tests and problem reports  Ask them to complete a task and report results, identify bugs, etc.

Variations based on purpose Feedback (now)Elicitation (later)  Record everything in situ  No follow up  Focus on the “what” data  Mostly structured  Can be burdensome on participants and researchers  Record aspects or triggers of an activity  Follow up with an interview to gain more information  Data captured is used to elicit the “why” and the how”  Mostly unstructured  Can be problems with participant recall

Cultural Probe  Diary study++  Used to not only record activities, but capture more of “felt life”  Stimulate thought as well as capture experiences  - pack contained a small disposable camera and a listening glass that participants used to listen at walls and doors and write what they heard. It also contained a small solid state recorder packaged in a sleeve that said 'dream recorder'.  Was used by designers at the Royal College of Art, London, to study the way people see their own homes. The results were used to enable designers to get a 'feel' of the meaning of home for many people.  Experience sampling method (measure feelings, moods)  Technology Probes (prototypes, experimental artifacts)

Snow Day Cultural Probe  Who took part? Did you do all activities? Or a subset? What was easy/hard as a participant?  Preamble:  Pretend that I've delivered you a probe kit that includes a camera, a note pad, and a paper map of the city. I want to understand how stormy winter weather impacts student life and poses barriers.  Complete the following activities:

Cultural Probe activity 1. Take a pictures of your "storm info central" - how do you find out about impending/current weather conditions and cancellations? 2. Take pictures of weather impeding your normal daily activities - if you are out and about, use your map to record your path (is it your normal one?) - link pictures to locations if you can 3. Take pictures of how you cope with the weather (any work arounds? alternative activities?) 4. In your notepad, jot down 3 things you like about a stormy day and 3 things that you don't like 5. How could technology have helped you? (jot down or sketch out ideas of technologies that could help you out - don't worry about feasibility - dream big!)

Coordination Challenges  Keeping participants on track  Periodic reminders  Feedback about the level of detail in responses  Progressive incentives, surprise incentives/gifts (may or may not be allowable by BREB)  Adapting to changes  Start analysis as soon as first results arrive  May need to re-evaluate the diary format if the data being captured is not what you expected!

Advantages  Time efficient for researchers  Lower cost than direct observations  Can have a broad geographic distribution  Supports contextual reports over time  Natural environment  Can give rich data about contexts of use

Disadvantages  Participant fatigue  Missed responses (frequency data is generally unreliable – lower bound)  Study drop outs  “after the fact” reporting to catch up  Behaviour adjustment  Participants need reminders  Can be expensive for long durations  Volume of collected data can be overwhelming

Study protocol  Introductory letter  Consent form  Needs to motivate their participation  Very specific instructions  Can be helpful to give an example of a filled out form (take care not to prime/limit)  Diary form / collection aids

Forms of analysis  Track temporal patterns  Look for semantic patterns in visual data  Combine with interview analysis