CSCI 4163/6610 WINTER 2015. Q1: Observations allow you to: a) Learn about real world behaviours b) Learn about opinions and perspectives c) Both A &

Slides:



Advertisements
Similar presentations
The 21st Century Context for
Advertisements

Shell Interview Skills Presentation
Appreciative Enquiry (AI) Friday 21 st March 2014.
Testing through user observations User Observation: Guidelines for Apple Developers, Kathleen Gomoll & Anne Nicol, January 1990 Notes based on:
Qualitative and Observational Research
Agile Usability Testing Methods
HOW DO PROFESSIONAL DEVELOPERS COMPREHEND TO SOFTWARE Report submitted by Tobias Roehm, Rebecca Tiarks, Rainer Koschke, Walid Maalej.
CSCI 4163/6904, Summer Diary studies…  Participants collect data about events  As they happen  In the context of the event (in situ)  Can think.
Assessment. Why Assess  to find out what students have learned  to determine what further teaching is needed  Teachers should –plan a balanced assessment.
Case Studies in Assistive Technology
Recruitment of online tutors Sharon Slade, Fenella Galpin OU Business School.
Contextual Inquiry By: Irvin, Dallas Juan, and Elaine.
Information & Interaction Design Fall 2005 Bill Hart-Davidson Session 6: analyzing work practices – rationale and challenges; the 5 Contextual Design work.
Chapter 5 The Probing Interview. © 2009 The McGraw-Hill Companies, Inc. All rights reserved. Chapter Summary Preparing the Interview Selecting Interviewees.
Data collection methods Questionnaires Interviews Focus groups Observation –Incl. automatic data collection User journals –Arbitron –Random alarm mechanisms.
Q ualitative Interview AGST 3000 Agriculture, Society and the Natural World.
1 © 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation See the PDE booklet, Collecting evaluation data:
TEAM MANAGEMENT SERIES: COACHING INDIVIDUAL PERFORMANCE UCP Central PA Supervisor Meeting November 20, 2014.
Lecture 3 Teaching Listening
CSCI 4163 / CSCI 6904 – Winter Housekeeping  Write a question/comment about today’s reading on the whiteboard (chocolate!)  Make sure to sign.
CHANGING BEHAVIOR CHERYL B. ASPY, PH.D. Motivational Interviewing.
SOCIAL MARKETING RESEARCH. OUTLINE When to do research Types of research –Formative –Process –Post-tests How to choose.
Housekeeping  Seminar topics  Requirements  Sign up by Feb 3rd :  Bonus.
© 2013 by Nelson Education1 Selection III: Interviewing.
Evidence based research in education Cathy Gunn University of Auckland.
CSCI 4163/6904, summer Quiz  Multiple choice  Answer individually - pass in  Then class discussion.
Assessing Program Quality with the Autism Program Environment Rating Scale.
Qualitative Assessment Methods Session 1.3 Qualitative Approaches for FS Assessments.
Chapter 12 Observing Users Li, Jia Li, Wei. Outline What and when to observe Approaches to observation How to observe How to collect data Indirect observation.
©2010 John Wiley and Sons Chapter 6 Research Methods in Human-Computer Interaction Chapter 6- Diaries.
CS2003 Usability Engineering Usability Evaluation Dr Steve Love.
Methodology Matters: Doing Research in the Behavioral and Social Sciences ICS 205 Ha Nguyen Chad Ata.
Dr. Engr. Sami ur Rahman Assistant Professor Department of Computer Science University of Malakand Research Methods in Computer Science Lecture: Data Generation.
Gathering SoTL Evidence: Methods for Systematic Inquiry into Student Learning Renee A. Meyers Coordinator, UWS SoTL Leadership Site Faculty College, May.
Foundations of Sociological Inquiry Doing Qualitative Field Research.
3 FACTORS THAT INFLUENCE EWT 1.Anxiety 2.Age of Witness 3.Misleading Information What research/studies are associated with each of the factors below… Coxon.
Scientific Inquiry Learning Goal: We will be able to validate observations as real or inferences.
Task Analysis Methods IST 331. March 16 th
CSCI 4163 / CSCI 6904 – Winter Housekeeping  Clarification about due date for reading comments/questions  Skills sheet  Active listening handout.
Recruit, Train, and Educate Airmen to Deliver Airpower for America How Focus Groups Can Help Your Unit 1.
Interviewing for Dissertation Research But these ideas apply to many types of interviewing.
Housekeeping Seminar Topics doodle poll on facebook page – sign up by tomorrow night (Fri) please, and I’ll make the schedule this weekend Option to propose.
CSCI 4163/6610 WINTER Housekeeping  Group membership update.
The CAP Self-evaluation Survey Goal: to improve the assessment (the CAP survey is designed for a formative purpose)
Facilitate Group Learning
Education Performance Measures Session. Session Overview Combination of presentation and interactive components Time at the end of the session for Q&A.
Meeting Madness Running a Great Meeting. Why do we have meetings?
Fashion MARKETING TID1131. Types of research Quantitative research Information relating to numbers – quantity. Method - surveys Qualitative research To.
Steps in Planning a Usability Test Determine Who We Want To Test Determine What We Want to Test Determine Our Test Metrics Write or Choose our Scenario.
Welcome. Common Core State Standards? English Language Arts and Literacy in History/Social Studies, Science, and Technical Subjects Mathematical Practice.
University of Southern California Center for Systems and Software Engineering Core Capability Drive-Through Preparation Pongtip Aroonvatanaporn CSCI 577b.
Developing coaching skills
A year in the life of a team coach Joanne James Head of Corporate and Executive Development Newcastle Business School.
Some general tips for the interviews. Interviews Data collection method used to discover opinions held by users Works better for qualitative research.
Introduction and questioning Level 3 Extended Diploma Unit 12 IT Technical Support.
Chapter 5 The Probing Interview. Chapter Summary Preparing the Interview Selecting Interviewees and Interviewers Conducting the Interview Preparing the.
Copyright ©2011 Brooks/Cole, Cengage Learning Gathering Useful Data for Examining Relationships Observation VS Experiment Chapter 6 1.
Project Breakdowns HCDE 492/592 Winter 2014.
Usability Testing 3 CPSC 481: HCI I Fall 2014 Anthony Tang.
Observations contextual inquiry
Interview Techniques when talking to People
MGT-351 Human Resource Management Chapter-04
Lecture 2: Discovering what people can't tell you: Contextual Inquiry and Analysis Methodology Brad Myers / : Introduction to Human Computer.
From Controlled to Natural Settings
The BIG Idea INTERVIEWS
Executive Directors do it all… How can WE do it even better?
Lecture 2: Discovering what people can't tell you: Contextual Inquiry and Analysis Methodology Brad Myers / : Introduction to Human Computer.
Core Capability Drive-Through Workshop
Mock Job Interviews 2/17/2017.
Chapter 14 INTRODUCING EVALUATION
Presentation transcript:

CSCI 4163/6610 WINTER 2015

Q1: Observations allow you to: a) Learn about real world behaviours b) Learn about opinions and perspectives c) Both A & B d) Neither A nor B

Q2: Observations are a good choice… A. When you are trying to understand an ongoing behaviour or process B. When there is physical evidence, products, or outcomes that can be readily seen C. When you want direct information D. All of the above

Q3: Disadvantages of observation include… A) Can only be used in natural settings B) The observer’s presence may create an artificial situation C) Both A & B D) Neither A nor B

Q4: If unobtrusive, observations allow you to… A) see things in their natural context B) see things that may escape conscious awareness, things that are not seen by others C) discover things that may have been taken for granted D) All of the above

Q5: To preserve ecological validity, you must make sure the _____ is/are representative of usual behaviours A. Task B. Setting C. Tools D. All of the above

Big disadvantage of pure (unobtrusive) observation…  Can be hard to understand why the behaviours/activities are happeny….

Contextual inquiry  Interviewees are interviewed in their context, when doing their tasks, with as little interference from the interviewer as possible.  Allows probing of “why?”  Can be real-time or record interesting actions for later discussion

“Typical” 4 phased approach  Traditional interview  Get an overview, establish trust, start recording  Switch to a master-apprentice relationship  Tell them what you want to observe  Make sure to establish when ok to interrupt  Observe, ask questions  Take notes  Balance need to understand with impact of interruptions  Summarization  Go over observations and your understanding with participant  Make sure that you go it right

Other ways of providing context  If natural observation not possible, can ask them to demonstrate specific tasks of interest  Can provide task scenarios and ask them to perform  “Think aloud” protocols

Other ways of getting observational data  Logging  Screen recording (check out Camtasia)  Trace data  Read McGrath handout for a great discussion of ways to get observational data

Recent readings 1. Why did they do the research/study? a. What was the motivation? b. What were the research questions? 2. What was their approach? 3. Critique their study (Recruitment, running the study, analysis) a. what was good? b. What was bad?) c. Do you think that their findings are valid? 4. What would you do differently if you wanted to replicate/extend this research?

Homework  Friday’s tutorials: interview groups  Be a participant  Be an observer  Day of: submit quick feedback sheets for all that you took part in/observed  The next tutorial: submit a critique for ONE group  Advertising Diary exercise for Tues  Assigned reading w/ questions for Tues  Read McGrath’s Methodology Matters (submit questions) for Tues Feb 3rd