Julia Eka Rini Petra Christian University, Surabaya LTBI Atma Jaya, Jakarta.

Slides:



Advertisements
Similar presentations
BRAINSTORMING BURÇİN AKI WHAT IS BRAINSTORMING? Brainstorming is a group activity technique.It is designed to generate lots of ideas for solution.
Advertisements

Description of the Project The Consumer Operated Service Program (COSP) will study the impact of participating in a consumer-operated service by examining.
Testing through user observations User Observation: Guidelines for Apple Developers, Kathleen Gomoll & Anne Nicol, January 1990 Notes based on:
Conducting the Interview/Survey
Chapter 2 Psychological Research Methods and Statistics
Conducting Interviews
Talk Moves in Math While teachers of both younger and older children work hard to provide their students with the best literacy experiences, oral language.
6.811 / PPAT: Principles and Practice of Assistive Technology Wednesday, 16 October 2013 Prof. Rob Miller Today: User Testing.
Client survey Data collection team training presentation template.
Asper School of Business University of Manitoba Systems Analysis & Design Instructor: Bob Travica Determining systems requirements Updated: September 2014.
Deciding How to Measure Usability How to conduct successful user requirements activity?
A Student’s Guide to Methodology Justifying Enquiry 3 rd edition P ETER C LOUGH AND C ATHY N UTBROWN.
1 RUNNING a CLASS (2) Pertemuan Matakuliah: G0454/Class Management & Education Media Tahun: 2006.
Classroom Management.
Research Methods Lab In-Depth Interviews. Why Interviews? A major advantage of the interview is its adaptability A skillful interviewer can follow up.
Think-aloud usability experiments or concurrent verbal accounts Judy Kay CHAI: Computer human adapted interaction research group School of Information.
The Information School of the University of Washington Interviews: Analyzing interviews/practicing interviewing.
Effective Use of Interpreters Adopted from St. Mary’s Interpreter Services References: The Medical Interview Across Cultures, Debra Buchwald, MD: Patient.
“Retrospective vs. concurrent think-aloud protocols: usability testing of an online library catalogue.” Presented by: Aram Saponjyan & Elie Boutros.
RESEARCH METHODS IN EDUCATIONAL PSYCHOLOGY
Qualitative research methods. Qualitative research You need to be able to explain: what qualitative research is, and why it is controversial. The controversy.
 It is a master plan that specifies the methods and procedures for collecting data and analyzing the needed information (Zikmund et al, 2010)  It involves.
Key Forms of Nonfiction Name _______________ Mrs. S’ class.
“Thank you for agreeing to fill out our evaluation survey”
Cultural Anthropology. Viewing Culture as Successive Levels.
Chapter 7 | ProStart Year 1
Chapter 7 Communication.
Connecting Data Collection to the Behavior Intervention Plan Hartford Public Schools Special Education Department
Experimental Research Methods in Language Learning Chapter 8 A Hybrid Approach for Experimental Research.
B 203: Qualitative Research Techniques Interpretivism Symbolic Interaction Hermeneutics.
Gathering User Data IS 588 Dr. Dania Bilal Spring 2008.
Data Collection Methods
Negotiating access, ethics and the problems of ‘inside’ research.
Listening Strategies for Tutoring. Listening Students spend 20% of all school related hours just listening. If television watching and just half of the.
Auditory Study Skills Presented by: Delphi Carlos Bruce.
1 Usability Studies. 2 Evaluate Usability Run a usability study to judge how an interface facilitates tasks with respect to the aspects of usability mentioned.
CS2003 Usability Engineering Usability Evaluation Dr Steve Love.
Usability Testing: Role Playing as an Illustration Defining experimental tasks Recording stuff Identifying problems  changes Leading to A6 Presented by.
COMP5047 Pervasive Computing: 2012 Think-aloud usability experiments or concurrent verbal accounts Judy Kay CHAI: Computer human adapted interaction research.
Quantitative and Qualitative Approaches
Chapter 15 Qualitative Data Collection Gay, Mills, and Airasian
Dr. Engr. Sami ur Rahman Assistant Professor Department of Computer Science University of Malakand Research Methods in Computer Science Lecture: Data Generation.
The product of evaluation is knowledge. This could be knowledge about a design, knowledge about the user or knowledge about the task.
Lesson 12.1The Interview Process and Preparation Lesson 12.2The Interview Lesson 12.3After the Interview 12 CHAPTER Interviewing for a Job ©2013 Cengage.
Writing the Research Paper: Part 1 Senior Projects
Step 5 Training Session: Interview Techniques. Questions Generate useful information Generate useful information Focus on reasons or motives Focus on.
Survey Methodology Survey Instruments (1) EPID 626 Lecture 7.
Informative Speeches. What is an informative speech? Speech that conveys knowledge and understanding Survey says..... Informative speeches rated #1 most.
9.351 Systems Analysis & DesignRequirements Determination1 Requirement Determination Collecting information that specify what system needs to do/support.
Copyright 2010, The World Bank Group. All Rights Reserved. Testing and Documentation Part II.
Cultural Anthropology. Cultural Anthropology -- an academic discipline.
Chapter 23 Deciding how to collect data. UIDE Chapter 23 Introduction: Preparing to Collect Evaluation Data Timing and Logging Actions –Automatic Logging.
Paper III Qualitative research methodology.  Qualitative research is designed to reveal a specific target audience’s range of behavior and the perceptions.
Observation. What is Observation? Observation is a systematic data collection approach. Researchers use all of their senses to examine people in natural.
What To Expect In Your Practicum: Classroom Management Jenny Harris.
Skills For Effective Communication
1 Chapter 2 Organization Create Consistent Organizational Patterns.
Searching and Using Electronic Literature III. Research Design.
Action Research. What is action research ? Action research - the process You notice a problem or issue in your class You think of a way of addressing.
By Daniel Keegan.
Summer Institutes Level 1 FRMCA Level 1, Chapter 7 Communication.
SIE 515 Design Evaluation Lecture 7.
Collecting Qualitative Data
Interviewing Techniques
Interviewing Techniques
Thoughts on HCI Requirements Elicitation
Why “Whole-Class?” Individualized reading instruction is typically not possible. “Anonymity” Modeling Efficient Multiple rewards Easy to implement.
Chapter 23 Deciding how to collect data
Using Verbal Reports for Data Collection and Analysis
Unit 6 Research and data collection techniques
Presentation transcript:

Julia Eka Rini Petra Christian University, Surabaya LTBI Atma Jaya, Jakarta

Action Survey IntrospectiveQualitative Research Research ResearchResearch Questionnaire Interviews CaseEthno- Studies graphies Verbal Diary Reports Studies Continuum of Research Methods (McKay 2006: 16)

Three types of Introspection based on the timing of the event concurrent introspection- collected while the research participants are doing the task. immediate retrospection ] done not at the same time delayed retrospection ] as the concurrent introspection

TAP Think-aloud protocols (TAPs) are the result of a data collection technique that involve verbal concurrent introspection. Introspective verbal reports

Nunan and Bailey (2009:287) a research subject talks about the process under investigation while he or she is engaged in doing that process …. As the person thinks aloud (i.e., talks about his current thought processes), his self-report is audiotape-or videotaped recorded. It is then transcribed and the written result is the “protocol

Translation research Translation product Translation process

Controversies of using TAP The problem of timing is not the issue altering cognitive processes rather than providing a true reflection of thoughts

Nunan and Bailey (2009: 287) Three levels of verbalization. The first level is simply reporting. In this level the person just says what he is doing; there is no need to describe (second level) or to explain (third level) the thought process.

Procedures in conducting verbal reports Provide students with a practice activity give simple directions be as unobtrusive as possible do not ask leading questions ask subjects to report their thought processes at a particular points in the text after they have read the text record the session pay attention to nonverbal behavior.

Practical guidelines Informed consent written explanation of the think-aloud procedure in plain language repeat the reason why participants are asked to think aloud should specify that their voice will be recorded and used in the publication and that they will be kept anonymous. also possible to give information about how their think- aloud will contribute to the field of research.

Practical guidelines continued Instruction for research participants We ask you to TALK ALOUD as you go through the program. What we mean by “talk aloud” is that we want you to say out loud everything that you would say to yourself silently while you think. Just act as if you were alone in the room speaking to yourself. Don’t try to explain your thoughts.

Practical guidelines continued Warm-up task for translation research non-verbal tasks Arithmetic problems verbal tasks Translating a short and easy text

Practical guidelines continued Timing in translation research Thinking aloud will surely increase the time in completing a task Time should not be limited

Practical guidelines continued Language used in think-aloud protocol Participants should be allowed to think in their first language

Practical guidelines continued Recording of think-aloud Audio recording Using handycam: also non-verbal Both