Distribution of Tau Distances Assessing Episodic and Semantic Contributions in Serial Recall Pernille Hemmer, Brent Miller & Mark Steyvers University of.

Slides:



Advertisements
Similar presentations
Contingency Table Analysis Mary Whiteside, Ph.D..
Advertisements

What makes an image memorable?
Bayesian Robust Principal Component Analysis Presenter: Raghu Ranganathan ECE / CMR Tennessee Technological University January 21, 2011 Reading Group (Xinghao.
Wisdom of Crowds in Human Memory: Reconstructing Events by Aggregating Memories across Individuals Mark Steyvers Department of Cognitive Sciences University.
Retrieval: How We Recall the Past from Episodic Memory
Wisdom of Crowds and Rank Aggregation Wisdom of crowds phenomenon: aggregating over individuals in a group often leads to an estimate that is better than.
Using Informative Priors to Enhance Wisdom in Small Crowds.
Wisdom of Crowds and Rank Aggregation Mark Steyvers Department of Cognitive Sciences University of California, Irvine Joint work with: Brent Miller, Pernille.
Relationship Between Sample Data and Population Values You will encounter many situations in business where a sample will be taken from a population, and.
Shavelson – Descriptive Statistics Variability Range Variance SD.
Lecture 2: Thu, Jan 16 Hypothesis Testing – Introduction (Ch 11)
Introduction In the western world, vascular disorders form a major medical problem. To increase knowledge of the underlying mechanisms of, for example,
Modeling fMRI data generated by overlapping cognitive processes with unknown onsets using Hidden Process Models Rebecca A. Hutchinson (1) Tom M. Mitchell.
Learning the Common Structure of Data Kristina Lerman and Steven Minton Presentation by Jeff Roth.
Chapter 9 Flashcards. measurement method that uses uniform procedures to collect, score, interpret, and report numerical results; usually has norms and.
STM - encoding Does the information stay in its original modality or is it re-coded in some way? Frying Pan.
Data and Data Collection Quantitative – Numbers, tests, counting, measuring Fundamentally--2 types of data Qualitative – Words, images, observations, conversations,
Choosing Statistical Procedures
Determining the Significance of Item Order In Randomized Problem Sets Zachary A. Pardos, Neil T. Heffernan Worcester Polytechnic Institute Department of.
The Role of Prior Knowledge in Human Reconstructive Memory Mark Steyvers Pernille Hemmer University of California, Irvine 1.
Hierarchical Bayesian Models for Aggregating Retrieved Memories across Individuals Mark Steyvers Department of Cognitive Sciences University of California,
Evaluate schema theory with reference to research studies
RMTD 404 Lecture 8. 2 Power Recall what you learned about statistical errors in Chapter 4: Type I Error: Finding a difference when there is no true difference.
SLB /04/07 Thinking and Communicating “The Spiritual Life is Thinking!” (R.B. Thieme, Jr.)
Cognitive Processes PSY 334 Chapter 7 – Human Memory: Retention and Retrieval May 16, 2003.
Topic 5 Statistical inference: point and interval estimate
Wisdom of Crowds and Rank Aggregation Mark Steyvers Department of Cognitive Sciences University of California, Irvine Joint work with: Brent Miller, Pernille.
MEMORY & INTELLIGENCE.
Serial Position Effects in Free Recall In a free recall task, you are given a list of words, one word at a time, and immediately afterwards you try to.
One-sample In the previous cases we had one sample and were comparing its mean to a hypothesized population mean However in many situations we will use.
Wisdom of Crowds in Human Memory: Reconstructing Events by Aggregating Memories across Individuals Mark Steyvers Department of Cognitive Sciences University.
Improving the Quality of Investigative Decision Making Craig Bennell, Ph.D. Carleton University Ottawa, Ontario, Canada
Decisions from Data: The Role of Simulation Gail Burrill Gail Burrill Michigan State University
Association between 2 variables
VI. Evaluate Model Fit Basic questions that modelers must address are: How well does the model fit the data? Do changes to a model, such as reparameterization,
Selecting and Recruiting Subjects One Independent Variable: Two Group Designs Two Independent Groups Two Matched Groups Multiple Groups.
Part III Taking Chances for Fun and Profit Chapter 8 Are Your Curves Normal? Probability and Why it Counts.
Chapter 6 USING PROBABILITY TO MAKE DECISIONS ABOUT DATA.
Indian and Northern Affaires indiennes Affairs Canada et du Nord Canada First Nation and Inuit Community Well-Being : Describing Historical Trends ( )
A Model for Learning the Semantics of Pictures V. Lavrenko, R. Manmatha, J. Jeon Center for Intelligent Information Retrieval Computer Science Department,
Cognitive Level of Analysis. Principles of Cognitive Level of Analysis 1.Mental processes guide behavior. 2.There is a biological basis for cognitive.
Statistical Inference for the Mean Objectives: (Chapter 9, DeCoursey) -To understand the terms: Null Hypothesis, Rejection Region, and Type I and II errors.
Section 10.1 Estimating with Confidence AP Statistics February 11 th, 2011.
: An alternative representation of level of significance. - normal distribution applies. - α level of significance (e.g. 5% in two tails) determines the.
Acknowledgments We thank Dr. Yu, Dr. Bateman, and Professor Szabo for allowing us to conduct this study during their class time. We especially thank the.
1 Differences Between Observed and Latent Confidence in Rank Ordering Brent J. Miller Mark Steyvers University of California, Irvine.
Chapter 6: Analyzing and Interpreting Quantitative Data
Repetition blindness for novel objects 作 者: Veronika Cotheart et al. 報告者:李正彥 日 期: 2006/3/30.
MEMORY & INTELLIGENCE. MEMORY: The input, storage, and retrieval of what has been learned or experienced.
Education 793 Class Notes Inference and Hypothesis Testing Using the Normal Distribution 8 October 2003.
BIOSTATISTICS Lecture 2. The role of Biostatisticians Biostatisticians play essential roles in designing studies, analyzing data and creating methods.
Outline of Today’s Discussion 1.Displaying the Order in a Group of Numbers: 2.The Mean, Variance, Standard Deviation, & Z-Scores 3.SPSS: Data Entry, Definition,
KUHL, B.A., JOHNSON, M.K., AND CHUN, M.M. (2013). DISSOCIABLE NEURAL MECHANISMS FOR GOAL-DIRECTED VERSUS INCIDENTAL MEMORY REACTIVATION. THE JOURNAL OF.
Statistical Inference for the Mean Objectives: (Chapter 8&9, DeCoursey) -To understand the terms variance and standard error of a sample mean, Null Hypothesis,
Lesson 3 Measurement and Scaling. Case: “What is performance?” brandesign.co.za.
Long Term Memory LONG TERM MEMORY (LTM)  Variety of information stored in LTM:  The capital of Turkey  How to drive a car.
Basics of Genome Annotation Daniel Standage Biology Department Indiana University.
Review of Power of a Test
ESTIMATION.
The Effects of Imagery on Name Recall
Topic 2 – Cognitive Psychology
Lesson 6 Normal and Skewed Distribution Type one and Type two errors.
Two-sided p-values (1.4) and Theory-based approaches (1.5)
Statistical Inference for the Mean Confidence Interval
Mark Steyvers Department of Cognitive Sciences
Using Informative Priors to Enhance Wisdom in Small Crowds
Effect of Prior Knowledge and Wisdom of Crowds
Rhythmic Working Memory Activation in the Human Hippocampus
Attentional Modulations Related to Spatial Gating but Not to Allocation of Limited Resources in Primate V1  Yuzhi Chen, Eyal Seidemann  Neuron  Volume.
Event Boundaries Trigger Rapid Memory Reinstatement of the Prior Events to Promote Their Representation in Long-Term Memory  Ignasi Sols, Sarah DuBrow,
Presentation transcript:

Distribution of Tau Distances Assessing Episodic and Semantic Contributions in Serial Recall Pernille Hemmer, Brent Miller & Mark Steyvers University of California, Irvine A Wisdom of Crowds Analysis Can we reconstruct the original order on the basis of the recalled orders of a group of individuals? How can memory models help us in this reconstruction process? The goal here is to show that the reconstructed order from a group of individuals is better than the recalled order from any particular individual – a wisdom of crowds effect. We developed a variant of the perturbation model (Estes et al., 1972) that can explain a number of memory errors in serial recall. In this model, items are originally encoded in the correct temporal sequence. Errors occur by locally perturbing the temporal encoding. In our variant of the model, we build in individual differences and item differences – assuming that some people have better memories (sigma parameter), and that some items are easier to rank (e.g., because they stand out temporally) Prior knowledge and expectations about events are known to influence episodic memory. Researchers often assume that prior knowledge leads to errors in recall. We investigate recall for the order of sequences of events, focusing on the potential benefit of prior knowledge. First, we assess the prior knowledge that people bring to the memory task. Second, we utilize memory tasks that are ecologically valid. The stimulus materials to be remembered have the same statistical regularities as can be found in the natural environment. The memory task involves a rank-ordering task in which people have to remember the study order of pictures of stereotyped and random event sequences. We expect to show that combining our knowledge of the regularities of the environment with these noisy memory representations improves the overall accuracy in episodic memory Introduction The Tasks Ten images were drawn from 6 different video clips. Three videos depicted stereotyped events sequences (getting up in the morning, a wedding, getting on the school bus) for which people have strong prior expectations. Three videos depicted more random event sequences (yogurt, pizza, claymation) for which people have weak prior expectations. Prior knowledge condition: Participants would order the randomized sequence of images based on their prior expectation and with out having previously viewed the images Memory condition: Participants would first study the correct sequence of images. They would then order the sequence from memory. probability for individual j that the item at the source position i gets perturbed to the destination position k. Original order Recalled order ABCDEFGH D Note: the mean tau expected for random sequences is 22.5 (=10*9/4) Median Tau to Truth Performance was measures using Kendall’s Tau: The number of adjacent pair-wise swaps between recalled and true order. = 1 = 1+1 Ordering by Individual ABECD True Order ABCDE C D E ABAB ABCDEABCDE = 2 Measuring Performance Data for Morning Sequence (see top banner) Inferred Model Parameters Example Random Sequences Example Stereotyped Event Sequence Best individualAverage IndividualInferred Item AccuracyCalibration of Individuals Participant number (first row) Tau score for each participant (second row) Tau scores indicate high accuracy from guessing with prior knowledge for stereotyped events For random events prior knowledge performance is similar to chance Taus are significantly lower for stereotyped (prior) than for random (no prior) events Taus in the memory task (study) are significantly lower than in the prior knowledge task (no study) Even when participants did not previously study the events, they performed better for all three stereotyped events Semantic and Episodic Contributions priorserial recall A B CD EFG H IJ AB CD EFG H IJ Data for Pizza Sequence (see bottom banner) priorserial recall Morning Sequence Wedding Sequence Pizza Sequence Clay Sequence Mean  Mean Performance of Individuals and Model(s) Note: the Thurstonian and Borda count model are two alternative models that were applied to this data