MVPA Tutorial Last Update: January 18, 2012 Last Course: Psychology 9223, W2010, University of Western Ontario Last Update:

Slides:



Advertisements
Similar presentations
G53MLE | Machine Learning | Dr Guoping Qiu
Advertisements

Ensemble Learning Reading: R. Schapire, A brief introduction to boosting.
On-line learning and Boosting
Introduction to Functional MRI Last Update: January 14, 2013 Last Course: Psychology 9223, W2013 Jody Culham Brain and Mind.
1 SSS II Lecture 1: Correlation and Regression Graduate School 2008/2009 Social Science Statistics II Gwilym Pryce
A (very) brief introduction to multivoxel analysis “stuff” Jo Etzel, Social Brain Lab
Analysis of variance (ANOVA)-the General Linear Model (GLM)
Circular analysis in systems neuroscience – with particular attention to cross-subject correlation mapping Nikolaus Kriegeskorte Laboratory of Brain and.
2D1431 Machine Learning Boosting.
Lecture 5 Outline – Tues., Jan. 27 Miscellanea from Lecture 4 Case Study Chapter 2.2 –Probability model for random sampling (see also chapter 1.4.1)
Hypothesis Testing: Type II Error and Power.
Evaluation.
Mean for sample of n=10 n = 10: t = 1.361df = 9Critical value = Conclusion: accept the null hypothesis; no difference between this sample.
CSSE463: Image Recognition Day 31 Due tomorrow night – Project plan Due tomorrow night – Project plan Evidence that you’ve tried something and what specifically.
Lorelei Howard and Nick Wright MfD 2008
1 Formal Evaluation Techniques Chapter 7. 2 test set error rates, confusion matrices, lift charts Focusing on formal evaluation methods for supervised.
How To Do Multivariate Pattern Analysis
CSSE463: Image Recognition Day 21 Upcoming schedule: Upcoming schedule: Exam covers material through SVMs Exam covers material through SVMs.
CSSE463: Image Recognition Day 27 This week This week Last night: k-means lab due. Last night: k-means lab due. Today: Classification by “boosting” Today:
1 CSI5388: Functional Elements of Statistics for Machine Learning Part I.
Analysis of fMRI data with linear models Typical fMRI processing steps Image reconstruction Slice time correction Motion correction Temporal filtering.
Psy B07 Chapter 4Slide 1 SAMPLING DISTRIBUTIONS AND HYPOTHESIS TESTING.
FMRI Group Natasha Matthews, Ashley Parks, Destiny Miller, Ziad Safadi, Dana Tudorascu, Julia Sacher. Adviser: Mark Wheeler.
Current work at UCL & KCL. Project aim: find the network of regions associated with pleasant and unpleasant stimuli and use this information to classify.
1 CS 391L: Machine Learning: Experimental Evaluation Raymond J. Mooney University of Texas at Austin.
Independent Samples 1.Random Selection: Everyone from the Specified Population has an Equal Probability Of being Selected for the study (Yeah Right!)
So you want to run an MVPA experiment… Lindsay Morgan April 9, 2012.
The Campbell Collaborationwww.campbellcollaboration.org C2 Training: May 9 – 10, 2011 Introduction to meta-analysis.
Today Ensemble Methods. Recap of the course. Classifier Fusion
Ensemble Learning Spring 2009 Ben-Gurion University of the Negev.
Proportions. A proportion is the fraction of individuals having a particular attribute.
MVPD – Multivariate pattern decoding Christian Kaul MATLAB for Cognitive Neuroscience.
A comparison of methods for characterizing the event-related BOLD timeseries in rapid fMRI John T. Serences.
CSSE463: Image Recognition Day 33 This week This week Today: Classification by “boosting” Today: Classification by “boosting” Yoav Freund and Robert Schapire.
Functional Brain Signal Processing: EEG & fMRI Lesson 14
Copyright © 2005 Pearson Education, Inc. Slide 6-1.
C O R P O R A T E T E C H N O L O G Y Information & Communications Neural Computation Machine Learning Methods on functional MRI Data Siemens AG Corporate.
Introducing Communication Research 2e © 2014 SAGE Publications Chapter Seven Generalizing From Research Results: Inferential Statistics.
Psychology 202a Advanced Psychological Statistics October 20, 2015.
AGENDA Review In-Class Group Problems Review. Homework #3 Due on Thursday Do the first problem correctly Difference between what should happen over the.
Statistical Analysis An Introduction to MRI Physics and Analysis Michael Jay Schillaci, PhD Monday, April 7 th, 2007.
… Algo 1 Algo 2 Algo 3 Algo N Meta-Learning Algo.
ECE 8443 – Pattern Recognition ECE 8527 – Introduction to Machine Learning and Pattern Recognition Objectives: Statistical Significance Hypothesis Testing.
Commentary + Proposal Guidelines Last Update: March 17, 2013 Last Course: Psychology 9223, W2013, Western University Jody.
Hypothesis Testing. Suppose we believe the average systolic blood pressure of healthy adults is normally distributed with mean μ = 120 and variance σ.
Box and Whisker Plots Example: Comparing two samples.
FMRI Techniques to Investigate Neural Coding: Multivoxel Pattern Analysis (MVPA) Last Update: January 18, 2012 Last Course:
Pairwise comparisons: Confidence intervals Multiple comparisons Marina Bogomolov and Gili Baumer.
Multivariate analysis (Machine learning) Supervised True answer is known Classification Answer is categorical Regression Answer is continuous (ordered.
Machine Learning: Ensemble Methods
Introduction For inference on the difference between the means of two populations, we need samples from both populations. The basic assumptions.
Jody Culham Brain and Mind Institute Department of Psychology
LECTURE 33: STATISTICAL SIGNIFICANCE AND CONFIDENCE (CONT.)
Chapter 2 Simple Comparative Experiments
Slicer fMRI introduction
Combining Base Learners
Hypothesis Tests for Two Population Proportions
I. Statistical Tests: Why do we use them? What do they involve?
Tutorial 9 Suppose that a random sample of size 10 is drawn from a normal distribution with mean 10 and variance 4. Find the following probabilities:
EM for Inference in MV Data
Sheng Li, Stephen D. Mayhew, Zoe Kourtzi  Neuron 
Timothy J. Vickery, Marvin M. Chun, Daeyeol Lee  Neuron 
Volume 93, Issue 2, Pages (January 2017)
Metabolic Network Prediction of Drug Side Effects
Ensemble learning.
Yukiyasu Kamitani, Frank Tong  Current Biology 
Deciphering Cortical Number Coding from Human Brain Activity Patterns
Adaptive multi-voxel representation of stimuli, rules and responses
EM for Inference in MV Data
John T. Serences, Geoffrey M. Boynton  Neuron 
Presentation transcript:

MVPA Tutorial Last Update: January 18, 2012 Last Course: Psychology 9223, W2010, University of Western Ontario Last Update: March 10, 2013 Last Course: Psychology 9223, W2013, Western University Jody Culham Brain and Mind Institute Department of Psychology Western University

Test Data Set Two runs: A and B (same protocol) 5 trials per condition for 3 conditions

Measures of Activity β weights –z-normalized –%-transformed t-values –β/error % BOLD signal change –minus baseline low activity high activity low t low β z low β % high t high β z high β %

Step 1: Trial Estimation Just as in the Basic GLM, we are running one GLM per voxel Now however, each GLM is estimating activation not across a whole condition but for each instance (trial or block) of a condition

Three Predictors Per Instance 2-gammaconstantlinear within trial 5 instances of motor imagery 5 instances of mental calculation 5 instances of mental singing

Step 1: Trial Estimation Dialog

Step 1: Trial Estimation Output Now for each instance of each condition in each run, for each voxel we have an estimate of activation

Step 2: Support Vector Machine SVMs are usually run in a subregion of the brain –e.g., a region of interest (= volume of interest) sample data: SMA ROI sample data: 3 Tasks ROI

Step 2: Support Vector Machine test data must be independent of training data –leave-one-run-out –leave-one-trial-out –leave-one-trial-set-out often we will run a series of iterations to test multiple combinations of leave-X-out –e.g., with two runs, we can run two iterations of leave-one-run-out –e.g., with 10 trials per condition and 3 conditions, we could run up to 10 3 = 1000 iterations of leave-one-trial-set-out

MVP file plots 98 functional voxels 15 trials Run A = training set Run B = test set intensity = activation

SVM Output: Train Run A; Test Run B Guessed Condition Actual Condition Guessed Condition Actual Condition                               15/15 correct 10/15 correct (chance = 5/15)

SVM Output: Train Run B; Test Run A

Permutation Testing randomize all the condition labels run SVMs on the randomized data repeat this many times (e.g., 1000X) get a distribution of expected decoding accuracy test the null hypothesis (H 0 ) that the decoding accuracy you found came from this permuted distribution

Output from Permutation Testing median of permuted distribution (should be 33.3%) upper quartile of permuted distribution lower quartile of permuted distribution upper bound of 95% confidence limits on permuted distribution our data  reject H 0

Voxel Weight Maps voxels with high weights contribute strongly to the classification of a trial to a given condition