Topological Inference

Slides:



Advertisements
Similar presentations
Statistical Inference
Advertisements

SPM Course Zurich, February 2012 Statistical Inference Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London.
Mkael Symmonds, Bahador Bahrami
Random Field Theory Methods for Dummies 2009 Lea Firmin and Anna Jafarpour.
SPM for EEG/MEG Guillaume Flandin
Multiple comparison correction
Statistical Inference and Random Field Theory Will Penny SPM short course, London, May 2003 Will Penny SPM short course, London, May 2003 M.Brett et al.
Statistical Inference and Random Field Theory Will Penny SPM short course, Kyoto, Japan, 2002 Will Penny SPM short course, Kyoto, Japan, 2002.
Multiple comparison correction
Multiple testing Justin Chumbley Laboratory for Social and Neural Systems Research University of Zurich With many thanks for slides & images to: FIL Methods.
Topological Inference Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London SPM Course London, May 2014 Many thanks to Justin.
Multiple testing Justin Chumbley Laboratory for Social and Neural Systems Research Institute for Empirical Research in Economics University of Zurich With.
07/01/15 MfD 2014 Xin You Tai & Misun Kim
Multiple testing Justin Chumbley Laboratory for Social and Neural Systems Research Institute for Empirical Research in Economics University of Zurich With.
Multiple comparison correction Methods & models for fMRI data analysis 18 March 2009 Klaas Enno Stephan Laboratory for Social and Neural Systems Research.
Comparison of Parametric and Nonparametric Thresholding Methods for Small Group Analyses Thomas Nichols & Satoru Hayasaka Department of Biostatistics U.
Multiple comparison correction Methods & models for fMRI data analysis 29 October 2008 Klaas Enno Stephan Branco Weiss Laboratory (BWL) Institute for Empirical.
False Discovery Rate Methods for Functional Neuroimaging Thomas Nichols Department of Biostatistics University of Michigan.
Giles Story Philipp Schwartenbeck
General Linear Model & Classical Inference Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London SPM M/EEGCourse London, May.
Multiple Comparison Correction in SPMs Will Penny SPM short course, Zurich, Feb 2008 Will Penny SPM short course, Zurich, Feb 2008.
Random Field Theory Will Penny SPM short course, London, May 2005 Will Penny SPM short course, London, May 2005 David Carmichael MfD 2006 David Carmichael.
Basics of fMRI Inference Douglas N. Greve. Overview Inference False Positives and False Negatives Problem of Multiple Comparisons Bonferroni Correction.
Random field theory Rumana Chowdhury and Nagako Murase Methods for Dummies November 2010.
Computational Biology Jianfeng Feng Warwick University.
Multiple testing Justin Chumbley Laboratory for Social and Neural Systems Research Institute for Empirical Research in Economics University of Zurich With.
SPM Course Zurich, February 2015 Group Analyses Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London With many thanks to.
Multiple comparison correction Methods & models for fMRI data analysis October 2013 With many thanks for slides & images to: FIL Methods group & Tom Nichols.
Multiple comparisons in M/EEG analysis Gareth Barnes Wellcome Trust Centre for Neuroimaging University College London SPM M/EEG Course London, May 2013.
Methods for Dummies Random Field Theory Annika Lübbert & Marian Schneider.
Classical Inference on SPMs Justin Chumbley SPM Course Oct 23, 2008.
**please note** Many slides in part 1 are corrupt and have lost images and/or text. Part 2 is fine. Unfortunately, the original is not available, so please.
Random Field Theory Will Penny SPM short course, London, May 2005 Will Penny SPM short course, London, May 2005.
Random Field Theory Ciaran S Hill & Christian Lambert Methods for Dummies 2008.
Event-related fMRI Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London SPM Course Chicago, Oct 2015.
Spatial Smoothing and Multiple Comparisons Correction for Dummies Alexa Morcom, Matthew Brett Acknowledgements.
Multiple comparisons problem and solutions James M. Kilner
Topological Inference Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London SPM Course London, May 2015 With thanks to Justin.
Multiple comparison correction
False Discovery Rate for Functional Neuroimaging Thomas Nichols Department of Biostatistics University of Michigan Christopher Genovese & Nicole Lazar.
What a Cluster F… ailure!
Group Analyses Guillaume Flandin SPM Course London, October 2016
Statistical Analysis of M/EEG Sensor- and Source-Level Data
General Linear Model & Classical Inference
Inference on SPMs: Random Field Theory & Alternatives
Statistical Inference
Wellcome Trust Centre for Neuroimaging University College London
Detecting Sparse Connectivity: MS Lesions, Cortical Thickness, and the ‘Bubbles’ Task in an fMRI Experiment Keith Worsley, Nicholas Chamandy, McGill Jonathan.
Methods for Dummies Random Field Theory
Thomas Nichols, Ph.D. Assistant Professor Department of Biostatistics
Multiple comparisons in M/EEG analysis
M/EEG Statistical Analysis & Source Localization
The General Linear Model (GLM)
Topological Inference
Contrasts & Statistical Inference
Inference on SPMs: Random Field Theory & Alternatives
The General Linear Model
Inference on SPMs: Random Field Theory & Alternatives
Inference on SPMs: Random Field Theory & Alternatives
Statistical Parametric Mapping
The general linear model and Statistical Parametric Mapping
The General Linear Model
M/EEG Statistical Analysis & Source Localization
Contrasts & Statistical Inference
The General Linear Model
Multiple testing Justin Chumbley Laboratory for Social and Neural Systems Research Institute for Empirical Research in Economics University of Zurich.
Multiple testing Justin Chumbley Laboratory for Social and Neural Systems Research Institute for Empirical Research in Economics University of Zurich.
Statistical Inference
The General Linear Model
Contrasts & Statistical Inference
Presentation transcript:

Topological Inference Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London Many thanks to Justin Chumbley and Tom Nichols for slides SPM Course London, May 2010

Statistical Inference Random Field Theory   Contrast c Pre- processings General Linear Model Statistical Inference      

Statistical Parametric Maps mm time frequency mm time 2D time-frequency mm 2D+t scalp-time fMRI, VBM, M/EEG source reconstruction mm mm

Inference at a single voxel u Null Hypothesis H0: zero activation Decision rule (threshold) u: determines false positive rate α  Choose u to give acceptable α under H0 Null distribution of test statistic T  

Multiple tests α=0.05  5,000 false positive voxels. u u u u u u If we have 100,000 voxels, α=0.05  5,000 false positive voxels. This is clearly undesirable; to correct for this we can define a null hypothesis for a collection of tests. t  u Noise Signal

Multiple tests α=0.05  5,000 false positive voxels. u u u u u u If we have 100,000 voxels, α=0.05  5,000 false positive voxels. This is clearly undesirable; to correct for this we can define a null hypothesis for a collection of tests. t  u 11.3% 12.5% 10.8% 11.5% 10.0% 10.7% 11.2% 10.2% 9.5% Use of ‘uncorrected’ p-value, α =0.1 Percentage of Null Pixels that are False Positives

Family-Wise Null Hypothesis Activation is zero everywhere If we reject a voxel null hypothesis at any voxel, we reject the family-wise Null hypothesis A FP anywhere in the image gives a Family Wise Error (FWE) Family-Wise Error rate (FWER) = ‘corrected’ p-value FWE Use of ‘corrected’ p-value, α =0.1 Use of ‘uncorrected’ p-value, α =0.1

Bonferroni correction The Family-Wise Error rate (FWER), αFWE, for a family of N tests follows the inequality: where α is the test-wise error rate.   Therefore, to ensure a particular FWER choose:   This correction does not require the tests to be independent but becomes very stringent if dependence.

Spatial correlations 100 x 100 independent tests Spatially correlated tests (FWHM=10) Discrete data Spatially extended data Bonferroni is too conservative for spatial correlated data.  

lattice representation Random Field Theory  Consider a statistic image as a discretisation of a continuous underlying random field.  Use results from continuous random field theory. lattice representation

Collection of discrete tests  continuous field

Topological inference Topological feature: Peak height space intensity u significant local maxima non significant local maxima

Topological inference Topological feature: Cluster extent space intensity         uclus significant cluster non significant clusters

Topological inference Topological feature: Number of clusters space intensity         uclus Here, c=1, only one cluster larger than k.

Terminology Random field f() (spatial stochastic process) Search volume  Excursion sets of f over  and above the level u:   Cluster (extent = # voxels)

      No holes Zero or one blob  

Expected Euler Characteristic   2D Gaussian Random Field  : search region ( : volume ||1/2 : roughness (1 / smoothness)  

Smoothness Smoothness parameterised in terms of FWHM: Size of Gaussian kernel required to smooth i.i.d. noise to have same smoothness as observed null (standardized) data. FWHM   1 2 3 4 6 8 10 5 7 9 Eg: 10 voxels, 2.5 FWHM, 4 RESELS The number of resels is similar, but not identical to the number independent observations. Smoothness estimated from spatial derivatives of standardised residuals: Yields an RPV image containing local roughness estimation.

Random Field intuition Corrected p-value for statistic value t    

Random Field: Unified Theory General form for expected Euler characteristic • t, F & 2 fields • restricted search regions • D dimensions •     rd (u) : d-dimensional EC density of the field – function of dimension and threshold, specific for RF type: E.g. Gaussian RF: r0(u) = 1- (u) r1(u) = (4 ln2)1/2 exp(-u2/2) / (2p) r2(u) = (4 ln2) u exp(-u2/2) / (2p)3/2 r3(u) = (4 ln2)3/2 (u2 -1) exp(-u2/2) / (2p)2 r4(u) = (4 ln2)2 (u3 -3u) exp(-u2/2) / (2p)5/2 

Peak, cluster and set level inference Regional specificity Sensitivity : significant at the set level : significant at the cluster level : significant at the peak level L1 > spatial extent threshold L2 < spatial extent threshold Peak level test: height of local maxima Cluster level test: spatial extent above u Set level test: number of clusters above u  

Random Field Theory The statistic image is assumed to be a good lattice representation of an underlying continuous stationary random field. Typically, FWHM > 3 voxels (combination of intrinsic and extrinsic smoothing) Smoothness of the data is unknown and estimated: very precise estimate by pooling over voxels  stationarity assumptions (esp. relevant for cluster size results). RFT conservative for low degrees of freedom (always compare with Bonferroni correction). Afford littles power for group studies with small sample size. A priori hypothesis about where an activation should be, reduce search volume  Small Volume Correction: mask defined by (probabilistic) anatomical atlases mask defined by separate "functional localisers" mask defined by orthogonal contrasts (spherical) search volume around previously reported coordinates

Conclusion There is a multiple testing problem and corrections have to be applied on p-values (for the volume of interest only (see SVC)). Inference is made about topological features (peak height, spatial extent, number of clusters). Use results from the Random Field Theory. Control of FWER (probability of a false positive anywhere in the image): very specific, not so sensitive. Control of FDR (expected proportion of false positives amongst those features declared positive (the discoveries)): less specific, more sensitive.

References Friston KJ, Frith CD, Liddle PF, Frackowiak RS. Comparing functional (PET) images: the assessment of significant change. J Cereb Blood Flow Metab. 1991 Jul;11(4):690-9. Worsley KJ, Marrett S, Neelin P, Vandal AC, Friston KJ, Evans AC. A unified statistical approach for determining significant signals in images of cerebral activation. Human Brain Mapping 1996;4:58-73. Chumbley J, Worsley KJ , Flandin G, and Friston KJ. Topological FDR for neuroimaging. NeuroImage, 49(4):3057-3064, 2010. Chumbley J and Friston KJ. False Discovery Rate Revisited: FDR and Topological Inference Using Gaussian Random Fields. NeuroImage, 2008. Kilner J and Friston KJ. Topological inference for EEG and MEG data. Annals of Applied Statistics, in press. http://www.fil.ion.ucl.ac.uk/spm/doc/biblio/Keyword/RFT.html