World Statistics Day 20.10.2010 Statisical Modelling of Complex Systems Jouko Lampinen Finnish Centre of Excellence in Computational Complex Systems Research.

Slides:



Advertisements
Similar presentations
Sampling Design, Spatial Allocation, and Proposed Analyses Don Stevens Department of Statistics Oregon State University.
Advertisements

Dynamic Spatial Mixture Modelling and its Application in Cell Tracking - Work in Progress - Chunlin Ji & Mike West Department of Statistical Sciences,
Bayesian inference Jean Daunizeau Wellcome Trust Centre for Neuroimaging 16 / 05 / 2008.
Insert Date HereSlide 1 Using Derivative and Integral Information in the Statistical Analysis of Computer Models Gemma Stephenson March 2007.
Evaluation of standard ICES stock assessment and Bayesian stock assessment in the light of uncertainty: North Sea herring as an example Samu MäntyniemiFEM,
INTRODUCTION TO MACHINE LEARNING Bayesian Estimation.
Bayesian Estimation in MARK
1 Approximated tracking of multiple non-rigid objects using adaptive quantization and resampling techniques. J. M. Sotoca 1, F.J. Ferri 1, J. Gutierrez.
Hidden Markov Models Reading: Russell and Norvig, Chapter 15, Sections
Learning to estimate human pose with data driven belief propagation Gang Hua, Ming-Hsuan Yang, Ying Wu CVPR 05.
Automatic Identification of Bacterial Types using Statistical Image Modeling Sigal Trattner, Dr. Hayit Greenspan, Prof. Shimon Abboud Department of Biomedical.
Artificial Intelligence Lecture 2 Dr. Bo Yuan, Professor Department of Computer Science and Engineering Shanghai Jiaotong University
Predictive Automatic Relevance Determination by Expectation Propagation Yuan (Alan) Qi Thomas P. Minka Rosalind W. Picard Zoubin Ghahramani.
Sérgio Pequito Phd Student
CSE 221: Probabilistic Analysis of Computer Systems Topics covered: Statistical inference (Sec. )
CSE 221: Probabilistic Analysis of Computer Systems Topics covered: Statistical inference.
Bayesian Methods for Monitoring Public Health Surveillance Data Owen Devine Division of STD Prevention National Center for HIV, STD and TB Prevention Centers.
Baysian Approaches Kun Guo, PhD Reader in Cognitive Neuroscience School of Psychology University of Lincoln Quantitative Methods 2011.
Introduction of Cancer Molecular Epidemiology Zuo-Feng Zhang, MD, PhD University of California Los Angeles.
HELSINKI UNIVERSITY OF TECHNOLOGY LABORATORY OF COMPUTER AND INFORMATION SCIENCE NEURAL NETWORKS RESEACH CENTRE Variability of Independent Components.
Chapter 8 Introduction to Hypothesis Testing
1 Bayesian methods for parameter estimation and data assimilation with crop models Part 2: Likelihood function and prior distribution David Makowski and.
Overview G. Jogesh Babu. Probability theory Probability is all about flip of a coin Conditional probability & Bayes theorem (Bayesian analysis) Expectation,
Particle Filtering in Network Tomography
The free-energy principle: a rough guide to the brain? K Friston Summarized by Joon Shik Kim (Thu) Computational Models of Intelligence.
WSEAS AIKED, Cambridge, Feature Importance in Bayesian Assessment of Newborn Brain Maturity from EEG Livia Jakaite, Vitaly Schetinin and Carsten.
1 A Presentation of ‘Bayesian Models for Gene Expression With DNA Microarray Data’ by Ibrahim, Chen, and Gray Presentation By Lara DePadilla.
BraMBLe: The Bayesian Multiple-BLob Tracker By Michael Isard and John MacCormick Presented by Kristin Branson CSE 252C, Fall 2003.
1 / 41 Inference and Computation with Population Codes 13 November 2012 Inference and Computation with Population Codes Alexandre Pouget, Peter Dayan,
Naive Bayes Classifier
Computer Science, Software Engineering & Robotics Workshop, FGCU, April 27-28, 2012 Fault Prediction with Particle Filters by David Hatfield mentors: Dr.
Particle Filters.
Mixture Models, Monte Carlo, Bayesian Updating and Dynamic Models Mike West Computing Science and Statistics, Vol. 24, pp , 1993.
Markov Random Fields Probabilistic Models for Images
Forward-Scan Sonar Tomographic Reconstruction PHD Filter Multiple Target Tracking Bayesian Multiple Target Tracking in Forward Scan Sonar.
Therapeutic Equivalence & Active Control Clinical Trials Richard Simon, D.Sc. Chief, Biometric Research Branch National Cancer Institute.
Biological Signal Detection for Protein Function Prediction Investigators: Yang Dai Prime Grant Support: NSF Problem Statement and Motivation Technical.
Randomized Algorithms for Bayesian Hierarchical Clustering
Learning In Bayesian Networks. General Learning Problem Set of random variables X = {X 1, X 2, X 3, X 4, …} Training set D = { X (1), X (2), …, X (N)
Paper Reading Dalong Du Nov.27, Papers Leon Gu and Takeo Kanade. A Generative Shape Regularization Model for Robust Face Alignment. ECCV08. Yan.
Chapter 7. Learning through Imitation and Exploration: Towards Humanoid Robots that Learn from Humans in Creating Brain-like Intelligence. Course: Robots.
Ch15: Decision Theory & Bayesian Inference 15.1: INTRO: We are back to some theoretical statistics: 1.Decision Theory –Make decisions in the presence of.
Boosted Particle Filter: Multitarget Detection and Tracking Fayin Li.
Looking at people and Image-based Localisation Roberto Cipolla Department of Engineering Research team
Sequential Monte-Carlo Method -Introduction, implementation and application Fan, Xin
Guest lecture: Feature Selection Alan Qi Dec 2, 2004.
Markov Chain Monte Carlo for LDA C. Andrieu, N. D. Freitas, and A. Doucet, An Introduction to MCMC for Machine Learning, R. M. Neal, Probabilistic.
Chapter 20 Classification and Estimation Classification – Feature selection Good feature have four characteristics: –Discrimination. Features.
Exposure Assessment for Health Effect Studies: Insights from Air Pollution Epidemiology Lianne Sheppard University of Washington Special thanks to Sun-Young.
BIOSTATISTICS Lecture 2. The role of Biostatisticians Biostatisticians play essential roles in designing studies, analyzing data and creating methods.
Visual Tracking by Cluster Analysis Arthur Pece Department of Computer Science University of Copenhagen
CS Statistical Machine learning Lecture 25 Yuan (Alan) Qi Purdue CS Nov
Statistical Methods. 2 Concepts and Notations Sample unit – the basic landscape unit at which we wish to establish the presence/absence of the species.
Naïve Bayes Classifier April 25 th, Classification Methods (1) Manual classification Used by Yahoo!, Looksmart, about.com, ODP Very accurate when.
Bayesian Brain Probabilistic Approaches to Neural Coding 1.1 A Probability Primer Bayesian Brain Probabilistic Approaches to Neural Coding 1.1 A Probability.
Naive Bayes Classifier. REVIEW: Bayesian Methods Our focus this lecture: – Learning and classification methods based on probability theory. Bayes theorem.
Introduction to Bayesian inference POORFISH workshop Helsinki Samu Mäntyniemi Fisheries and Environmental Management group (FEM) Department.
Ch 1. Introduction Pattern Recognition and Machine Learning, C. M. Bishop, Updated by J.-H. Eom (2 nd round revision) Summarized by K.-I.
Predictive Automatic Relevance Determination by Expectation Propagation Y. Qi T.P. Minka R.W. Picard Z. Ghahramani.
Naive Bayes Classifier
Gregory Cooper Professor of Biomedical Informatics Director, Center for Causal Discovery Vice Chair Research, Department of Biomedical Informatics.
Alan Qi Thomas P. Minka Rosalind W. Picard Zoubin Ghahramani
Bayesian Biosurveillance of Disease Outbreaks
Sampling Distribution
Sampling Distribution
Filtering and State Estimation: Basic Concepts
CSCI 5822 Probabilistic Models of Human and Machine Learning
Gregory Cooper Professor of Biomedical Informatics Director, Center for Causal Discovery Vice Chair Research, Department of Biomedical Informatics.
Network Inference Chris Holmes Oxford Centre for Gene Function, &,
Mixture Models with Adaptive Spatial Priors
Presentation transcript:

World Statistics Day Statisical Modelling of Complex Systems Jouko Lampinen Finnish Centre of Excellence in Computational Complex Systems Research (COSY) Department of Biomedical Engineering and Computational Science Aalto University

Complexity of a system: Structure & Function & Response Communication system: Many non-identical elements linked with diverse interactions Communication system: Many non-identical elements linked with diverse interactions NETWORKNETWORK Six degrees - Small World C. ELEGANS: genes HOMO SAPIENS: genes FRUIT FLY : genes ARABIDOPSIS (mustard): genes Is complexity in number? Self-organisation – Emergent properties in structure, function and response

How to? Complex Dynamic Networks characterizing the interaction structures and dynamical changes in large-scale systems with possibly very little prior knowledge characterizing the interaction structures and dynamical changes in large-scale systems with possibly very little prior knowledge Bayesian Modelling Modelling and estimating the interaction strengths and predicting the outcomes of partly known systems. Modelling and estimating the interaction strengths and predicting the outcomes of partly known systems.

Bayesian modelling Complex phenomena need flexible models Inference using Bayesian approach prior knowledge + observation -> posterior knowledge Consistent approach for handling uncertainties, model selection, and prediction Research issues: integration over large models, application specific models, model assessment Applied in Health care data analysis Brain signal analysis Object recognition

Spatial Epidemiology Gaussian process smoothing different spatial correlation structures multible length-scales modelling of spatio-temporal effects Variables of interest Spatial variation of diseases Practical efficacy of treatments Spatial distributon of demand and use of health care services Algorithmic progress Basically O(N^3)  2006: 20 km grid, 600 cells: 2-3 days 2009: 5 km grid, 10k cells: 2 hours

Example: Alcohol related mortality Spatial variation of incidencies Hypothesis: is risk elevated in population centers?

Alcohol related mortality Spatial effectRelative risk normalized for population

Spatio-temporal analysis of breast cancer (F)

Prediction of breast cancer incidences Collaboration with Finnish cancer Registry

Brain Signal Analysis Bayesian analysis of source localization in MEG Current focus neurocinematics: spatio-temporal analysis of brain activity in natural stimulus environment

Bayesian Object Recognition Perception as Bayesian Inference perception = prior knowledge + sensory input Object matching Object matching Sequential Monte CarloSequential Monte Carlo Clutter, occlusions etcClutter, occlusions etc Learning novel objects Learning novel objects Population Monte Carlo Population Monte Carlo

Adaptive proposal distribution in SMC Example of proposal distributions for new feature Feature with good likelihood Occluded feature with no information in likelihood

Blue – already sampled, yellow – new feature Final match Example of SMC sampling Sequential sampling with random feature order and occlusion model

Example of SMC sampling with occlusions Model trained with studio quality images Test image in uncontrolled office environment Posterior means yellow: p(visibility)>0.5 black: p(visibility)<0.5

Example of SMC sampling with occlusions

Learning novel objects Based on the previous occlusion model for detecting background feature points Population Monte Carlo for adapting likelihood and shape parameters and the probability of the feature belonging to the object

Learning novel objects Matching: predicted position + likelihood => posterior position & association Resampling: the most probable hypotheses are retained For additional info: PhD dissertation of Miika Toivanen, "Incremental object matching with probabilistic methods" on October 22nd, 2010 at 12 o’clock, Hall F239a Opponent: Dr. Josephine Sullivan, KTH, Sweden