Human-centered Machine Learning

Slides:



Advertisements
Similar presentations
Introduction to modelling extremes
Advertisements

Spatial point patterns and Geostatistics an introduction
Deriving and fitting LogN-LogS distributions An Introduction Andreas Zezas University of Crete.
Spike Train Statistics Sabri IPM. Review of spike train  Extracting information from spike trains  Noisy environment:  in vitro  in vivo  measurement.
ฟังก์ชั่นการแจกแจงความน่าจะเป็น แบบไม่ต่อเนื่อง Discrete Probability Distributions.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 5-1 Chapter 5 Some Important Discrete Probability Distributions Statistics.
MATH 1107 Introduction to Statistics
Chapter 8 Random-Variate Generation Banks, Carson, Nelson & Nicol Discrete-Event System Simulation.
Descriptive statistics Experiment  Data  Sample Statistics Sample mean Sample variance Normalize sample variance by N-1 Standard deviation goes as square-root.
Extremes ● An extreme value is an unusually large – or small – magnitude. ● Extreme value analysis (EVA) has as objective to quantify the stochastic behavior.
Simulation Modeling and Analysis
Estimation of parameters. Maximum likelihood What has happened was most likely.
Descriptive statistics Experiment  Data  Sample Statistics Experiment  Data  Sample Statistics Sample mean Sample mean Sample variance Sample variance.
Horng-Chyi HorngStatistics II127 Summary Table of Influence Procedures for a Single Sample (I) &4-8 (&8-6)
Probability theory 2011 Outline of lecture 7 The Poisson process  Definitions  Restarted Poisson processes  Conditioning in Poisson processes  Thinning.
Statistical analysis and modeling of neural data Lecture 4 Bijan Pesaran 17 Sept, 2007.
CSE 221: Probabilistic Analysis of Computer Systems Topics covered: Statistical inference.
Introduction to Stochastic Models GSLM 54100
This is a discrete distribution. Poisson is French for fish… It was named due to one of its uses. For example, if a fish tank had 260L of water and 13.
Computer Simulation A Laboratory to Evaluate “What-if” Questions.
Overview G. Jogesh Babu. Probability theory Probability is all about flip of a coin Conditional probability & Bayes theorem (Bayesian analysis) Expectation,
Likelihood probability of observing the data given a model with certain parameters Maximum Likelihood Estimation (MLE) –find the parameter combination.
Modeling Your Spiking Data with Generalized Linear Models.
Introduction and Motivation Approaches for DE: Known model → parametric approach: p(x;θ) (Gaussian, Laplace,…) Unknown model → nonparametric approach Assumes.
Modeling and Simulation CS 313
Probability Definitions Dr. Dan Gilbert Associate Professor Tennessee Wesleyan College.
For information contact H. C. Koons 30 October Preliminary Analysis of ABFM Data WSR 11 x 11-km Average Harry Koons 30 October.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. All Rights Reserved. Section 5-5 Poisson Probability Distributions.
1 Lecture 9: The Poisson Random Variable and its PMF Devore, Ch. 3.6.
Chapter Outline Goodness of Fit test Test of Independence.
School of Information Technologies Poisson-1 The Poisson Process Poisson process, rate parameter e.g. packets/second Three equivalent viewpoints of the.
S TOCHASTIC M ODELS L ECTURE 2 P ART II P OISSON P ROCESSES Nan Chen MSc Program in Financial Engineering The Chinese University of Hong Kong (ShenZhen)
Overview G. Jogesh Babu. Overview of Astrostatistics A brief description of modern astronomy & astrophysics. Many statistical concepts have their roots.
Chapter 8 Random-Variate Generation Banks, Carson, Nelson & Nicol Discrete-Event System Simulation.
4.3 More Discrete Probability Distributions NOTES Coach Bridges.
by Ryan P. Adams, Iain Murray, and David J.C. MacKay (ICML 2009)
정하경 MMLAB Fundamentals of Internet Measurement: a Tutorial Nevil Brownlee, Chris Lossley, “Fundamentals of Internet Measurement: a Tutorial,” CMG journal.
1 Introduction to Statistics − Day 4 Glen Cowan Lecture 1 Probability Random variables, probability densities, etc. Lecture 2 Brief catalogue of probability.
Lesson Runs Test for Randomness. Objectives Perform a runs test for randomness Runs tests are used to test whether it is reasonable to conclude.
Created by Tom Wegleitner, Centreville, Virginia Section 4-5 The Poisson Distribution.
Overview G. Jogesh Babu. R Programming environment Introduction to R programming language R is an integrated suite of software facilities for data manipulation,
Machine learning for Dynamic Social Network Analysis
MECH 373 Instrumentation and Measurements
Machine learning for Dynamic Social Network Analysis
Manuel Gomez Rodriguez
HST 583 fMRI DATA ANALYSIS AND ACQUISITION
Probability Distributions: a review
Machine learning for Dynamic Social Network Analysis
Manuel Gomez Rodriguez
Ch3: Model Building through Regression
Maximum Likelihood Find the parameters of a model that best fit the data… Forms the foundation of Bayesian inference Slide 1.
Point processes. Some special cases.
Goodness-of-Fit Tests
Spatial Point Pattern Analysis
Probability & Statistics Probability Theory Mathematical Probability Models Event Relationships Distributions of Random Variables Continuous Random.
R. Console, M. Murru, F. Catalli
Hydrologic Statistics
Extreme Value Theory: Part I
Point processes. Some special cases.
Chapter 8 Random-Variate Generation
Model generalization Brief summary of methods
UNIT-3. Random Process – Temporal Characteristics
Summary Table of Influence Procedures for a Single Sample (I)
Human-centered Machine Learning
Human-centered Machine Learning
Human-centered Machine Learning
Human-centered Machine Learning
Human-centered Machine Learning
Wednesday After Lunch: Add randomness to the Flowers Model
Probabilistic Surrogate Models
Presentation transcript:

Human-centered Machine Learning Introduction to Temporal Point Processes (II) Human-centered Machine Learning http://courses.mpi-sws.org/hcml-ws18/

Temporal Point Processes: Basic building blocks Outline of tutorial

Poisson process Intensity of a Poisson process Observations: time Intensity of a Poisson process Observations: Intensity independent of history Uniformly random occurrence Time interval follows exponential distribution

Fitting a Poisson from (historical) timeline Maximum likelihood

Sampling from a Poisson process time We would like to sample: We sample using inversion sampling:

Inhomogeneous Poisson process time Intensity of an inhomogeneous Poisson process Observations: Intensity independent of history

Fitting an inhomogeneous Poisson time Maximum likelihood Design such that max. likelihood is convex (and use CVX)

Nonparametric inhomogeneous Poisson process Positive combination of (Gaussian) RFB kernels:

Sampling from an inhomogeneous Poisson time Thinning procedure (similar to rejection sampling): Sample from Poisson process with intensity Inversion sampling Generate Keep sample with prob. Keep the sample if

Terminating (or survival) process time Intensity of a terminating (or survival) process Observations: Limited number of occurrences

Self-exciting (or Hawkes) process time History, Triggering kernel Intensity of self-exciting (or Hawkes) process: Observations: Clustered (or bursty) occurrence of events Intensity is stochastic and history dependent

Fitting a Hawkes process from a recorded timeline Maximum likelihood The max. likelihood is jointly convex in and (use CVX!)

Sampling from a Hawkes process time Thinning procedure (similar to rejection sampling): Sample from Poisson process with intensity Inversion sampling Generate Keep sample with prob. Keep the sample if

We know how to fit them and how to sample from them Summary Building blocks to represent different dynamic processes: Poisson processes: We know how to fit them and how to sample from them Inhomogeneous Poisson processes: Terminating point processes: Self-exciting point processes:

Temporal Point Processes: Superposition Outline of tutorial

Superposition of processes time Sample each intensity + take minimum = Additive intensity

Mutually exciting process time Bob History Christine time History Clustered occurrence affected by neighbors

Mutually exciting terminating process time Bob Christine time History Clustered occurrence affected by neighbors