PatReco: Detection Alexandros Potamianos Dept of ECE, Tech. Univ. of Crete Fall 2009-2010.

Slides:



Advertisements
Similar presentations
Power of a test. power The power of a test (against a specific alternative value) Is a tests ability to detect a false hypothesis Is the probability that.
Advertisements

Unlocking the Mysteries of Hypothesis Testing
Introduction to Hypothesis Testing
Non-Metric Methods: Decision Trees Alexandros Potamianos Dept of ECE, Tech. Univ. of Crete Fall
 When we perform a hypothesis test, we make a decision to either Reject the Null Hypothesis or Fail to Reject the Null Hypothesis.  There is always the.
PatReco: Hidden Markov Models Alexandros Potamianos Dept of ECE, Tech. Univ. of Crete Fall
Decision making as a model 2. Statistics and decision making.
PatReco: Estimation/Training Alexandros Potamianos Dept of ECE, Tech. Univ. of Crete Fall
Hypothesis Testing Steps of a Statistical Significance Test. 1. Assumptions Type of data, form of population, method of sampling, sample size.
Power. The Four Components to a Statistical Conclusion The number of units (e.g., people) accessible to study The salience of the program relative to.
Non Parametric Classifiers Alexandros Potamianos Dept of ECE, Tech. Univ. of Crete Fall
Statistics for the Social Sciences Psychology 340 Fall 2006 Review For Exam 1.
Unsupervised Training and Clustering Alexandros Potamianos Dept of ECE, Tech. Univ. of Crete Fall
PatReco: Bayesian Networks Alexandros Potamianos Dept of ECE, Tech. Univ. of Crete Fall
Discriminant Functions Alexandros Potamianos Dept of ECE, Tech. Univ. of Crete Fall
PatReco: Bayes Classifier and Discriminant Functions Alexandros Potamianos Dept of ECE, Tech. Univ. of Crete Fall
Hypothesis Testing. G/RG/R Null Hypothesis: The means of the populations from which the samples were drawn are the same. The samples come from the same.
PatReco: Discriminant Functions for Gaussians Alexandros Potamianos Dept of ECE, Tech. Univ. of Crete Fall
Pattern Recognition Applications Alexandros Potamianos Dept of ECE, Tech. Univ. of Crete Fall
PSY 307 – Statistics for the Behavioral Sciences
Intro to Statistics for the Behavioral Sciences PSYC 1900 Lecture 11: Power.
Short Notes on Theory of Signal Detection Walter Schneider
Hypothesis Testing.
8 - 1 © 2003 Pearson Prentice Hall Chi-Square (  2 ) Test of Variance.
Sections 8-1 and 8-2 Review and Preview and Basics of Hypothesis Testing.
Overview Basics of Hypothesis Testing
1 Power and Sample Size in Testing One Mean. 2 Type I & Type II Error Type I Error: reject the null hypothesis when it is true. The probability of a Type.
Presentation on Type I and Type II Errors How can someone be arrested if they really are presumed innocent? Why do some individuals who really are guilty.
1 Hypothesis Testing Population Proportion (  ).
Hypothesis testing and Decision Making Formal aspects of hypothesis testing.
Inference and Inferential Statistics Methods of Educational Research EDU 660.
CONFIDENCE INTERVAL It is the interval or range of values which most likely encompasses the true population value. It is the extent that a particular.
Introduction to sample size and power calculations Afshin Ostovar Bushehr University of Medical Sciences.
Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Statistics for Business and Economics 8 th Edition Chapter 9 Hypothesis Testing: Single.
Statistical Inference for the Mean Objectives: (Chapter 9, DeCoursey) -To understand the terms: Null Hypothesis, Rejection Region, and Type I and II errors.
Power Analysis for Traditional and Modern Hypothesis Tests
Type I and Type II Errors. An analogy may help us to understand two types of errors we can make with inference. Consider the judicial system in the US.
Chapter 21: More About Tests
Lecturer’s desk INTEGRATED LEARNING CENTER ILC 120 Screen Row A Row B Row C Row D Row E Row F Row G Row.
USER INTERFACE USER INTERFACE January 12, 2006 Intern 박지현 Performance analysis of filtering software using Signal Detection Theory Ashutosh Deshmukh, Balaji.
Inference as Design Target Goal: I can calculate and interpret a type I and type II error. 9.1c h.w: pg 547: 15, 19, 21.
Type I and Type II Errors. For type I and type II errors, we must know the null and alternate hypotheses. H 0 : µ = 40 The mean of the population is 40.
Major Steps. 1.State the hypotheses.  Be sure to state both the null hypothesis and the alternative hypothesis, and identify which is the claim. H0H0.
Hypothesis Testing Steps for the Rejection Region Method State H 1 and State H 0 State the Test Statistic and its sampling distribution (normal or t) Determine.
Chapter 7 Statistical Issues in Research Planning and Evaluation.
Chapter ?? 7 Statistical Issues in Research Planning and Evaluation C H A P T E R.
Chapter 9: Hypothesis Tests for One Population Mean 9.2 Terms, Errors, and Hypotheses.
PEP-PMMA Training Session Statistical inference Lima, Peru Abdelkrim Araar / Jean-Yves Duclos 9-10 June 2007.
Statistical Inference for the Mean Objectives: (Chapter 8&9, DeCoursey) -To understand the terms variance and standard error of a sample mean, Null Hypothesis,
Sensitivity, Specificity, and Receiver- Operator Characteristic Curves 10/10/2013.
PatReco: Introduction Alexandros Potamianos Dept of ECE, Tech. Univ. of Crete Fall
PatReco: Model and Feature Selection Alexandros Potamianos Dept of ECE, Tech. Univ. of Crete Fall
Lecture 1.31 Criteria for optimal reception of radio signals.
Section Testing a Proportion
Review and Preview and Basics of Hypothesis Testing
MATH 2311 Section 8.2.
CONCEPTS OF HYPOTHESIS TESTING
INTEGRATED LEARNING CENTER
Chapter 6 Hypothesis tests.
P-value Approach for Test Conclusion
Unlocking the Mysteries of Hypothesis Testing
Chapter 9 Hypothesis Testing
Chapter 9: Hypothesis Testing
AP Statistics: Chapter 21
Errors In Hypothesis tests
More About Tests Notes from
Chapter 7: Statistical Issues in Research planning and Evaluation
Sample Mean Compared to a Given Population Mean
Sample Mean Compared to a Given Population Mean
Statistical Power.
Presentation transcript:

PatReco: Detection Alexandros Potamianos Dept of ECE, Tech. Univ. of Crete Fall

Detection  Classification problems with two classes are sometimes referred to as detection problems  For detection problems the two classes are referred to as ω 2 and ω 1 = NOT ω 2  In statistics NOT ω 2 is the null hypothesis H 0 and ω 2 is H 1

Detection  Goal: Detect an Event Hit (Success): event occurs and is detected False Alarm: event does not occur but is detected Miss (Failure): event occurs and goes undetected Correct Reject: event neither occurs nor detected  In traditional Bayes classifier terms: P(correct) = P(Hit) + P(Correct Reject) P(error) = P(False Alarm) + P (Miss)

Detection Examples  House Alarm (detect burglary)  Reading bits of a CD or a DVD (detect 1’s)  Medical screening (e.g., detect cancer) Hit (Success): cancer present and detected False Alarm: caner not present but not detected Miss (Failure): cancer present and goes undetected Correct Reject: cancer neither present nor detected Further testing No action

HitMiss False Alarm Correct Reject

Receiver Operator Curve (ROC-curve) Equal Error Rate(EER) Operation Point

Conclusions  Detection is a special case of two-class classification  Type I and Type II errors (miss and false alarms) often have different costs  Often increase Bayes error to minimize total cost  Select an operation point on the ROC-curve