IMST 2008 / FIM XVI Decision theoretic Bayesian hypothesis testing with focus on skewed alternatives By Naveen K. Bansal Ru Sheng Marquette University.

Slides:

Advertisements

Similar presentations

Introduction to Hypothesis Testing

Advertisements

Lecture (11,12) Parameter Estimation of PDF and Fitting a Distribution Function.

Lecture XXIII.  In general there are two kinds of hypotheses: one concerns the form of the probability distribution (i.e. is the random variable normally.

Understanding the Variability of Your Data: Dependent Variable.

Statistical Modeling and Data Analysis Given a data set, first question a statistician ask is, “What is the statistical model to this data?” We then characterize.

Statistics 101 Class 8. Overview Hypothesis Testing Hypothesis Testing Stating the Research Question Stating the Research Question –Null Hypothesis –Alternative.

1 1 Slide IS 310 – Business Statistics IS 310 Business Statistics CSU Long Beach.

Naveen K. Bansal and Prachi Pradeep Dept. of Math., Stat., and Comp. Sci. Marquette University Milwaukee, WI (USA)

AP Statistics – Chapter 9 Test Review

Hypothesis testing Week 10 Lecture 2.

Becoming Acquainted With Statistical Concepts CHAPTER CHAPTER 12.

Statistical Significance What is Statistical Significance? What is Statistical Significance? How Do We Know Whether a Result is Statistically Significant?

Chapter 7(7b): Statistical Applications in Traffic Engineering Chapter objectives: By the end of these chapters the student will be able to (We spend 3.

HYPOTHESIS TESTING Four Steps Statistical Significance Outcomes Sampling Distributions.

Using Statistics in Research Psych 231: Research Methods in Psychology.

Evaluating Hypotheses Chapter 9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics.

Statistical Significance What is Statistical Significance? How Do We Know Whether a Result is Statistically Significant? How Do We Know Whether a Result.

Chapter 6 Hypotheses texts. Central Limit Theorem Hypotheses and statistics are dependent upon this theorem.

Introduction to Hypothesis Testing CJ 526 Statistical Analysis in Criminal Justice.

Chapter 3 Hypothesis Testing. Curriculum Object Specified the problem based the form of hypothesis Student can arrange for hypothesis step Analyze a problem.

Introduction to Hypothesis Testing CJ 526 Statistical Analysis in Criminal Justice.

PY 427 Statistics 1Fall 2006 Kin Ching Kong, Ph.D Lecture 6 Chicago School of Professional Psychology.

Educational Research by John W. Creswell. Copyright © 2002 by Pearson Education. All rights reserved. Slide 1 Chapter 8 Analyzing and Interpreting Quantitative.

PSY 307 – Statistics for the Behavioral Sciences

Statistics 03 Hypothesis Testing ( 假设检验 ). When we have two sets of data and we want to know whether there is any statistically significant difference.

Statistics for the Social Sciences

Overview of Statistical Hypothesis Testing: The z-Test

1 © Lecture note 3 Hypothesis Testing MAKE HYPOTHESIS ©

© 2008 McGraw-Hill Higher Education The Statistical Imagination Chapter 9. Hypothesis Testing I: The Six Steps of Statistical Inference.

Jeopardy Hypothesis Testing T-test Basics T for Indep. Samples Z-scores Probability $100 $200$200 $300 $500 $400 $300 $400 $300 $400 $500 $400.

Tuesday, September 10, 2013 Introduction to hypothesis testing.

Chapter 8 Introduction to Hypothesis Testing

Chapter 8 Hypothesis Testing. Section 8-1: Steps in Hypothesis Testing – Traditional Method Learning targets – IWBAT understand the definitions used in.

1 1 Slide © 2005 Thomson/South-Western Chapter 9, Part B Hypothesis Tests Population Proportion Population Proportion Hypothesis Testing and Decision Making.

The Probability of a Type II Error and the Power of the Test

1 Power and Sample Size in Testing One Mean. 2 Type I & Type II Error Type I Error: reject the null hypothesis when it is true. The probability of a Type.

Chapter 9 Hypothesis Testing II: two samples Test of significance for sample means (large samples) The difference between “statistical significance” and.

Chapter 9 Power. Decisions A null hypothesis significance test tells us the probability of obtaining our results when the null hypothesis is true p(Results|H.

Don’t cry because it is all over, smile because it happened.

Statistical Hypotheses & Hypothesis Testing. Statistical Hypotheses There are two types of statistical hypotheses. Null Hypothesis The null hypothesis,

Chapter 8 Introduction to Hypothesis Testing ©. Chapter 8 - Chapter Outcomes After studying the material in this chapter, you should be able to: 4 Formulate.

Back to basics – Probability, Conditional Probability and Independence Probability of an outcome in an experiment is the proportion of times that.

Inferential Statistics Body of statistical computations relevant to making inferences from findings based on sample observations to some larger population.

1 1 Slide © 2005 Thomson/South-Western Slides Prepared by JOHN S. LOUCKS St. Edward’s University Slides Prepared by JOHN S. LOUCKS St. Edward’s University.

Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Statistics for Business and Economics 8 th Edition Chapter 9 Hypothesis Testing: Single.

Not in FPP Bayesian Statistics. The Frequentist paradigm Defines probability as a long-run frequency independent, identical trials Looks at parameters.

1 Where we are going : a graphic: Hypothesis Testing. 1 2 Paired 2 or more Means Variances Proportions Categories Slopes Ho: / CI Samples Ho: / CI Ho:

Simple examples of the Bayesian approach For proportions and means.

Ch15: Decision Theory & Bayesian Inference 15.1: INTRO: We are back to some theoretical statistics: 1.Decision Theory –Make decisions in the presence of.

Constructing hypotheses & research design. The definition of a hypothesis A tentative proposition. Its validity is unknown. It specifies a relationship.

Inen 460 Lecture 2. Estimation (ch. 6,7) and Hypothesis Testing (ch.8) Two Important Aspects of Statistical Inference Point Estimation – Estimate an unknown.

Bayes Theorem. Prior Probabilities On way to party, you ask “Has Karl already had too many beers?” Your prior probabilities are 20% yes, 80% no.

© Copyright McGraw-Hill 2004

An example of using BFDP for identifying noteworthy associations Joan Dong.

Aim: What is the P-value method for hypothesis testing? Quiz Friday.

ELEC 303 – Random Signals Lecture 17 – Hypothesis testing 2 Dr. Farinaz Koushanfar ECE Dept., Rice University Nov 2, 2009.

Hypothesis Testing Steps for the Rejection Region Method State H 1 and State H 0 State the Test Statistic and its sampling distribution (normal or t) Determine.

Chapter 9: Hypothesis Tests for One Population Mean 9.2 Terms, Errors, and Hypotheses.

Chapter 7: Hypothesis Testing. Learning Objectives Describe the process of hypothesis testing Correctly state hypotheses Distinguish between one-tailed.

Inferential Statistics Psych 231: Research Methods in Psychology.

McGraw-Hill/Irwin © 2003 The McGraw-Hill Companies, Inc.,All Rights Reserved. Part Four ANALYSIS AND PRESENTATION OF DATA.

Part Four ANALYSIS AND PRESENTATION OF DATA

Milwaukee, Wisconsin(USA)

P-value Approach for Test Conclusion

Chapter 9: Hypothesis Testing

One Way ANOVAs One Way ANOVAs

CHAPTER 12 Inference for Proportions

CHAPTER 12 Inference for Proportions

More About Tests Notes from

Statistical Power.

Presentation transcript:

IMST 2008 / FIM XVI Decision theoretic Bayesian hypothesis testing with focus on skewed alternatives By Naveen K. Bansal Ru Sheng Marquette University Milwaukee, WI

IMST 2008 / FIM XVI Directional Error (Type III error): Sarkar and Zhou (2008, JSPI) Shaffer (2002, Psychological Methods) Finner ( 1999, AS) Lehmann (1952, AMS; 1957, AMS) Main points of these work is that if the objective is to find the true Direction of the alternative after rejecting the null, then a Type III error must be also controlled. Type III error is defined as P( false directional error if the null is rejected). The traditional method does not control the directional error. For example,

IMST 2008 / FIM XVI

Bayes Rule Bayes Rule

IMST 2008 / FIM XVI

Relationship with the False Discovery Rates

IMST 2008 / FIM XVI

An Application: An experiment was conducted to see the effect of a sequence knockdown from non-coding genes. Hypothesis was that this knockdown will cause the overexpression of the mRNAs of the coding genes. The implication of this is that this will shows how the non-coding genes interact with coding genes. In other words, non-coding genes also play a part in protein synthesis. Here it can be assumed that that the effect of knockdown on the coding genes (if there is any) would be mostly overexpression of mRNAs than underexpression of mRNAs. The objective would be to detect as many of overexpressed genes as possible. IMST 2008 / FIM XVI

Accept Total is true Total Table 1 Possible outcomes from hypothesis tests

IMST 2008 / FIM XVI

This theorem and our previous discussion on the Bayes decision rule implies that under the independent hypotheses testing setting, the Bayes rule obtained from a single test problem which minimizes the average expected false discoveries, can be used under multiple hypotheses problem. The false discovery rates of this procedure can be obtained by computing the posterior probabilities. The prior probabilities will determine whether the positive hypothesis or the negative hypothesis will be more frequently correctly detected.

IMST 2008 / FIM XVI Computation of Bayes Rule:

IMST 2008 / FIM XVI Choice of the loss function:

IMST 2008 / FIM XVI

Power Comparison:

IMST 2008 / FIM XVI

Another Approach:

IMST 2008 / FIM XVI Power Comparison of a skew-normal Bayes with the UMP test

IMST 2008 / FIM XVI