Randomness Test Fall 2012 By Yaohang Li, Ph.D.. Review Last Class –Random Number Generation –Uniform Distribution This Class –Test of Randomness –Chi.

Slides:



Advertisements
Similar presentations
Special random variables Chapter 5 Some discrete or continuous probability distributions.
Advertisements

Distributions of sampling statistics Chapter 6 Sample mean & sample variance.
Exponential Distribution. = mean interval between consequent events = rate = mean number of counts in the unit interval > 0 X = distance between events.
Chapter 6 Sampling and Sampling Distributions
Week11 Parameter, Statistic and Random Samples A parameter is a number that describes the population. It is a fixed number, but in practice we do not know.
Chapter 7 Introduction to Sampling Distributions
Statistics for Financial Engineering Part1: Probability Instructor: Youngju Lee MFE, Haas Business School University of California, Berkeley.
Engineering Probability and Statistics - SE-205 -Chap 4 By S. O. Duffuaa.
CONFIDENCE INTERVAL FOR THE STANDARD DEVIATION σ We have a point estimate for σ: S (or S 2 for σ 2 ). Want a confidence interval for σ. Let sample from.
A Review of Probability and Statistics
Probability Densities
Chapter 7 Sampling and Sampling Distributions
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 6-1 Introduction to Statistics Chapter 7 Sampling Distributions.
Statistics.
Statistics Lecture 15. Percentile for Normal Distributions The 100p th percentile of the N( ,  2 ) distribution is  +  (p)  Where  (p) is.
Statistical inference form observational data Parameter estimation: Method of moments Use the data you have to calculate first and second moment To fit.
Analysis of Simulation Input.. Simulation Machine n Simulation can be considered as an Engine with input and output as follows: Simulation Engine Input.
OMS 201 Review. Range The range of a data set is the difference between the largest and smallest data values. It is the simplest measure of dispersion.
Part III: Inference Topic 6 Sampling and Sampling Distributions
Copyright (c) 2004 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 4 Continuous Random Variables and Probability Distributions.
Normal and Sampling Distributions A normal distribution is uniquely determined by its mean, , and variance,  2 The random variable Z = (X-  /  is.
Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Statistics for Business and Economics 8 th Edition Chapter 6 Sampling and Sampling.
Short Resume of Statistical Terms Fall 2013 By Yaohang Li, Ph.D.
JMB Chapter 6 Lecture 3 EGR 252 Spring 2011 Slide 1 Continuous Probability Distributions Many continuous probability distributions, including: Uniform.
Chapter 5 Statistical Models in Simulation
Continuous Probability Distributions  Continuous Random Variable  A random variable whose space (set of possible values) is an entire interval of numbers.
Moment Generating Functions
Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Statistics for Business and Economics 8 th Edition Chapter 6 Sampling and Sampling.
Random Sampling, Point Estimation and Maximum Likelihood.
General Principle of Monte Carlo Fall 2013 By Yaohang Li, Ph.D.
Chap 6-1 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. A Course In Business Statistics 4 th Edition Chapter 6 Introduction to Sampling.
1 Statistical Distribution Fitting Dr. Jason Merrick.
Tests for Random Numbers Dr. Akram Ibrahim Aly Lecture (9)
+ The Practice of Statistics, 4 th edition – For AP* STARNES, YATES, MOORE Chapter 9: Sampling Distributions Section 9.2 Sample Proportions.
Estimating a Population Proportion
Bernoulli Trials Two Possible Outcomes –Success, with probability p –Failure, with probability q = 1  p Trials are independent.
“ Building Strong “ Delivering Integrated, Sustainable, Water Resources Solutions Statistics 101 Robert C. Patev NAD Regional Technical Specialist (978)
McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 5 Discrete Random Variables.
Quasi-Monte Carlo Methods Fall 2012 By Yaohang Li, Ph.D.
Selecting Input Probability Distribution. Simulation Machine Simulation can be considered as an Engine with input and output as follows: Simulation Engine.
Tests of Random Number Generators
Quasi-Random Number Sequences from a Long Period TLP Generator with Remarks on Application to Cryptography By Herbert S. Bright and Richard L. Enison Presented.
The Sampling Distribution of
Stats Probability Theory Summary. The sample Space, S The sample space, S, for a random phenomena is the set of all possible outcomes.
Testing Random-Number Generators Andy Wang CIS Computer Systems Performance Analysis.
Statistics for Business and Economics 8 th Edition Chapter 7 Estimation: Single Population Copyright © 2013 Pearson Education, Inc. Publishing as Prentice.
Review of Probability Concepts Prepared by Vera Tabakova, East Carolina University.
Chapter 3 Statistical Models or Quality Control Improvement.
1 1 Slide © 2008 Thomson South-Western. All Rights Reserved Chapter 12 Tests of Goodness of Fit and Independence n Goodness of Fit Test: A Multinomial.
Chapter 6 Sampling and Sampling Distributions
Section 10.1 Goodness of Fit © 2012 Pearson Education, Inc. All rights reserved. 1 of 91.
Basic statistics Usman Roshan.
Chapter 7: Sampling Distributions
Test for randomness : Chi square test
Statistical Quality Control, 7th Edition by Douglas C. Montgomery.
Discrete Probability Distributions
Elementary Statistics
SA3202 Statistical Methods for Social Sciences
Inferential Statistics and Probability a Holistic Approach
Chapter 7: Sampling Distributions
Chapter 7: Sampling Distributions
Chapter 7: Sampling Distributions
Chapter 7: Sampling Distributions
Chapter 7: Sampling Distributions
Chapter 7: Sampling Distributions
Distributions Discrete and Continuous
1/10/ Sample Proportions.
Statistical Models or Quality Control Improvement
Presentation transcript:

Randomness Test Fall 2012 By Yaohang Li, Ph.D.

Review Last Class –Random Number Generation –Uniform Distribution This Class –Test of Randomness –Chi Square Test –K-S Test –10 empirical tests Next Class –Nuclear Simulation

Chi-square test Introduced by Karl Pearson in 1900 Test for discrete distributions e.g. binomial and Poisson distributions Implementation: - assume we have k possible categories - P = sequence size / k - expected sample size = P * n trials - suppose category i occurs Y i times - error = Y i – nP i - chi-square statistic - chi-square percentile = proportion of samples from a "true“ distribution having a chi-square statistic (function of errors) less than the percentile.

Example Given two “true” dice for 144 trials we get: s = P s = 1/36 1/18 1/12 1/9 5/36 1/6 5/36 1/9 1/12 1/18 1/36 Y s = nP s = V = (Y 2 – nP 2 )² / nP 2 + (Y 3 – nP 3 )² / nP 3 +………+ (Y 12 – nP 12 )² / nP 12 V = (2 – 4)² / 4 + (4 – 8)² / 8 +……+ (9 – 8)² / 8 + (6 – 4)² / 4 = 7 7/48

Chi-square Table

Kolmogorov-Smirnov test Introduced in 1933 Test for continuous distributions e.g. normal and Weibull distributions based on ECDF defined as,

K-S Test

K-S Table

Empirical Tests Equidistribution Test Serial Test Gap Test Poker Test Coupon Collector’s Test Permutation Test Run Test Maximum of t test Collision Test Serial Correlation Test

Summary Chi-Square Test KS Test Empirical Tests

What I want you to do? Review Slides Review basic probability/statistics concepts Work on your Assignment 3