The Importance of Sample Size and Its Varying Effects on Precision in Large-Scale Surveys Dipankar Roy, PhD Bangladesh Bureau of Statistics

Slides:



Advertisements
Similar presentations
Irwin/McGraw-Hill © Andrew F. Siegel, 1997 and l Chapter 12 l Multiple Regression: Predicting One Factor from Several Others.
Advertisements

Sampling: Final and Initial Sample Size Determination
Confidence Intervals This chapter presents the beginning of inferential statistics. We introduce methods for estimating values of these important population.
Estimation of Sample Size
Confidence Intervals for Proportions
1-1 Copyright © 2015, 2010, 2007 Pearson Education, Inc. Chapter 18, Slide 1 Chapter 18 Confidence Intervals for Proportions.
Business Statistics - QBM117 Selecting the sample size.
Nemours Biomedical Research Statistics March 19, 2009 Tim Bunnell, Ph.D. & Jobayer Hossain, Ph.D. Nemours Bioinformatics Core Facility.
Sociology 601: Class 5, September 15, 2009
1 A heart fills with loving kindness is a likeable person indeed.
Copyright © 2010 Pearson Education, Inc. Chapter 19 Confidence Intervals for Proportions.
A new sampling method: stratified sampling
BPS - 3rd Ed. Chapter 131 Confidence intervals: the basics.
Chapter 10: Estimating with Confidence
Estimation Goal: Use sample data to make predictions regarding unknown population parameters Point Estimate - Single value that is best guess of true parameter.
Chapter 11: Estimation Estimation Defined Confidence Levels
Confidence Intervals (Chapter 8) Confidence Intervals for numerical data: –Standard deviation known –Standard deviation unknown Confidence Intervals for.
Lecture 14 Sections 7.1 – 7.2 Objectives:
PARAMETRIC STATISTICAL INFERENCE
Test Topics 1)Notation and symbols 2)Determining if CLT applies. 3)Using CLT to find mean/mean proportion and standard error of sampling distribution 4)Finding.
University of Ottawa - Bio 4118 – Applied Biostatistics © Antoine Morin and Scott Findlay 08/10/ :23 PM 1 Some basic statistical concepts, statistics.
Statistics for Managers Using Microsoft Excel, 5e © 2008 Pearson Prentice-Hall, Inc.Chap 8-1 Statistics for Managers Using Microsoft® Excel 5th Edition.
1 Things That May Affect Estimates from the American Community Survey.
AP STATISTICS LESSON 10 – 1 ( DAY 3 ) CHOOSING THE SAMPLE SIZE.
2.6 Confidence Intervals and Margins of Error. What you often see in reports about studies… These results are accurate to within +/- 3.7%, 19 times out.
1 Chapter 6 Estimates and Sample Sizes 6-1 Estimating a Population Mean: Large Samples / σ Known 6-2 Estimating a Population Mean: Small Samples / σ Unknown.
Things that May Affect the Estimates from the American Community Survey Updated February 2013.
BPS - 3rd Ed. Chapter 131 Confidence Intervals: The Basics.
Sampling distributions rule of thumb…. Some important points about sample distributions… If we obtain a sample that meets the rules of thumb, then…
What is a Confidence Interval?. Sampling Distribution of the Sample Mean The statistic estimates the population mean We want the sampling distribution.
Section 8.3 ~ Estimating Population Proportions Introduction to Probability and Statistics Ms. Young.
Confidence Intervals for a Population Proportion Excel.
Ch 8 Estimating with Confidence 8.1: Confidence Intervals.
Copyright © Cengage Learning. All rights reserved. Estimation 8.
INFERENCE Farrokh Alemi Ph.D.. Point Estimates Point Estimates Vary.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. Chapter 19 Confidence Intervals for Proportions.
Ex St 801 Statistical Methods Inference about a Single Population Mean (CI)
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 12 Analyzing the Association Between Quantitative Variables: Regression Analysis Section.
Chapter 8 Estimation ©. Estimator and Estimate estimator estimate An estimator of a population parameter is a random variable that depends on the sample.
Sampling Design and Analysis MTH 494 LECTURE-11 Ossam Chohan Assistant Professor CIIT Abbottabad.
Statistics 19 Confidence Intervals for Proportions.
Lecture 13 Dustin Lueker. 2  Inferential statistical methods provide predictions about characteristics of a population, based on information in a sample.
Confidence Intervals for Proportions
More on Inference.
Chapter 6 Inferences Based on a Single Sample: Estimation with Confidence Intervals Slides for Optional Sections Section 7.5 Finite Population Correction.
ESTIMATION.
Making inferences from collected data involve two possible tasks:
04/10/
ECO 173 Chapter 10: Introduction to Estimation Lecture 5a
Confidence Intervals for Proportions
Week 10 Chapter 16. Confidence Intervals for Proportions
ECO 173 Chapter 10: Introduction to Estimation Lecture 5a
More on Inference.
Data Analysis and Statistical Software I ( ) Quarter: Autumn 02/03
Introduction to Inference
Daniela Stan Raicu School of CTI, DePaul University
Statistics Confidence Intervals
Estimation Goal: Use sample data to make predictions regarding unknown population parameters Point Estimate - Single value that is best guess of true parameter.
Sample Size, Margin of Error, and Confidence Intervals
Calculating Probabilities for Any Normal Variable
CHAPTER 8 Estimating with Confidence
Chapter 13 - Confidence Intervals - The Basics
Confidence Intervals for Proportions
Daniela Stan Raicu School of CTI, DePaul University
Inference for Proportions
Confidence Intervals for Proportions
Chapter 14 - Confidence Intervals: The Basics
Objectives 6.1 Estimating with confidence Statistical confidence
Objectives 6.1 Estimating with confidence Statistical confidence
Chapter 7 Estimation: Single Population
Presentation transcript:

The Importance of Sample Size and Its Varying Effects on Precision in Large-Scale Surveys Dipankar Roy, PhD Bangladesh Bureau of Statistics Presented at the International Seminar at Rajshahi University October 2012 Rajshahi, Bangladesh

Sample size determination – the act of choosing the number of observations to be surveyed – The way should be statistically sound and formulae-oriented – Samples should be selected with selection probability (base weight) – Samples should be allocated scientifically (need based) 2

 Sampling  The process of selecting units  Study them  Generalize the result (estimate/statistic)  Back to population (parameter)  Infer about population through sample 3

A major goal of data analysis – sample mean (or proportion) to estimate the corresponding parameters in the respective population – Statistical inference about a population NOT for sample 4

Two approaches – Precision-based approach – Power-based approach 5

How large a sample is needed to – enable statistical judgments that are accurate and reliable? AND – to attain a desirable level of precision? 6

Sample size should not be determined – arbitrarily – without solving the equation Required/optimum samples can ensure accurate, precise and reliable estimates – Too low samples lack the precision – Unnecessary larger samples yield minimal gain 7

Sampling Error Standard Error (SE) Margin of Error (MOE) Confidence Interval (CI) 8

MOE Indicates that a data user can be certain that the estimate (statistic) and the population value (parameter) differ by no more than the value of the MOE 9

There is some margin of error d in the estimated proportion p in relation to the true proportion P There is some risk α that the actual error is larger than d Pr(|p-P|>d)= α OR Pr(|p-P|<=d)= 1-α 10

n=[z^2*P*(1-P)]/d^2 – the level of precision, – the level of confidence or risk, and – the degree of variability in the attributes 11

Sample of size n is required to – estimate an event of p – within d of its true value – with 100(1-α)% confidence level 12

Formulae for MICS Sample Size 13

HIES Coefficient of variation should have been used in determining sample size for a study variable like income Household income, by its nature, seems to be heterogeneous within and/or between localities 14

Template Input Values Value Predicted value of indicator (in target/base population)r0.26 Design Effect (DEFF)f1.4 Margin of error at 95% Confidencee0.09 Proportion of base population in total populationp0.04 Average Household Sizes4.5 Adjustment for Non-Responsek1.05 Output Value Number of Households (Sample Size)n776 15

Sample size vs. coverage rate 16

Sample size vs. margin of error 17

n vs. N 18

Interval width is equal to twice the margin of error and it is directly proportional to If the sample size is increased by a factor of 4, the interval width will be reduced by half High levels of precision require larger sample sizes Higher confidence levels require larger sample sizes 19

Sample size depends on domain-level estimation Sample size does not necessarily depend on how large the population In a certain stage there is no necessity for increasing the sample size for population becoming any larger For any complex design, sample size should be inflated by the design effect. 20