Presented by: Khaleel S. Hussaini PhD Bureau Chief, Public Health Statistics Division of Public Health Preparedness Judy Bass Arizona’s BRFSS Coordinator.

Slides:



Advertisements
Similar presentations
Survey Response Rates: Trends and Standards Karen Donelan, ScD Senior Scientist in Health Policy Massachusetts General Hospital/Harvard Medical School.
Advertisements

2004 Fannin County Health Survey Texas Behavioral Risk Factor Surveillance System (BRFSS)
Behavioral Risk Factor Surveillance System
Outline of talk The ONS surveys Why should we weight?
Diabetes in Idaho BRFSS 2009 Data collected from Behavioral Risk Factor Surveillance System Idaho Department of Health and Welfare, Division of.
Coverage Bias in Traditional Telephone Surveys of Low-Income and Young Adults Centers for Disease Control and Prevention National Center for Health Statistics.
Online Privacy Survey Results Conducted: December 2011.
An Overview of the North Carolina Behavioral Risk Factor Surveillance System (BRFSS) Presentation to the State Health Director's Conference January 23,
Recent Improvements for Dual-Frame RDD Sampling Methodology 29 th Annual Meeting March 26, 2012.
Women’s Health and BRFSS Presented By: Neha Thakkar Arkansas BRFSS Coordinator With the help of: Dr. John Senner Project Officer Arkansas Center for Health.
An Assessment of the Impact of Two Distinct Survey Design Modifications on Health Insurance Coverage Estimates in a National Health Care Survey Steven.
Behavioral Risk Factor Surveillance System (BRFSS) Contributors: Wayne A. Honey, MPH Jennifer E. Daniel, MPH Annie Hickman, BS Survey Unit, Injury & Behavioral.
1 Sampling Telephone Numbers and Adults, and Interview Length, and Weighting in the California Health Survey Cell Phone Pilot Study J. Michael Brick, Westat.
Eligible Women and Participation in the Women’s Health Network Ellen M. Kramer ScD RD April 7, 2005.
Challenges to Surveys Non-response error –Falling response rates over time Sample coverage –Those without landline telephones excluded –Growing.
Asthma Prevalence in the United States
A Brief Introduction to Epidemiology - VII (Epidemiologic Research Designs: Demographic, Mortality & Morbidity Studies) Betty C. Jung, RN, MPH, CHES.
Use of Spiritual Healing Therapy in Relation to Race and Ethnicity Catherine Simile, Ph.D. and Hanyu Ni, Ph.D. Division of Health Interview Statistics.
2010 Census and ACS in Oregon: Results and Resources Census Data Workshops November, 2011 Charles Rynerson Census State Data Center Coordinator Population.
5.10: Stratification after Selection of Sample – Post Stratification n Situations can arise in which we cannot place sampling units into their correct.
Methodologic Overview of Two National Data Sets Centers for Disease Control and Prevention National Center for Health Statistics Issues in Comparing Findings.
1 Health Status and The Retirement Decision Among the Early-Retirement-Age Population Shailesh Bhandari Economist Labor Force Statistics Branch Housing.
Wireless Substitution: Semiannual Estimates from the NHIS ER Program Centers for Disease Control and Prevention National Center for Health Statistics Stephen.
The Gender Gap in Educational Attainment: Variation by Age, Race, Ethnicity, and Nativity in the United States Sarah R. Crissey, U.S. Census Bureau Nicole.
Joint Canada/U.S. Health Survey Catherine Simile, National Center for Health Statistics Patrice Mathieu, Statistics Canada Ed Rama, Statistics Canada NCHS.
Turning Data into Action for Colorectal Cancer November 17, 2014 Jessica Shaffer, Director, Maine CDC Colorectal Cancer Control Program
How America Shops & Spends 2014
Effects of Income Imputation on Traditional Poverty Estimates The views expressed here are the authors and do not represent the official positions.
Definitions Observation unit Target population Sample Sampled population Sampling unit Sampling frame.
Liesl Eathington Iowa Community Indicators Program Iowa State University October 2014.
2004 Falls County Health Survey Texas Behavioral Risk Factor Surveillance System (BRFSS)
Women’s Health in Massachusetts Highlights from the Massachusetts Behavioral Risk Factor Surveillance System (BRFSS): Health Survey Program Bureau.
Copyright 2010, The World Bank Group. All Rights Reserved. Estimation and Weighting, Part I.
Assessing the Value of the NHIS for Studying Changes in State Health Coverage Policies: The Case of New York Sharon K. Long John A. Graves Stephen Zuckerman.
Economics and Statistics Administration U.S. CENSUS BUREAU U.S. Department of Commerce Research on Estimating International Migration of the Foreign-Born.
A Latent Class Call-back Model for Survey Nonresponse Paul P. Biemer RTI International and UNC-CH Michael W. Link Centers for Disease Control and Prevention.
The 2006 National Health Interview Survey (NHIS) Paradata File: Overview And Applications Beth L. Taylor 2008 NCHS Data User’s Conference August 13 th,
Secondary Data Analysis Linda K. Owens, PhD Assistant Director for Sampling and Analysis Survey Research Laboratory University of Illinois.
Scot Exec Course Nov/Dec 04 Survey design overview Gillian Raab Professor of Applied Statistics Napier University.
Veterans Using and Uninsured Veterans Not Using VA Health Care Karin Nelson, MD, MSHS Gordon A. Starkebaum, MD Gayle E. Reiber, PhD, MPH VA Puget Sound.
Core State PCH Indicators: A Preliminary Report of Multi-State Findings Using Data from the BRFSS CDR Lauren B. Zapata, PhD, MSPH Division of Reproductive.
Louisiana Health Insurance Survey, Provides detailed data on Louisiana’s uninsured population Assists in planning programs and targeting outreach.
4th June 2012 Nisha Kini Disparities in Heart Attack Knowledge by Gender, Race/Ethnicity, Education Level and Household Income among Maine adults.
Growing Challenges to State Telephone Surveys of Health Insurance Coverage: Minnesota as a Case Study Supported by a grant from the Minnesota Department.
Weighting opt-in samples Some preliminary results from Sweden.
Assessment of Misclassification Error in Stratification Due to Incomplete Frame Information Donsig Jang, Xiaojing Lin, Amang Sukasih Mathematica Policy.
A Comparison of Variance Estimates for Schools and Students Using Taylor Series and Replicate Weighting Ellen Scheib, Peter H. Siegel, and James R. Chromy.
Acute and Chronic Disability Among US Farmers and Pesticide Applicators: The National Health Interview Survey O Gómez-Marín, D Zheng, W LeBlanc, D Lee,
Estimation of preliminary unemployment rates by means of multiple imputation UN/ECE-Work Session on Data Editing Vienna, April 2008 Thomas Burg, Statistics.
Introduction to Secondary Data Analysis Young Ik Cho, PhD Research Associate Professor Survey Research Laboratory University of Illinois at Chicago Fall,
Recent Birth Trends from a State and National Perspective: The Case of Arizona Presented by: Khaleel S. Hussaini PhD Bureau Chief, Public Health Statistics.
Small Area (e.g. County-level) Estimates. Concepts Considerable interest in small area estimates of uninsured (e.g. County level) Two estimation methods.
Weighting Household Surveys By David F. Pearson, Ph.D., P.E. April 2007.
Treasure Coast Regional Planning Council Meeting June 17, 2011 Regional Demographic Profile: 2010 Census.
National Health Interview Survey Early Release Program: Overview and Key Health Indicators Report Jeannine S. Schiller, M.P.H. Division of Health Interview.
Statistical Weights and Methods for Analyzing HINTS Data HINTS Data Users Conference January 21, 2005 William W. Davis, Ph.D. Richard P. Moser, Ph.D. National.
Using Data from the National Survey of Children with Special Health Care Needs Centers for Disease Control and Prevention National Center for Health Statistics.
Restaurant Smoking Policies and Reported Exposure to ETS The case of Massachusetts Tandiwe Njobe National Conference on Tobacco or Health November 2002.
Sample Design of the National Health Interview Survey (NHIS) Linda Tompkins Data Users Conference July 12, 2006 Centers for Disease Control and Prevention.
1 Assessment of Potential Bias in the National Immunization Survey (NIS) from the Increasing Prevalence of Households Without Landline Telephones Meena.
E-Reading Rises as Device Ownership Jumps BY: KATHERINE ZICKUHR AND LEE RAINIE.
As a data user, it is imperative that you understand how the data has been generated and processed…
Non-response Bias Analysis and Evaluation Reporting Passport Demand Forecasting Study 11/14/2013.
From the Delaware Behavioral Risk Factor Survey (BRFS) Cancer Consortium Retreat, February 20, 2012.
Section 1: Trends of Hispanic Employment in Construction.
Weighting and imputation PHC 6716 July 13, 2011 Chris McCarty.
Camden County BRFSS Results
Gender disparities in self-reported fear of an intimate partner
Rapid Risk Factor Surveillance System Conference
Vice President, Health Care Coverage and Access
Presentation transcript:

Presented by: Khaleel S. Hussaini PhD Bureau Chief, Public Health Statistics Division of Public Health Preparedness Judy Bass Arizona’s BRFSS Coordinator June 26, 2012

What are we covering and what we are not? We are talking about BRFSS and changes in methods. What are the changes and why? Implications of the changes. We are not talking about questions and modules, today but will schedule a separate time and place. We will not discuss costs. We will not discuss time- lines for the next report.

So what are the changes? Any guesses! BRFSS weighting process

The Behavioral Risk Factor Surveillance Survey (BRFSS) was initiated by CDC in1984. It is the largest ongoing telephone survey in the World. Like all surveillance systems BRFSS has adapted to both technical and non-technical changes. Technical terms to remember: POPULATION VS. SAMPLE

Population inferences can be made...

...by selecting a representative sample from the population

SAMPLING STRATEGY IN BRFSS

Disproportionate stratified sample

National Center for Health Statistics Estimates of Cell Phone Only Households in the United States, Source: Blumberg SJ, Luke JV. Wireless substitution: Early release from the Nation Health Interview Survey, January2008 -June 2011 Available at: /wireless pdf. Accessed June 14, /wireless pdf

According to CDC Cell phone interviewees can now be better represented as the sample is: More likely to be younger; More renters than home owners; More likely to be Hispanic; More likely to be single; There are also differences in attitude and behaviors between cell phone only users and those with landline phones.

WEIGHTING PROCEDURES Why weight?

What is weighting?  Sampling weights are needed to correct for imperfections in the sample that might lead to bias. It can include the selection of units with unequal probabilities, non-coverage of the population, and non-response.  Data weights take the design weighting and incorporate characteristics of the population and the sample  Final Weights (_FINALWT) = Design Weight * some form of data weighting

IN THE PAST….  Post-stratification was used as a weighting method.  It was based on known demographics of the population.  For BRFSS Post-stratification included: Regions within states; Race/ Ethnicity (in detailed categories); Gender ; Age (in 7 categories)  Post-stratification forces the sum of the weighted frequencies to equal the population estimates for the region or state by race, age and gender.  Post stratification weights are applied to the responses, allowing for estimates of how groups of non-respondents would have answered survey questions. 

POST STRATIFICATION VS. RAKING  Beginning with the 2011 dataset, raking will succeed post stratification as the sole BRFSS statistical weighting method.  Allows for the incorporation of a now crucial variable – telephone source (landline or cell phone) into the BRFSS weighting methodology (called _LLCPWT)

WEIGHTING Iterative Proportional Fitting (Raking)

RAKING Gender by race/ethnicity Age by gender Age by race/ethnicity Renter/owner Education level Martial status Detailed race/ethnicity Regions within states Phone source Rather than adjusting weights to categories, IPF adjusts for each dimension separately in an iterative process. The process will continue up to 75 times, or until data converges to Census estimates.

Why Incorporate IPF Now?  Computer capacity has increased.  Cell phones are becoming larger percentage of the total number of calls.  Non-coverage with declining response rates makes weighting more important than ever.

HOW DOES IT IMPACT US?

CONCLUSION  Raked weights impact differently for different variables.  Trend data and comparison cannot be established prior to 2009 due to changes in weighting procedures.  In 2008, there was only landline data available and hence raked weights reflected only landline.  With introduction of cell phones raking methods incorporated both landline as well as cell phone weights called _LLCPWT.  Starting in 2011 CDC will weight data only using raking methods which implies establishing any trends is not feasible.