© 2006 IMS Health Incorporated or its affiliates. All rights reserved. June 20, 2007 Determination of Target Sample Sizes for Physicians Surveys Darrell.

Slides:



Advertisements
Similar presentations
Re-design of the trade in commercial services program in Canada October 2010 OECD Working Party on Trade in Goods and Services.
Advertisements

Multiple Indicator Cluster Surveys Survey Design Workshop
Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?
Correcting for Common Causes of Nonresponse and Measurement Error Andy Peytchev International Total Survey Error Workshop Stowe, June 15, 2010.
2 nd National Pilot Survey of OAA Title III Service Recipients: Key to Planning & Improving Performance Nancy Wellman, PhD, RD National Resource Center.
1 Incorporating Statistical Process Control and Statistical Quality Control Techniques into a Quality Assurance Program Robyn Sirkis U.S. Census Bureau.
The English Longitudinal Study of Ageing (ELSA) Sample design & response Shaun Scholes NatCen.
SAMPLING.
GLOBAL TOBACCO SURVEILLANCE SYSTEM Global Youth Tobacco Survey Training Workshop Introduction to the GYTS Sample Design & Weights.
Jaki S. McCarthy, Daniel G. Beckler, and Suzette M. Qualey Slide 1Slide Slide 1 International Conference on Establishment Surveys III Montreal June 18-21,
NLSCY – Non-response. Non-response There are various reasons why there is non-response to a survey  Some related to the survey process Timing Poor frame.
sampling Dr Majed El-Farra
© John M. Abowd 2005, all rights reserved Analyzing Frames and Samples with Missing Data John M. Abowd March 2005.
USE OF PEAK FLOW METER AS AN OBSERVATION AND TEACHING TOOL IN AN EDUCATIONAL PROGRAM IN WOMEN WITH ASTHMA Noreen M. Clark, Molly Z. Gong, Martha B. DeRoeck,
Chapter 7 Selecting Samples
Methodology for a school- leavers’ survey Irena Kogan MZES, University of Mannheim.
~ Draft version ~ 1 HOW TO CHOOSE THE NUMBER OF CALL ATTEMPTS IN A TELEPHONE SURVEY IN THE PRESENCE OF NONRESPONSE AND MEASUREMENT ERRORS Annica Isaksson.
1 C ensus Data for Transportation Planning Transitioning to the American Community Survey May 11, 2005 Irvine, CA.
COUNTRY PRESENTATION – SINGAPORE INTERNATIONAL WORKSHOP ON INDUSTRIAL STATISTICS BEIJING, CHINA 8-10 JULY 2013.
The Weighting Strategy of the Canadian Community Health Survey Cathlin Sarafin Methodologist Statistics Canada March 25, 2008.
Which physicians and practices are using electronic medical records? Catharine W. Burt, Ed.D. Chief, Ambulatory Care Statistics Branch July 19, 2006 The.
Full-time Undergaduate
Internet Access, Past Year Health-Related Use of the Internet, and Interest in Selected IT Modalities for Health Education Estimates from the 2005 Kaiser.
2014 SDC and CIC Annual Training Conference: Accessing ACS PUMS Data Tim Gilbert U.S. Census Bureau April 2, 2014.
Aspects of the National Health Interview Survey (NHIS) Chris Moriarity National Conference on Health Statistics August 16, 2010
The new HBS Chisinau, 26 October Outline 1.How the HBS changed 2.Assessment of data quality 3.Data comparability 4.Conclusions.
Source: 1997 Economic Census Survey of Minority-Owned Business Enterprises Survey of Minority-Owned Business Enterprises.
McGraw-Hill/Irwin McGraw-Hill/Irwin Copyright © 2009 by The McGraw-Hill Companies, Inc. All rights reserved.
Definitions Observation unit Target population Sample Sampled population Sampling unit Sampling frame.
DESIGN FEATURES OF NCHS SURVEYS By Iris Shimizu Mathematical Statistician Office of Research and Methodology, NCHS Disclaimer: The opinions in this presentation.
TRANSLATING VISITS INTO PATIENTS USING AMBULATORY VISIT DATA (Hypertensive patient case study) by Esther Hing, M.P.H. and Julia Holmes, Ph.D U.S. DEPARTMENT.
Copyright 2010, The World Bank Group. All Rights Reserved. Estimation and Weighting, Part I.
Integrated Health Care Survey Designs: Analytical Enhancements Achieved Through Linkage of Surveys and Administrative Data 2008 European Conference on.
1 Statistical Disclosure Control for Communal Establishments in the UK 2011 Census Joe Frend Office for National Statistics.
© John M. Abowd 2007, all rights reserved Analyzing Frames and Samples with Missing Data John M. Abowd March 2007.
DATA COLLECTION METHODS Sampling
Deriving practice-level estimates from physician-level surveys Catharine W. Burt, EdD and Esther Hing, MPH. Chief, Ambulatory Care Statistics Branch Session.
Scot Exec Course Nov/Dec 04 Survey design overview Gillian Raab Professor of Applied Statistics Napier University.
Topic - 3. Figure 7.1 Population, sample and individual cases.
Physicians’ Decisions to Treat Charity and Medicaid Patients Peter J. Cunningham, Ph.D. Jack Hadley, Ph.D. Presented at AcademyHealth Annual Research Meeting,
Sources of Errors in Estimating Community Health Center Physicians Centers for Disease Control and Prevention National Center for Health Statistics Catharine.
Lecture 9 Prof. Development and Research Lecturer: R. Milyankova
United Nations Regional Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Bangkok,
Copyright 2010, The World Bank Group. All Rights Reserved. Reducing Non-Response Section A 1.
Copyright 2010, The World Bank Group. All Rights Reserved. Reducing Non-Response Section B 1.
Copyright 2010, The World Bank Group. All Rights Reserved. Part 1 Sample Design Produced in Collaboration between World Bank Institute and the Development.
Understanding Sampling
Building Wave Response Rates in a Longitudinal Survey: Essential for Nonsampling Error Reduction or Last In - First Out? Steven B. Cohen Fred Rohde and.
The California Gonorrhea Surveillance System California Department of Public Health STD Control Branch Contact info: Rain Mocello, MPH
THE HIT ADOPTIONINITIATIVE The George Washington University School of Public Health and Health Services The Institute for Health Policy at MGH/Partners.
7: Sampling Theory and Methods. 7-2 Copyright © 2008 by the McGraw-Hill Companies, Inc. All rights reserved. Hair/Wolfinbarger/Ortinau/Bush, Essentials.
Household Surveys: American Community Survey & American Housing Survey Warren A. Brown February 8, 2007.
Interviewer Effects on Paradata Predictors of Nonresponse Rachael Walsh, US Census Bureau James Dahlhamer, NCHS European Survey Research Association, 2015.
Changes to the collection of short walk data in the NTS Glenn Goodman, DfT.
11 How Much of Interviewer Variance is Really Nonresponse Error Variance? Brady T. West Michigan Program in Survey Methodology University of Michigan-Ann.
Towards an improvement of current migration estimates for Italy Domenico Gabrielli, Maria Pia Sorvillo Istat - Italy Joint UNECE-Eurostat Work session.
Statistics Canada Citizenship and Immigration Canada Methodological issues.
CASE STUDY: NATIONAL SURVEY OF FAMILY GROWTH Karen E. Davis National Center for Health Statistics Coordinating Center for Health Information and Service.
Assessing Nonresponse Bias and Measurement Error Using Statistical Matching John Dixon U.S. Bureau of Labor Statistics June 15, 2010 The opinions.
Sample Design of the National Health Interview Survey (NHIS) Linda Tompkins Data Users Conference July 12, 2006 Centers for Disease Control and Prevention.
Copyright © 2014, 2011 Pearson Education, Inc. 1 Chapter 13 Samples and Surveys.
Slide 7.1 Saunders, Lewis and Thornhill, Research Methods for Business Students, 5 th Edition, © Mark Saunders, Philip Lewis and Adrian Thornhill 2009.
Copyright 2010, The World Bank Group. All Rights Reserved. Producer prices, part 2 Measurement issues Business Statistics and Registers 1.
Table 1. Methodological Evaluation of Observational Research (MORE) – observational studies of incidence or prevalence of chronic diseases Tatyana Shamliyan.
Sampling Designs and Sampling Procedures
USE OF PEAK FLOW METER AS AN OBSERVATION AND TEACHING TOOL IN AN EDUCATIONAL PROGRAM IN WOMEN WITH ASTHMA Noreen M. Clark, Molly Z. Gong, Martha B. DeRoeck,
Determining Subsampling Rates for Nonrespondents
Presentation transcript:

© 2006 IMS Health Incorporated or its affiliates. All rights reserved. June 20, 2007 Determination of Target Sample Sizes for Physicians Surveys Darrell J. Philpot Kennon R. Copeland IMS Health

© 2006 IMS Health Incorporated or its affiliates. All rights reserved. ICES III Physician Nonresponse June 20, Outline Overview Physician Panel Survey Participation Selected Physician Survey Methodologies Non-participation Considerations Prior Participation Rate Modeling New Participation Rate Models Implications for Physician Sample Design Summary

© 2006 IMS Health Incorporated or its affiliates. All rights reserved. ICES III Physician Nonresponse June 20, Overview Sample design is established based upon number of completed responses  Total size, allocation to strata developed to provide most efficient estimates Non-participation will reduce effective sample size  Sample variance will be greater than that targeted by design  If weighting carried out at higher level than design, can adversely affect accuracy of estimates Sample design should account for expected participation rates  Logistic modeling typically carried out  Olsen, et. al., looked at problem from Bayesian point of view

© 2006 IMS Health Incorporated or its affiliates. All rights reserved. ICES III Physician Nonresponse June 20, Physician Panel Survey Participation Survey Recruitment  Noncontact: Unable to contact sample unit before end of survey recruitment period  Ineligible: Sample unit not in scope for survey  Non-agree: Sample unit is eligible, but refuses or is otherwise not available to report  Agree: Sample unit is eligible and agrees to participate Survey Reporting Nonreporter: Agreed sample unit does not return survey form Reporter: Agreed sample unit returns survey form Panel Survey Reporting  Reporting rates may differ for first, subsequent interview periods

© 2006 IMS Health Incorporated or its affiliates. All rights reserved. ICES III Physician Nonresponse June 20, Physician Panel Survey Participation Components Noncontacts 1 st Period Reporters Non-agrees Nonreporters Selected Sample Subsequent Period Reporters Subsequent Period Nonreporters Agrees Ineligibles

© 2006 IMS Health Incorporated or its affiliates. All rights reserved. ICES III Physician Nonresponse June 20, Physician Survey Methodology: National Disease and Therapeutic Index Office-based physicians, recording information on all patient contacts in assigned reporting period Panel of physicians 1,373 per month 4,120 unique per quarter Stratified by 108 primary specialties by 9 geographic divisions (sample design) Aggregated into 30 group specialties by 4 geographic regions (estimation) Reporting period 2 randomly selected, consecutive days per quarter

© 2006 IMS Health Incorporated or its affiliates. All rights reserved. ICES III Physician Nonresponse June 20, Physician Survey Methodology: Office Promotion Report Office-based physicians, recording information on all pharmacy rep contacts in reporting period Panel of physicians 4,011 per month Stratified by 27 group specialties by 43 state groups (sample design) Aggregated into 27 group specialties by 4 regions (estimation) Reporting period Full month

© 2006 IMS Health Incorporated or its affiliates. All rights reserved. ICES III Physician Nonresponse June 20, Physician Survey Methodology: Patient Contact Survey Office-based physicians, reporting information on patient contact days in reporting period Panel of physicians 4,011 per month Stratified by 30 group specialties by 4 regions (sample design) Aggregated into 30 group specialties by 4 regions (estimation) Reporting period Prior 5 days

© 2006 IMS Health Incorporated or its affiliates. All rights reserved. ICES III Physician Nonresponse June 20, Participation Rate Modeling: Prior Models Historical models account for difference in response rate by: Specialty Group (collection of self defined primary specialty from either the AMA or AOA) Geography (State, Census Region)

© 2006 IMS Health Incorporated or its affiliates. All rights reserved. ICES III Physician Nonresponse June 20, Participation Rate Modeling: New Models New models will include additional factors like: Age of physician Gender of physician Location (Urban/Rural, area economics) Type of practice Physician workload Resulting in increase accuracy in the predicted response rates

© 2006 IMS Health Incorporated or its affiliates. All rights reserved. ICES III Physician Nonresponse June 20, Participation Rate Modeling (New): National Disease and Therapeutic Index

© 2006 IMS Health Incorporated or its affiliates. All rights reserved. ICES III Physician Nonresponse June 20, Participation Rate Modeling (New): Office Promotion Reports

© 2006 IMS Health Incorporated or its affiliates. All rights reserved. ICES III Physician Nonresponse June 20, Participation Rate Modeling (New): Patient Contact Survey

© 2006 IMS Health Incorporated or its affiliates. All rights reserved. ICES III Physician Nonresponse June 20, Participation Rate Modeling: Implication for Sample Designs Sample Design become more complicated And/or post-stratification

© 2006 IMS Health Incorporated or its affiliates. All rights reserved. ICES III Physician Nonresponse June 20, Summary Factors other than Specialty and Geography can influence physicians willingness to participate in primary research study Impact can differs depending on the type of study Depending on the objective of the study it may be necessary to consider some of additional factors in your sampling plan to insure your desired number of respondents Age, gender, Type of practice, Urban/Rural setting, economics of the surround area or other