Deriving practice-level estimates from physician-level surveys Catharine W. Burt, EdD and Esther Hing, MPH. Chief, Ambulatory Care Statistics Branch Session 32 June 20, 2007 ICES III, Montreal, Canada U.S. DEPARTMENT OF HEALTH AND HUMAN SERVICES Centers for Disease Control and Prevention National Center for Health Statistics

Topics  Introduction  Multiplicity theory  Re-weighting methods  Application to NAMCS  Assumptions  Analytical example  Limitations

Multiplicity theory  Multiplicity occurs when the same observation unit can be counted multiple times among the selection units eg., same patient is counted in multiple records of visits/discharges or same medical practice is counted in records of multiple physicians eg., same patient is counted in multiple records of visits/discharges or same medical practice is counted in records of multiple physicians  Using principles of network sampling, you can adjust weights to estimate the observations of interest rather than the selection units

Desired observation units Survey selection units

Greek for the Geeks = the selection probability of physician i (i = 1, …, N) and if physician i is affiliated with practice j, and if physician i is not affiliated with practice j.

Weight adjustment to estimate X  Observation weight = selection weight / M where M is the multiplicity information for the selection unit

Re-weighting methodology  Assumptions and definitions Use multiplicity information from the physician data to adjust physician-level estimates into practice-level estimates Use multiplicity information from the physician data to adjust physician-level estimates into practice-level estimates Dividing the physician sampling weight by number of physicians in the practice provides a measure of practices Dividing the physician sampling weight by number of physicians in the practice provides a measure of practices

Physicians ► practices example…  Samples of physician records in medical practices  Physician data have the same practice included in multiple observations.  If we knew how many physicians were in the same practice as the sampled physicians, then we can adjust the estimator to account for the multiplicity.

Application to NAMCS  National Ambulatory Medical Care Survey  Annual survey of 3,000 nationally representative office-based physicians in patient care  Excludes radiologists, anesthesiologists, and pathologists and federally-employed physicians  Face-to-face induction interview asks physicians questions about his/her office practice  Records are weighted by the inverse of the probability of selection, adjusted for nonresponse (~60% RR), with a calibration ratio to annual totals

Induction interview content  Number of locations Number of other physicians Number of other physicians Ownership Ownership Type of office Type of office Private, clinic, HMO, faculty practice plan, etcPrivate, clinic, HMO, faculty practice plan, etc  EMR adoption  Revenue sources

Assumptions Used the first location reported Used the first location reported Assumes practice information provided by sample physician is a constant for the practice Assumes practice information provided by sample physician is a constant for the practice Does not account for multiplicity of practices within a physician Does not account for multiplicity of practices within a physician i.e., Ignores the fact that some physicians are affiliated with multiple practices (about 1% of physicians)i.e., Ignores the fact that some physicians are affiliated with multiple practices (about 1% of physicians)

3 medical practices with a total of 7 physicians Solo practicePartner practiceGroup practice

4/7 2/71/7 Probability of selecting a practice

4/72/7 1/ Multiplicity factor

Multiplicity information  How many other physicians practice with you at this location?  M= 1+ # of other physicians  Practice weight = physician weight / M

Re-weighting example Practice size Physician weight Multiplicity adjustment Practiceweight solo10110 partner Sum = 110 physicians 43 practices

 Practice weight = physician weight / practice size  physician weight → 311,200 physicians ± 8,000 ± 8,000  practice weight → 161,200 practices ± 5,300 ± 5,300

Percent distribution of office-based medical physicians and practices by size PhysiciansPractices

Computerized administrative and clinical support systems Uses electronic billingUses EMRUses CPOE PracticesPhysicians

Limitations of NAMCS data…  Good National estimates of practices National estimates of practices Characteristics that are common among physicians Characteristics that are common among physicians  Bad Characterizing practices Underestimates larger practices Be careful how you define size First-listed location Location with most visits Location of the visit