AASHTO & FHWA Appeal re: DRB “rule of three” decision before the Data Stewardship Executive Policy Committee 8/28/2008.

Slides:



Advertisements
Similar presentations
1 ACS Data Products for Use in Transportation Planning: 2004 and Beyond By Phillip Salopek Chief, Journey to Work and Migration Statistics Branch Population.
Advertisements

11 ACS Public Use Microdata Samples of 2005 and 2006 – How to Use the Replicate Weights B. Dale Garrett and Michael Starsinic U.S. Census Bureau AAPOR.
Access routes to 2001 UK Census Microdata: Issues and Solutions Jo Wathan SARs support Unit, CCSR University of Manchester, UK
1 U.S. Census Bureau Data Availability for Geographic Areas March 25, 2008.
1 The American Community Survey (ACS) 2005 Data Release.
1 Commuting and Migration Data Products from the American Community Survey Journey-to-Work and Migration Statistics Branch U.S. Census Bureau State Data.
Commuting in America Using the ACS to Develop a National Report on Commuting Patterns and Trends Penelope Weinberger, CTPP Program Manager, AASHTO ACS.
To see first hand how the TAZ/TAD development software works Why are we here Today?
United Nations Economic Commission for Europe Statistical Division Applying the GSBPM to Business Register Management Steven Vale UNECE
County-to-County Worker Flow Map Journeys To and From Hampden MA.
American Community Survey Continuous Survey Methodology 250,000 Households sampled per month About 1 in 40 Households sampled per.
Census Transportation Planning Products (CTPP) Data Products June 18, 2010.
Equal Employment Opportunity (EEO) Special Tabulation by Jennifer Cheeseman Day Presentation for the State Data Centers Annual Meeting October 15, 2010.
11 The American Community Survey Steve Murdock, Ph.D. Director, Hobby Center for the Study of Texas Rice University.
COMMUTING IN AMERICA 2013 ALAN E. PISARSKI PRESERVING THE AMERICAN DREAM Oct 2013.
Household Surveys ACS – CPS - AHS INFO 7470 / ECON 8500 Warren A. Brown University of Georgia February 22,
American Community Survey Presented at the Meeting of the National Neighborhood Indicators Partnership Susan Schechter May
Issues Related to Data Dissemination in Official Statistics Presented at the European Conference On Quality in Official Statistics Helsinki, Finland May.
But what about the ACS? What is the American Community Survey? Replacement of the Long Form Continuous Survey Methodology Conducted Monthly.
111 American Community Survey Fundamentals 2009 Population Association of America ACS Workshop April 29, 2009.
Microdata Simulation for Confidentiality of Tax Returns Using Quantile Regression and Hot Deck Jennifer Huckett Iowa State University June 20, 2007.
Census Transportation Planning Products Program Penelope Weinberger CTPP Program Manager - AASHTO GIS in Public Transportation Conference (September 14,
Plans For the First Release of American Community Survey 5-year Estimates Prepared for the Joint Meetings of the SDC and CIC Steering Committees February.
Workshop #2 Summary Participant Reactions to the American Community Survey (ACS) Facilitators: John Adams, Elaine Murakami, Bob Sicko, Ed Christopher &
1 Commuting and Migration Data Products from the American Community Survey Journey-to-Work and Migration Statistics Branch U.S. Census Bureau 2010 State.
Using 5-year ACS for Transportation Planning Applications Elaine Murakami FHWA Office of Planning (in Seattle) 1.
The World of Census DATA according to Ed Christopher FHWA Resource Center Planning Team an update of relevant activities.
Census Transportation Planning Products (CTPP) Program Overview March 11, 2010.
1 Public Transportation Data in the American Community Survey (ACS) and Census Transportation Planning Products (CTPP) Dec 3, 2009 AASHTO Standing Committee.
Chicago Traffic Analysis Zones 9-Counties 1990 Population: 7,429,181 Area (sq. miles): 137 Number of zones: 14,127 People per zone: 526 Resident workers:
Working with the data
Ed Christopher Resource Center near Chicago Federal Highway Administration Governors Drive Olympia Fields, IL 60461
Using IPUMS.org Katie Genadek Minnesota Population Center University of Minnesota The IPUMS projects are funded by the National Science.
Integrating ACS with the World’s Census Data: ACS Microdata and the IPUMS Presented at the Pre-ALAP ACS/IPUMS Workshop November 16, 2010 Trent Alexander.
Record matching for census purposes in the Netherlands Eric Schulte Nordholt Senior researcher and project leader of the Census Statistics Netherlands.
1 Statistical Disclosure Control for Communal Establishments in the UK 2011 Census Joe Frend Office for National Statistics.
ACS Plans, Expectations and Products 2010 Census Slides available at USS CTPP.
GEOG3025 Confidentiality and social implications.
American Community Survey Maryland State Data Center Affiliate Meeting September 16, 2010.
American Community Survey (ACS) 1 Oregon State Data Center Meeting Portland State University April 14,
Vital Event Data Release Scoring Criteria 5 June, 2005 NAPHSIS Meeting – Cincinnati, OH Mark Flotow Illinois Center for Health Statistics, IDPH.
2011 Census: Lessons learned from the Business Sector Dr Barry Leventhal MRS Census & Geodemographics Group CAG Meeting 8 th January 2015.
The Impact of Disclosure Control on Labour Market Statistics (& other issues)– the User’s Gripes Jill Tuffnell Head of Research Cambridgeshire County Council.
Developing Survey Handbooks as Educational Tools for Data Users Presented at the European Conference on Quality in Official Statistics May 2010 Deborah.
Some ACS Data Issues and Statistical Significance (MOEs) Table Release Rules Statistical Filtering & Collapsing Disclosure Review Board Statistical Significance.
Data Products and Availability Census Data for Transportation Planning “Preparing for the Future” May 13, 2005 Data Products and Availability Help us get.
American Community Survey “It Don’t Come Easy”, Ringo Starr Jane Traynham Maryland State Data Center March 15, 2011.
Journey to Work from 1990 Census and ACS National test (C2SS) Elaine Murakami, USDOT, FHWA Nanda Srinivasan, Cambridge Systematics Inc.
Statistical data confidentiality and micro data in Albania
1 Decennial Census Ed Christopher Resource Center Planning Team Federal Highway Administration 4749 Lincoln Mall Dr. Rm 600 Matteson, IL
Disclosure Limitation in Microdata with Multiple Imputation Jerry Reiter Institute of Statistics and Decision Sciences Duke University.
Household Surveys: American Community Survey & American Housing Survey Warren A. Brown February 8, 2007.
Disclosure Control in the UK Census Keith Spicer 11 January 2005.
Creating Open Data whilst maintaining confidentiality Philip Lowthian, Caroline Tudor Office for National Statistics 1.
Access to microdata in the Netherlands: from a cold war to co-operation projects Eric Schulte Nordholt Senior researcher and project leader of the Census.
The 2011 Census: Estimating the Population Alexa Courtney.
Emerging Issues for Transportation Data Users of ACS Elaine Murakami, FHWA TRB Planning Applications Conference, April 26,
Census 2011 – A Question of Confidentiality Statistical Disclosure control for the 2011 Census Carole Abrahams ONS Methodology BSPS – York, September 2011.
ASDC Annual Meeting November 10, 2011 Kathleen Gabler Socioeconomic Research Associate Center for Business and Economic Research Culverhouse College of.
11 Measuring Disclosure Risk and Data Utility for Flexible Table Generators Natalie Shlomo, Laszlo Antal, Mark Elliot University of Manchester
Census Data-Strictly Business?:
Disclosure scenario and risk assessment: Structure of Earnings Survey
Working with the data.
Journey-to-Work and Migration Statistics Branch U.S. Census Bureau
Dissemination Workshop for African countries on the Implementation of International Recommendations for Distributive Trade Statistics May 2008,
Census Data The 2005 Census American Community Survey estimated 3,291,401 people used walking as their primary mode of travel for their journey to work.
2001 Census Disclosure Control UK variations
Data issues with the American Community Survey
Traffic analysis zones
Protecting the Confidentiality of the 2020 Census Statistics
Presentation transcript:

AASHTO & FHWA Appeal re: DRB “rule of three” decision before the Data Stewardship Executive Policy Committee 8/28/2008

Why we are here – in broad terms 1.The ACS-based Census Transportation Planning Products (CTPP) program is critical to investment decisions of hundreds of billions of dollars, as well as environmental, safety and homeland security issues 2.CTPP is a core data program of federal/state and metropolitan transportation planning and administrative agencies that is now threatened by the DRB action

CTPP tables request in late February 2008 DRB ruling “3 unweighted records PER CATEGORY of Means of Transportation to work” in cross- tabulations. DRB ruling is onerous and will suppress many tables, even when geography is large (population threshold = 20,000) and the categories for Means of Transportation are reduced We believe the threshold rule is unnecessary. Even when the rule is removed the CB will still maintain individual confidentiality Why we are here – Specifically CTPP table request using ACS samples ( )

Means of Transportation to Work 17 categories-- full list 10 categories -- Collapsed Drove Alone Carpool- 2 Carpool -3 Carpool – 4 or more Bus Streetcar, subway, elevated Railroad, ferry Bicycle or walked Taxi, motorcycle, other Worked at home

The AASHTO/FHWA position It is our view that in this application –Present disclosure safeguards are entirely adequate to protect confidentiality –Present CTPP consistent with previously acceptable approaches –The proposed DRB “rule of three” has not been supported by evidence –All evidence points to the contrary –Imposition of the rule will effectively destroy CTPP program and our support for ACS. (up to 80% of areas affected)

New rule for 3-year CTPP is far more onerous than for others ACS (Micro data) 1% Census 2000 LF Tract CTPP 2000 TAZ or BG “NEW” CTPP with ACS Population100,0004,0001,20020,000 Estimated unwgted sample (persons) 1,

Protections 1.ACS Survey Design and Collection 2.Survey Processing and Post- processing (including tabulations)

1. ACS Survey Design and Collection Small sample (about 4% after 3 years) –Address Based – not person based sample 36 months of data accumulation –Changes over time, especially residential moves, workplace changes, and related changes, esp. to journey-to-work –Period Estimate not point in time Question wording “usually get to work last week”

2. Survey Processing and Post-processing (including tabulation) Complex weighting scheme Data Swapping Imputation Tables, not microdata Tabulation limited to large geog (20,000+ pop) Variables collapsed and grouped Data averaging and adjusting (moving the income values to last year e.g. 2007)

AASHTO commissioned data-driven disclosure risk analysis Research conducted by Westat Emulated Snooping using Intruder Scenario Important findings: –Confirmed Risk vs Data Utility imbalance –Pseudo-Micro data addressed — “file” risk is extremely low –“Individual” Risk-level is low- Similar to ACS annual PUMS –Recommendation to drop DRB restrictions on 3-year CTPP –Mode to Work, critical to users and not a critical disclosure risk variable

Worst case 3 in 100 chance of identifying an individual record Data snooper would have to: –Create a pseudo-micro record using cross- tabulated table cell labels as variables and match to the ACS PUMS to gain additional detailed variables –Find a high quality external file (e.g., publicly available person-level registry or a confidential data set), that have personal identifiers (name, address, etc) –Find a unique record in external file that matches CTPP/ACS micro record

Ultimate Disclosure test Not the identification of a unique record at issue “ It is against the law to disclose or publish any private information that identifies an individual or business : No names No addresses No Social Security Numbers No telephone numbers”

We Face a Policy Challenge We have invested a fortune in this program We were sold the new ACS program based on its greater utility in our work We have been among the strongest supporters of the program The Bureau has not been helpful in addressing the challenges of ACS The Bureau has used the transportation support as a major argument for the benefits of the ACS products

Conclusion The Data Stewardship Executive Policy Committee should find that existing safeguards are effective and adequate to the task of protecting confidentiality in this application, and The Data Stewardship Executive Policy Committee should not permit “the rule of three” disclosure rule to be instituted at this late stage in this application

BUT, IF WE CANNOT GET WHAT WE NEED AND EXPECTED FROM THE ACS WE WILL BE FORCED TO WALK AWAY FROM THE PLANNED CTPP PROGRAM WITH THE CENSUS BUREAU WHICH WILL SHARPLY DIMINISH THE SENSE OF THE VALUE OF THE ENTIRE ACS PROGRAM!

Thank you ! Jack Basso, AASHTO Gloria Shepherd, FHWA Alan Pisarski, Consultant Ron McCready, AASHTO Elaine Murakami, FHWA Ed Christopher, FHWA Mark Freedman, Westat Tom Krenzke, Westat