Collecting Electronic Data From the Carriers: the Key to Success in the Canadian Trucking Commodity Origin and Destination Survey François Gagnon and Krista.

Slides:



Advertisements
Similar presentations
Use of Tax Data in the Unified Enterprise Survey (UES) Workshop on Use of Administrative Data in Economics Statistics Marie Brodeur Moscow November, 2006.
Advertisements

By: Saad Rais, Statistics Canada Zdenek Patak, Statistics Canada
Swedish Commodity Flow Surveys Evaluated Swedish Commodity Flow Surveys Evaluated – Statistics Swedens Experiences and Survey Adjustments Since 2001 Session.
1 ESTIMATION IN THE PRESENCE OF TAX DATA IN BUSINESS SURVEYS David Haziza, Gordon Kuromi and Joana Bérubé Université de Montréal & Statistics Canada ICESIII.
The Challenge of Integrating New Surveys into an Existing Business Survey Infrastructure Éric Pelletier Statistics Canada ICES-III Montréal, Québec, Canada.
1 Sharing best practices for the redesign of three business surveys Charles Tardif, Business Survey Methods Division,Statistics Canada presented at the.
Survey of Electronic Commerce and Technology: Past, Present and Future Challenges Jason Raymond Third International Conference on Establishment Surveys.
Migration of a large survey onto a micro-economic platform Val Cox April 2014.
Improvements to the Quality of Tax Data in the Context of their Use in Business Surveys at Statistics Canada François Brisebois, Martin Beaulieu, Richard.
Towards a Better Integration of Survey and Tax Data in the Unified Enterprise Survey Claude Turmelle Statistics Canada ICES-III Montréal, Québec, Canada.
Estimates and sampling errors for Establishment Surveys International Workshop on Industrial Statistics Beijing, China, 8-10 July 2013.
Sampling Strategy for Establishment Surveys International Workshop on Industrial Statistics Beijing, China, 8-10 July 2013.
The Many Ways of Improving the Industrial Coding for Statistics Canada’s Business Register Yanick Beaucage ICES III June 2007.
François Brisebois, Statistics Canada International Total Survey Error Workshop June 15, 2010 Improvements to Economic Survey Methodologies to Reduce Revisions.
Disaggregate State Level Freight Data to County Level October 2013 Shih-Miao Chin, Ph.D. Ho-Ling Hwang, Ph.D. Francisco Moraes Oliveira Neto, Ph.D. Center.
© 2002 Prentice-Hall, Inc.Chap 1-1 Statistics for Managers using Microsoft Excel 3 rd Edition Chapter 1 Introduction and Data Collection.
Who and How And How to Mess It up
Sampling.
A new sampling method: stratified sampling
An Integrated Approach to Economic Statistics “ The Canadian Experience” UNSD – IBGE Workshop on Manufacturing Statistics Kevin Roberts Rio de Janeiro,
COUNTRY PRESENTATION – SINGAPORE INTERNATIONAL WORKSHOP ON INDUSTRIAL STATISTICS BEIJING, CHINA 8-10 JULY 2013.
08/08/2015 Statistics Canada Statistique Canada Paradata Collection Research for Social Surveys at Statistics Canada François Laflamme International Total.
André Loranger New York, June 2014 The Integrated Business Statistics Program at Statistics Canada Presentation to the UNCEEA Assistant Chief Statistician.
Trade and business statistics: use of administrative data Lunch Seminar Enrico Giovannini Italian National Statistical Institute (ISTAT) New York, February,
Social Research Methods
Key terms in Sampling Sample: A fraction or portion of the population of interest e.g. consumers, brands, companies, products, etc Population: All the.
Use of administrative data in statistics - challenges and opportunities ICES III End Panel Discussion Montreal, June 2007 Heli Jeskanen-Sundström Statistics.
Seminar on Developing a Programme on Integrated Statistics in the Caribbean Saint Lucia The Components of an Integrated Business and International Statistics.
18/08/2015 Statistics Canada Statistique Canada Responsive Collection Design (RCD) for CATI Surveys and Total Survey Error (TSE) François Laflamme International.
National Household Survey: collection, quality and dissemination Laurent Roy Statistics Canada March 20, 2013 National Household Survey 1.
Combining administrative and survey data: potential benefits and impact on editing and imputation for a structural business survey UNECE Work Session on.
Administrative Data at Statistics Canada – Current Uses and the Way Forward 27 th Voorburg Group Meeting Warsaw, Poland André Loranger October 4, 2012.
Metadata: Integral Part of Statistics Canada Quality Framework International Conference on Agriculture Statistics October 22-24, 2007 Marcelle Dion Director.
McGraw-Hill/Irwin McGraw-Hill/Irwin Copyright © 2009 by The McGraw-Hill Companies, Inc. All rights reserved.
Near East Regional Workshop - Linking Population and Housing Censuses with Agricultural Censuses. Amman, Jordan, June 2012 Improving Efficiency.
Copyright 2010, The World Bank Group. All Rights Reserved. Estimation and Weighting, Part I.
Sampling: Theory and Methods
The Canadian Integrated Approach to Economic Surveys Marie Brodeur, Peter Koumanakos, Jean Leduc, Éric Rancourt, Karen Wilson Statistics Canada International.
Designing the 2007 Commodity Flow Survey Authors: Scot Dahl, William C. Davie, Jr US Census Bureau Presented by: Ruth Detlefsen US Census Bureau June 19,
1 Presentation to OG6 Canberra, Australia May 2011 Statistical Uses of Administrative Data in Canada.
Use of Administrative Data in Statistics Canada’s Annual Survey of Manufactures Steve Matthews and Wesley Yung May 16, 2004 The United Nations Statistical.
Central egency for public mobilization and statistics.
Overview of error model for estimates of foreign-born immigration using data from the American Community Survey Mary H. Mulry U.S. Census Bureau 2011 International.
The Future of Administrative Data ICES III End Panel Discussion Don Royce Statistics Canada June 2007.
Workshop on Price Index Compilation Issues February 23-27, 2015 Sample Design, Selection, and Maintenance Gefinor Rotana Hotel, Beirut, Lebanon.
Lesli Scott Ashley Bowers Sue Ellen Hansen Robin Tepper Jacob Survey Research Center, University of Michigan Third International Conference on Establishment.
Impact of using fiscal data on the imputation strategy of the Unified Enterprise Survey of Statistics Canada Ryan Chepita, Yi Li, Jean-Sébastien Provençal,
Martin Pantel Business Surveys Methods Division Third International Conference on Establishment Surveys June 2007 Classifying Agricultural Operations for.
European Conference on Quality in Official Statistics Roma, July 8-11, 2008 New Sampling Design of INSEE’s Labour Force Survey Sébastien Hallépée Vincent.
Performance of Resampling Variance Estimation Techniques with Imputed Survey data.
ICES III - Montréal, Canada Listening to Respondents for Better Results Alexander Hays Distributive Trades Division Statistics Canada.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 1-1 Statistics for Managers Using Microsoft ® Excel 4 th Edition Chapter.
United Nations Economic Commission for Europe Statistical Division Mapping Data Production Processes to the GSBPM Steven Vale UNECE
Methodology of Allocating Generic Field to its Details Jessica Andrews Nathalie Hamel François Brisebois ICESIII - June 19, 2007.
A Theoretical Framework for Adaptive Collection Designs Jean-François Beaumont, Statistics Canada David Haziza, Université de Montréal International Total.
RTI International is a trade name of Research Triangle Institute 6110 Executive Blvd. ■ Suite 902 ■ Rockville, Maryland, USA Phone
A Quality Driven Approach to Managing Collection and Analysis
Household Surveys: American Community Survey & American Housing Survey Warren A. Brown February 8, 2007.
Chapter 10 Sampling: Theories, Designs and Plans.
Lesson Sources of Errors in Sampling. Objectives Understand how error can be introduced during sampling.
Statistics Canada Citizenship and Immigration Canada Methodological issues.
1 of 22 INTRODUCTION TO SURVEY SAMPLING October 6, 2010 Linda Owens Survey Research Laboratory University of Illinois at Chicago
Unified Enterprise Survey New Horizons International Conference on Establishment Surveys Daniela Ravindra and Marie Brodeur Montreal, June 2007 Statistics.
Administrative Data at Statistics Canada – Current Uses and the Way Forward Wesley Yung and Peter Lys, Statistics Canada.
PRESENTED BY- MEENAL SANTANI (039) SWATI LUTHRA (054)
Copyright 2010, The World Bank Group. All Rights Reserved. Producer prices, part 2 Measurement issues Business Statistics and Registers 1.
Social Research Methods
An Active Collection using Intermediate Estimates to Manage Follow-Up of Non-Response and Measurement Errors Jeannine Claveau, Serge Godbout and Claude.
Mapping Data Production Processes to the GSBPM
Étienne Saint-Pierre, Statistics Canada
Presentation transcript:

Collecting Electronic Data From the Carriers: the Key to Success in the Canadian Trucking Commodity Origin and Destination Survey François Gagnon and Krista Cook Statistics Canada ICES III, Montreal, June 2007

PRESENTATION Outline 1. Background 2.Methodology of the Redesigned Survey 3.Advantages/Disadvantages of the Canadian Approach 4.Challenges of Collecting Electronic Data 5.Conclusion

1. BACKGROUND Commodity Flow Surveys in Canada Shipments Ship Rail Truck from admin data (census) from admin data (census) TCOD

1. BACKGROUND What is TCOD? – Purpose : To measure trucking commodity movements – Unit of interest : Shipments – Variables collected for each shipment : commodity carried, tonnage origin and destination of shipment distance, transportation revenues – Outputs : Estimates and CVs, microdata file – Input to : System of National Accounts – Main user & Co-sponsor: Transport Canada

1. BACKGROUND Why a redesign? -TCOD was developed in the early 1970s -In 2000, Statistics Canada approved a multi- year project to redesign the survey  To improve data quality  To better meet the new requirements of the users - Constraint: no additional production costs

1. BACKGROUND Addressing data coverage needs Needs identified and decisions made  Trucking industry  Long-distance & local   $1M (in terms of company revenue)  < $1M (in terms of company revenue)  Trucking activity in non-trucking businesses (Private trucking)  Foreign companies : no frame for now

1. BACKGROUND Addressing other needs  Annual data  Provincial & Territorial estimates  Improve precision  Other variables such as “value of shipment”: not available on shipping documents => Improve coverage + precision + detail AT NO ADDITIONAL COST: a good challenge!

$ 1 M  Revenue Long Distance Local Trucking companiesNon-trucking companies Canadian Companies Foreign Companies Old TCOD Coverage Added Coverage in the new TCOD 1,828 1, REDESIGNED TCOD Coverage of the Old and New TCODs ( Number of Companies) Other trucking activity Hhld goods moving Source: BR

2. REDESIGNED TCOD Key estimates to be produced Key domains: Matrix: Origin x Destination x Commodity Key variables of interest: => Tonnage, Distance, Revenue => Sample size in each cell of the matrix is random

2. REDESIGNED TCOD Need for a larger sample size Main challenge of commodity flow surveys: No efficient stratification possible to control sample size by estimation domain (O/D/Commodity cells) => random sample size in O/D/Commodity cells => poor precision in many estimation domains One solution: increase sample size  Old TCOD: 0.5 M shipments (sampling fraction: 0.8%)  New TCOD: 7.4 M shipments (sampling fraction: 11.2%)

2. REDESIGNED TCOD Data Collection A) Personal on-site visits Similar process to the old TCOD Improved CAPI application 79% of the sampled companies (was 91%)  reduction of the overall collection costs (since this collection method is expensive) 0.2 M shipments (comparable to the old TCOD)

2. REDESIGNED TCOD Data Collection B) Profiling using CATI Used for all companies with < 50 combinations of Origin/Destination/Type of commodity 21% of the sampled companies (was 9%) 3.7 M shipments in the sample (49% of the sample) => Profiling allows to: Reduce collection costs Improve precision ( through an increased sample size )

2. REDESIGNED TCOD Data Collection C) Electronic Data Reporting (EDR) ► 1 st years of the new TCOD - for the same 7 large companies - 100% of their data (only 5% in the old TCOD) M shipments (48% of the total sample) - automation of coding + imputation ► Future years: - potentially 200+ companies => EDR will allow to: Reduce collection costs Improve precision ( through an increased sample size )

2. REDESIGNED TCOD Sample Design 4-Stage Design:  1 st stage: Stratified SRSWOR of companies  Must-take strata for Profile & EDR companies > 2 nd stage: Sample of a period of time (e.g., a 6-month period) > 3 rd stage: Systematic sample of shipping documents > 4 th stage: Systematic sample of shipments

2. REDESIGNED TCOD Domain Estimation where: y hitjk = value of the variable of interest for the shipment k on shipping document j from the survey period t of company i in stratum h d = domain of interest >> Variance estimation: Jackknife method

3. CANADIAN APPROACH vs. Other Commodity Flow Surveys Most other commodity flow surveys Collect shipment information from the shippers Canadian TCOD Collects shipment information from the carriers

3. CANADIAN APPROACH Advantages Survey population clearly defined: no subjective decision on which industries (NAICS) to include Collection via EDR & profiles large increase of sample size at a minimal cost reduces sampling errors estimates at a more detailed level On-site collection reduces non-sampling errors higher response rate => reduces nonresponse bias

3. CANADIAN APPROACH Disadvantages Incomplete coverage of trucking activity On-site collection is very expensive Variable “value of commodity” cannot be collected

4. COLLECTING ELECTRONIC DATA Challenges Companies’ data vs. TCOD variables file formats + concepts Security of electronic data Automation of the processing coding of commodities and origin/destination imputation of commodities

5. CONCLUSION Canadian Approach Collection from the carriers: Larger sampling fraction => reduces sampling errors On-site collection: => reduces non-sampling errors => higher response rate Electronic data collection: huge potential to be developed in future years!

For more information please contact Pour plus d’information, veuillez contacter François Gagnon Krista Cook