The Many Ways of Improving the Industrial Coding for Statistics Canada’s Business Register Yanick Beaucage ICES III June 2007.

Slides:



Advertisements
Similar presentations
The Business Register Research, Design and Evaluation Division Statistical Institute of Jamaica.
Advertisements

Towards a simpler and more efficient BR June 19, 2007 ICES-III Montréal (QC)
Survey of Electronic Commerce and Technology: Past, Present and Future Challenges Jason Raymond Third International Conference on Establishment Surveys.
LeadManager™- Internet Marketing Lead Management Solution May, 2009.
Improvements to the Quality of Tax Data in the Context of their Use in Business Surveys at Statistics Canada François Brisebois, Martin Beaulieu, Richard.
Towards a Better Integration of Survey and Tax Data in the Unified Enterprise Survey Claude Turmelle Statistics Canada ICES-III Montréal, Québec, Canada.
Estimates and sampling errors for Establishment Surveys International Workshop on Industrial Statistics Beijing, China, 8-10 July 2013.
Sampling Frames for Establishment Surveys International Workshop on Industrial Statistics Beijing, China, 8-10 July 2013.
Sampling Strategy for Establishment Surveys International Workshop on Industrial Statistics Beijing, China, 8-10 July 2013.
United Nations Statistics Division Principles and concepts of classifications.
Unified theory of software evolution Reengineering – Business process reengineering and software reengineering BPR model – Business definition, process.
Quality evaluation and improvement for Internal Audit
An Integrated Approach to Economic Statistics “ The Canadian Experience” UNSD – IBGE Workshop on Manufacturing Statistics Kevin Roberts Rio de Janeiro,
08/08/2015 Statistics Canada Statistique Canada Paradata Collection Research for Social Surveys at Statistics Canada François Laflamme International Total.
United Nations Statistics Division Recoding the business register to ISIC Rev.4.
18/08/2015 Statistics Canada Statistique Canada Responsive Collection Design (RCD) for CATI Surveys and Total Survey Error (TSE) François Laflamme International.
United Nations Economic Commission for Europe Statistical Division Applying the GSBPM to Business Register Management Steven Vale UNECE
The implementation of tools to support the data quality of the survey frame Mario Ménard November 2008.
Data Sharing to Reduce Respondent Burden for the U.S. Census Bureau’s Business Register Presented to 12 th Meeting of the Group of Experts on Business.
Administrative Data at Statistics Canada – Current Uses and the Way Forward 27 th Voorburg Group Meeting Warsaw, Poland André Loranger October 4, 2012.
Electronic reporting in Poland 27th Voorburg Group Meeting Warsaw, Poland October 1st to October 5th, 2012 Central Statistical Office of Poland.
1 Business Register: Quality Practices Eddie Salyers
The Canadian Integrated Approach to Economic Surveys Marie Brodeur, Peter Koumanakos, Jean Leduc, Éric Rancourt, Karen Wilson Statistics Canada International.
The Statistical Business Register of Macao SAR Government of Macao SAR Statistics and Census Service.
Use of administrative data in short term economic indicators Statistics NZ Rochelle Barrow.
Improving the Design of UK Business Surveys Gareth James Methodology Directorate UK Office for National Statistics.
Use of Administrative Data in Statistics Canada’s Annual Survey of Manufactures Steve Matthews and Wesley Yung May 16, 2004 The United Nations Statistical.
Residential Survey. Survey Objectives Develop a more accurate algorithm to predict the presence and use of electric heat for residential customers. Algorithm.
The 2006 National Health Interview Survey (NHIS) Paradata File: Overview And Applications Beth L. Taylor 2008 NCHS Data User’s Conference August 13 th,
The Future of Administrative Data ICES III End Panel Discussion Don Royce Statistics Canada June 2007.
Evaluating a Research Report
Impact of using fiscal data on the imputation strategy of the Unified Enterprise Survey of Statistics Canada Ryan Chepita, Yi Li, Jean-Sébastien Provençal,
Collecting Electronic Data From the Carriers: the Key to Success in the Canadian Trucking Commodity Origin and Destination Survey François Gagnon and Krista.
May 2012 ESSnet DWH - Workshop III BUSINESS REGISTER IN STATISTICS LITHUANIA Jurga Rukšėnaitė Chief specialist.
Short-Term Economic Statistics Working PartyJune Short Term Economic Statistics Timeliness Framework Richard McKenzie OECD.
Georgia: business register data and gender-disaggregated indicators Tengiz Tsekvava Technical Meeting on Measuring Entrepreneurship from Gender Perspective.
A Strategy for Prioritising Non-response Follow-up to Reduce Costs Without Reducing Output Quality Gareth James Methodology Directorate UK Office for National.
Current and Future Applications of the Generic Statistical Business Process Model at Statistics Canada Laurie Reedman and Claude Julien May 5, 2010.
Developing Business Data Collection Nordic Statistical Meeting in Copenhagen August 2010 Theme 3. Statistics Production Johanna Leivo
Prioritizing Follow-up of Non- Respondents Using Scores for the Canadian Quarterly Survey of Financial Statistics for Enterprises Pierre Daoust Statistics.
Prioritizing Follow-up for the Canadian Quarterly Survey of Financial Statistics for Enterprises Pierre Daoust Statistics Canada ICES III, Montréal Statistique.
Use of Administrative Data Seminar on Developing a Programme on Integrated Statistics in support of the Implementation of the SNA for CARICOM countries.
Methodology of Allocating Generic Field to its Details Jessica Andrews Nathalie Hamel François Brisebois ICESIII - June 19, 2007.
Quality Assurance Programme of the Canadian Census of Population Expert Group Meeting on Population and Housing Censuses Geneva July 7-9, 2010.
Statistical Expertise for Sound Decision Making Quality Assurance for Census Data Processing Jean-Michel Durr 28/1/20111Fourth meeting of the TCG - Lubjana.
19 June 2007 Improving the quality of business registers UNECE/Eurostat/OECD 18 – 19 June 2007.
Improved Register Data Matching and its Impact on Survey Population Estimates Steve Vale Office for National Statistics, UK.
A Quality Driven Approach to Managing Collection and Analysis
1 QUALITY IMPROVEMENTS IN CROATIAN BUSINESS REGISTER AND IMPLICATIONS OF REVISION OF NACE Prepared by Zrinka Pavlović and Dubravka Celić Geneva,
Integrated Approach Processing Marie Brodeur Director General, Industry Statistics Branch, Statistics Canada St. Lucia February, 2014 SNA seminar in the.
Preparing for A Strategy for Change Based on Previous Experiences Steve Vale Office for National Statistics, UK.
MetaPlus Klas Blomqvist Statistics Sweden Research and Development – Central Methods
1 Statistical business registers as a prerequisite for integrated economic statistics. By Olav Ljones Deputy Director General Statistics Norway
RECENT DEVELOPMENT OF SORS METADATA REPOSITORIES FOR FASTER AND MORE TRANSPARENT PRODUCTION PROCESS Work Session on Statistical Metadata 9-11 February.
Short-Term Economic Statistics Working PartyJune Short Term Economic Statistics Timeliness Framework Richard McKenzie OECD.
Unified Enterprise Survey New Horizons International Conference on Establishment Surveys Daniela Ravindra and Marie Brodeur Montreal, June 2007 Statistics.
Processing Methodology of Tax Data at Statistics Canada Authors: François Brisebois, Richard Laroche and Rossana Manriquez (Statistics Canada) Presenter:
An Overview of Editing and Imputation Methods for the next Italian Censuses Gianpiero Bianchi, Antonia Manzari, Alessandra Reale UNECE-Eurostat Meeting.
Administrative Data at Statistics Canada – Current Uses and the Way Forward Wesley Yung and Peter Lys, Statistics Canada.
The Evolution of Administrative Data Use for the Canadian Business Register (BR) IAOS Conference Gaétan St-Louis October 2008.
Integration of the collection system and the Business Register system : Lessons learned, benefits achieved & opportunities created September 14, 2011 Session.
IMPACT EVALUATION PBAF 526 Class 5, October 31, 2011.
Redesigning French structural business statistics, using more administrative data ICESIII, Montréal, june 2007.
Implementation of a more efficient way of collecting data SBS: use of administrative data Statistics Belgium June 2009.
An Active Collection using Intermediate Estimates to Manage Follow-Up of Non-Response and Measurement Errors Jeannine Claveau, Serge Godbout and Claude.
A new fantastic source for updating the Statistical Business Register
26th Meeting of the Wiesbaden Group on Business Registers
Agenda Context of the BR Redesign Redesign Objectives Redesign changes
Étienne Saint-Pierre, Statistics Canada
Working towards a central Register : Simple, Complete and Widely Accessible September 29, 2010 Session no 5 - Register quality as a common task : Cooperation.
Presentation transcript:

The Many Ways of Improving the Industrial Coding for Statistics Canada’s Business Register Yanick Beaucage ICES III June 2007

Overview Background Automatic Coding Manual Coding Quality Evaluation of Classification Updates Quality Assurance Survey Conclusion

Background STC’s Business Register Redesign Improve administrative data link Improve treatment of births/deaths Reflect the businesses reality Give update privileges to a larger set of people Develop a quality assurance program Part of the quality assurance program is ensuring good industrial classification

Background Good industrial classification Leads to better population identification Leads to smaller sample size Leads to reduced collection cost Leads to better precision Prevents frustration from respondents (and interviewers)

Background Business Register Statistics Canada

Background Business Register Canada Revenue Agency Statistics Canada

Background Business Register Canada Revenue Agency Automatic Manual Statistics Canada

Background Business Register Updates Canada Revenue Agency Automatic Manual QE Statistics Canada

Background Business Register Updates Canada Revenue Agency Automatic Manual QE QAS Statistics Canada

Automatic Coding New businesses apply for a Business Number (BN) (done at Canada Revenue Agency - CRA) In person, over the phone, over the internet,... What is the description of the main Business activity? Decision tree tool used by CRA Prompts for details needed for coding Returns a robot-phrase to Statistics Canada

Automatic Coding Assign classification based on robot-phrase Improving decision tree tool and usage Re-developed on micro (originally mainframe) Expand use for Web BN application (currently used for phone or in person registration) Develop questions for all sectors Currently used for 75% of all industrial sectors Covers 90% of all descriptions to be coded

Automatic Coding Automated Character Text Recognition (ACTR) If description too general  Manual coding Used to assign classification based on descriptions Reference file (French and English) Parsing strategy Word weighting algorithm Score derived

Automatic Coding Improving use of ACTR Improve reference file Each year new phrases are added Currently phrases Study score needed for match Opening the weighting algorithm Improve parsing rules Revisit the rules Create an environment for testing purposes Evaluate impact of changing input/rules/score

Automatic Coding new businesses a month to code 45% are coded using robot-phrases 5% are coded using ACTR Leaves new businesses to code Need manual coding Done at Statistics Canada

Manual Coding Other units to code manually Survey feedback New operating entity found when profiling Tool Search engine for industrial coding Improve manual coding Add on-line ACTR or ACTR results Add decision tree tool

Manual Coding New businesses Goal: code all of them Reality: do as many as we can Result: backlog of businesses to code

Manual Coding New businesses Goal: code all of them Reality: do as many as we can Result: backlog of businesses to code Business Register Automatic Manual Automatic CRA May batch CRA June batch Backlog Manual

Manual Coding Which units should be coded first? First in, first out? Economic activity signal? Economic activity is determined by administrative data Both! Select a sample from backlog Take-all (large economic activity) Take-some 1 (economic activity / older units) Take-some 2 (economic activity / newer units) Take-none (no economic activity )

Manual Coding Prioritize units to code Can produce under-coverage estimates of the backlog by industrial sector Ultimate goal Improve automatic coding 80% - 90%? Code all remaining active units

Quality Evaluation of Classification Updates Update privileges will be expanded Subject-matter specialists Collection personnel Need to evaluate the quality of updates Prevent systematic errors Where to focus training

Quality Evaluation of Classification Updates Two processes Notification and sample selection 1- Notification Specialist determines set of enterprise to look at Every update to targeted enterprise is sent to specialist Agree/Disagree/Do nothing Make use of expertise of specialist Specialists keep up-to-date with their frame

Quality Evaluation of Classification Updates 2- Sample selection and evaluation Based on industry, source of industry, size and complexity of enterprise Re-code and compare Minimize respondent input when re-coding Using notification and sample Produce error rate for industrial coding Target specific problems

Quality Assurance Survey Goal: assess the quality of classification on the BR on an on-going basis Assess dead/alive status as well Point in time surveys done in the past 1993, 1995, 1997, 2002 Implement a continuous survey Produce overall results monthly Produce detailed results combining 12 months

Quality Assurance Survey Stratification Industrial sectors 2 or 3 size stratum Have higher sampling fraction for larger size Recently contacted Considered to have valid classification Sample allocation Target 3.5% standard error for annual industrial classification error rate 550 units a month

Quality Assurance Survey Currently doing a pilot test Monthly estimates produced Yearly estimates based on weighted average of 12 monthly measures Weighted average based on 1/12 Weighted average based on population ratio over the year (N m /(N N 12 ))

Quality Assurance Survey Survey will be used to Clean-up the register as an independent source Evaluate industrial in and out-of-scope rate Evaluate industrial error rate for non-surveyed portion of the register (e.g. small enterprises) Evaluate death rate in order to adjust sample sizes Potential use Evaluate frame quality for new surveys Clean-up part of the register

Conclusion Classification is essential to the BR Redesign provides an opportunity To improve coding To standardize tools used for coding To measure quality of coding adequately To set-up good practices/good reports Results Better quality of business survey frames More efficient surveys

For more Information please contact Pour plus d’information, veuillez contacter Visit our web site at Yanick Beaucage