Short-Term Economic Statistics Working PartyJune Short Term Economic Statistics Timeliness Framework Richard McKenzie OECD

Short-Term Economic Statistics Working PartyJune The STES Timeliness Framework Review of the framework, its original development, usage and promotion Recent statistics on usage Plans for 2006 update – and comparison with 2005 update Discussion by STESWP on the need for future updates to the framework

Short-Term Economic Statistics Working PartyJune STES Timeliness Framework - Background Developed by the STESEG taskforce on timeliness and benchmarking Aims to assist countries to improve the timeliness of the STES they produce (reduce costs & improve accuracy as well) A collection of good practices which cover all aspects of the statistical production process First version went live on the OECD website in September 2004, first update in September 2005 STESWP has the role to improve, maintain, use and promote the framework

Short-Term Economic Statistics Working PartyJune Development of the STES Timeliness Framework Timeliness is a function of the statistical production process However best practice in one country may not be applicable to another –e.g. different user requirements, legislation, economic structures, institutional structures etc. Desire to develop a framework which presents a range of good practices for improving timeliness across different aspects of the statistical production process

Short-Term Economic Statistics Working PartyJune Developing the STES Timeliness Framework Multi-dimensional web based product Each dimension providing more detail on specific methods to improve timeliness Emphasis on how processes link together, for developing overall strategies Only references methods with proven operational success Contains a breath of material sourced from many countries to ensure wide applicability

Short-Term Economic Statistics Working PartyJune Developing the STES Timeliness Framework Taskforce assessed documentation collected from national statistics offices and by reviewing relevant statistical conference proceedings: –Over 1200 papers from 9 journals and 22 statistical conferences were reviewed: 50 of these papers were included in the framework –162 papers were submitted from 23 NSOs of which 59 were included in the framework Current framework includes documents from 22 statistics organisations (national & international)

Short-Term Economic Statistics Working PartyJune Broad statistical functionStatistical functions most relevant to timeliness 1 Frame selection and administrative data use 1.1 Direct use of administrative data for STES 1.2 Maintaining Survey Frames from Admin source 2 Questionnaire design2.1 Flexible Questionnaire and Form Design 2.2 Minimising Data Items Collected 3 Sample design and selection 3.1 Efficient Sample Designs 3.2 Sample Designs for Sub Samples 3.3 Effective business selection methods 4 Reference period & due dates 4.1 Choice of Reference Periods 4.2 Due Date for Businesses Providing Data 5 Data collection and validation 5.1 Efficient Collection Methods Using Technology 5.2 Follow Up of Non Respondents 5.3 Automated Data Validation (Editing) Methods 5.4 Selective (or Significance) Editing Structure of the STES Timeliness Framework

Short-Term Economic Statistics Working PartyJune Broad statistical functionStatistical functions most relevant to timeliness 5 Data collection and validation 5.5 Effectively Combining Technology and Staff 5.6 Relationships With Respondents 6 Estimation6.1 Data imputation methods 6.2 Preliminary Estimates from Sub Samples 6.3 Estimation Based on Lower Response Rates 6.4 Preliminary Estimates Based on Statistical Model 7 Evaluation and dissemination 7.1 Assessment of User Requirements 7.2 Analysis of Revisions 7.3 Quality Assessment of Timeliness Improvements 7.4 Use of Benchmarking Techniques 7.5 Efficient Dissemination Processes Structure of the STES Timeliness Framework

Short-Term Economic Statistics Working PartyJune The web-based version

Short-Term Economic Statistics Working PartyJune Promoting the STES Timeliness Framework Maximise visibility on the OECD website STESEG members promotion in their own organisations Distribution by other international organisations to their relevant working groups Articles in OECD and UNSD Statistics Newsletters OECD Statistics Working paper & keynote address at the April 2006 Quality in Official Statistics Conference in Cardiff

Short-Term Economic Statistics Working PartyJune Use of the STES Timeliness Framework Visits to the STES Timeliness Framework homepage MonthRankViewsAve time Sep :19 Oct :29 Nov :58 Dec :03 Jan - Mar :31 Apr - Jun :37 Jul - Dec :35

Short-Term Economic Statistics Working PartyJune update of the framework Request sent to most NSOs that participated in 2005 STESEG to provide any new documentation –8 NSOs responded, with 4 providing a total of 20 new papers for assessment (of which 12 come from the BLS) –In 2005, 20 NSOs responded, with 11 providing a total of 33 new papers for assessment Need to identify relevant conferences from the past year to review proceedings –Q2006 is the only one thought of so far –For the 2005 update, 6 conferences were reviewed of which papers from 5 of these were taken

Short-Term Economic Statistics Working PartyJune Future updates of the framework / discussion points Does the lower response from NSOs suggest less work is being done to improve timeliness of STES? Relevant conference proceedings to review for the 2006 update – suggestions please! Framework structure and content continues to be relevant and OECD will continue to promote it –Especially for developing countries which are most of the subscribers –Also very useful as a statistical training tool –However does apparent diminishing usage justify spending STESWP resources on future updates?