Transformation of UK Business Data Collection

Slides:



Advertisements
Similar presentations
Statistics NZs experience in using Administrative Data in an Integrated Programme of Economic Vince Galvin General Manager Strategy & Communications.
Advertisements

A Statistical Architecture for Economic Statistics Ron McKenzie ICES III.
Benefits of integrated economic statistics for central bank users Richard Walton European Central Bank Berne, 6-8 June 2007.
Eurostat Micro data linking project in European business statistics European Commission – Eurostat Directorate G: Global business statistics.
Business Register Outputs in Support of Regional Policy John Perry UK Office for National Statistics.
United Nations Workshop on Revision 3 of Principles and recommendations for Population and Housing Censuses and Census Evaluation Amman, Jordan, 19 – 23.
Quality assuring the UK business register Andrew Allen.
Trade and business statistics: use of administrative data Lunch Seminar Enrico Giovannini Italian National Statistical Institute (ISTAT) New York, February,
Regional GDP Workshop. Purpose of the Project October Regional GDP Workshop Regional GDP Scope Annual Current price (nominal) GDP By region.
Combining administrative and survey data: potential benefits and impact on editing and imputation for a structural business survey UNECE Work Session on.
SBR Netherlands1 Standard Business Reporting Programme A Netherlands government initiative Standard Business Reporting XBRL International Conference 24.
A Checklist for Business Profiling John Perry, UK Office for National Statistics.
The Adoption of METIS GSBPM in Statistics Denmark.
Use of Administrative Data Seminar on Developing a Programme on Integrated Statistics in support of the Implementation of the SNA for CARICOM countries.
>>. ESSnet Measuring Global Value Chains 1.Globalisation indicators 2.Methodological development and support for International Organisation and Sourcing.
New sources – administrative registers Genovefa RUŽIĆ.
Trade & Business Statistics Geert Bruinooge Statistics Netherlands.
UN ECE Seminar on New Frontiers for Statistical Data Collection 31 Oct – 2 Nov 2012 Beyond 2011 The future of population statistics Andy Teague, Office.
Department of Internal Affairs Disrupting Government Service Models Tim Occleshaw Government Chief Technology Officer Service and System Transformation.
Central Banks and Statistical Offices – Partnership in sharing data for good statistics: Implementing the G20 recommendations on sharing and accessibility.
Head of National Accounts Statistics Netherlands
Short Training Course on Agricultural Cost of Production Statistics
Investment Intentions Survey 2016
Project support meeting
Pali Lehohla Statistician-General.
MALDIVES Project Support meeting for the Regional Programme on Economic Statistics Bangkok, November 2016.
2006/07 Pali Lehohla 24 May 2006.
Reducing Survey Burden Through Third-Party Data Sources
FUTURE EVOLUTION OF SHORT-TERM ECONOMIC STATISTICS
Cost analysis of key statistical products
Office for National Statistics 2016/17 to 2019/20
Statistics for policy use
Webinar Optimize Your Business Applications Strategy
Investment Intentions Survey 2016
Rapid Appraisal of Labor Market Information in Laos
Kevin Moore Head of Platforms Development and Support Branch
ESSnet on Consistency Workshop
Oslo City Group Use of administrative data sources
Guidelines on Integrated Economic Statistics
Measuring the Impact of Business Profiling in the UK Wiesbaden Group on Business Registers Profiling (Costs and Benefits) Tallinn, Estonia, September.
LIVESTOCK PRODUCTION AND PRODUCTIVITY
2.1 Coverage and units Regional Course on
Quality Aspects and Approaches in Business Statistics
Profiling in Switzerland Costs and benefits
Developments in European Statistics
Institutional Framework, Resources and Management
Business Register Quality Improvement
1 What is EGR? ESTP course on EGR 6-7 September 2016.
Changed Data Collection Strategies
Scanning the environment: The global perspective on the integration of non-traditional data sources, administrative data and geospatial information Sub-regional.
Agenda item 5b Main challenges and priorities for future work Implementation of the 2008 SNA in the EECCA, SEE and Mongolia Presentation by UNECE Workshop.
Sub-regional workshop on integration of administrative data, big data
26th Meeting of the Wiesbaden Group on Business Registers
Guidelines on Integrated Economic Statistics
Director General of the National Accounts
Classification John Perry, UK ONS.
Statistics beyond the National Level –Regional Experiences
Presentation to the Committee for Establishment of a Business Register
CARICOM TRADE IN SERVICES STATISTICS (CTIS)PROJECT June-December 2016
Guidelines on Integrated Economic Statistics
Big Data ESSNet WP 1: Web scraping / Job Vacancies Pilot
IMPLEMENTATION PROGRAMME OF SNA 2008 (Dominica)
Session 7 – Eurostat 2017 SBR User Survey
3.4 Modernisation of Social Statistics
Global SNA Implementation Strategy
The Swedish survey on turnover in the service sector
Pete Benton , Beyond 2011 Programme Director
Meeting of the EHIS Technical Group Luxembourg January 2012
ESTP course on EuroGroups Register
Presentation transcript:

Transformation of UK Business Data Collection UNECE Workshop on Statistical Data Collection 10-12 October 2017 Debra Prestwood UK Office for National Statistics Divisional Director, Business Surveys Transformation V0.2

Outline Vision for data collection Enterprise Architecture Roadmap for business surveys data collection Focus on short term surveys/statistics Statistical Business Register Direct data feeds Progress Sharing experience

Target Operating Model (TOM) Vision Target Operating Model (TOM) Data integration, not simply data collection Link core sources (survey and non-survey) to a central statistical spine at a micro data level in order to: Maximise the utility of our data Work efficiently - link once, rather than multiple times in different locations for different purposes / outputs

Enterprise Architecture Enterprise Architecture Overview 4

Survey and non-survey integration On going survey redesign and rationalisation work is currently looking at how we can minimise the number of businesses we survey through the integration of various data sources. Survey Data Non-survey Data Currently collected through 80 business surveys ranging from monthly, quarterly and annual Use the new Digital Economy Act (data sharing legislation) which allows ONS to store and use admin data, e.g. PAYE, VAT etc., plus commercial data 5

Business Survey Redesign Conceptual Approach

Rationalise/Online modular design Statistical Business Register Vision Non-Survey Data are preferred source Business Surveys redesigned to fill gaps or for calibration Value Added Tax Harmonise PAYE RTI Rationalise/Online modular design Self Assessment… Sample redesign Statistical Business Register Provides statistical units and so spine to link all/most business data Provides sampling frame for business survey(s) to supplement non-survey data sources

revisit output requirements TRANSLATE output(s) ‘as is’ TRANSFORM revisit output requirements TRANSLATION RATIONALISATION INTEGRATION No output changes or sample redesign Questionnaire content and structure largely unchanged Improve questionnaire design by: Benefitting from features of online collection (routing, validations, usability) Meets accessibility needs Revisit output requirements Survey(s) redesigned and rationalised Harmonisation of outputs, concepts Improved data collection design (content and usability – online first) Amended processing systems and methods Revisit output requirements Register spine to integrate sources Draw first on non-survey sources to meet output requirements Surveys redesigned to fill gaps Online first data collection redesign Benefits / Value Reduced costs - GAE & staff Reduced burden - sample reduction, improved questions, usability Reputation – progressing to transformation vision, ‘digital by default’ Benefits / Value Reduced costs - replacing direct collection, GAE & staff Reduced burden - data re-use, sample and survey reduction, improved questions, usability Reputation – delivering transformation Promotes innovation, new outputs More responsive – flexibility to respond to new demands Benefits / Value Reduced costs - GAE Reduced burden (but limited to usability) Reputation – ‘digital by default’

Potential impact of new sources on existing ONS business statistical outputs Potential impact on ONS outputs VAT Redevelopment of smaller MBS Quality assurance of many business surveys VAT expenditure=intermediate consumption proxy HMRC Trade & VAT Improve samples for ABS, environmental accounts, prices, AllCOM Corporation Tax Redevelopment & quality assurance of ABS Self-Assessment Enriched Statistical Business Register Improved current measure of self-employment PAYE RTI Redevelopment of workforce jobs Redevelop MWSS Visa, other credit cards Add trade mode of supply Improve regional accounts Scanner data Redevelopment of RSI & business prices EFA Redevelop financial surveys 9

Emerging road map for transforming all business survey / data groups Potential timeline / road map Emerging road map for transforming all business survey / data groups

Why start with short-term stats? Statistical Business Register High cost surveys due to size, coverage, frequency Short frequency to reiterate and learn High potential to harmonise turnover (and emp) Relatively simple concepts and questions compared to structural surveys RSI, QBS, MWSS are already online , so functionality in place for ‘simple’ surveys All use same downstream legacy systems High potential for use of non-survey data (more so than structurals) We already have VAT data and are researching PAYE RTI potential VAT and PAYE RTI are the initial focus for non-survey data integration Makes use of investment in the ongoing VAT Minimum Viable Product Non-Survey Data are preferred source Business Surveys redesigned to fill gaps or for calibration VAT Harmonise PAYE RTI Online modular design Self Assessment… Sample redesign Statistical Business Register Provides statistical units and so spine to link all/most business data! Provides sampling frame for business survey(s) to supplement non-survey data sources! Turnover (VAT) and employment (PAYE) are core register (auxillary) variables! …so great for laying the foundations for transformation!

Rationalise/Online modular design Statistical Business Register Workstreams Output Specification Define & prioritise output user needs, to provide a reference for all other workstreams Non-Survey Data are preferred source Business Surveys redesigned to fill gaps or for calibration VAT Harmonise PAYE RTI Rationalise/Online modular design Self Assessment… Sample redesign Statistical Business Register Provides statistical units and so spine to link all/most business data Provides sampling frame for business survey(s) to supplement non-survey data sources

Workstreams vs. Output Specification For example… Define & prioritise output user needs, to provide a reference for all other workstreams For example… Who are our main users for short-term output (turnover) data? What conceptual basis should we be using to collect data and/or produce stats? Global National Accounts vs. BoE– Monetary Policy Committee Economic Ownership UN System of National Accounts Who owns the raw materials & finished goods? Where is the money going? What is the ‘real’ activity in the UK?

Use of ‘Simple v Complex’ Units Motivated by desire for admin (or other non-survey) data to be the preferred source [for any given output] Suitability depends on quality (inc. availability) of admin data for the statistical units Likely to want to partition business population into units for which: non-survey data will be used survey principles will be applied

Use of Simple v Complex Units defined by: employment, turnover, … Size of unit Big T.B.D. Survey defined primarily by: unit linkage (1-to-1, 1-to-many, etc.) Admin data T.B.D. Small Complexity Simple Complex

New Statistical Business Register Business Index (BI): Links legal units to VAT references and PAYE schemes Statistical Business Register (SBR): Frame function: Provide the sampling frame facilitating survey and non-survey sources. Enable more sophisticated and flexible sample designs and auxiliary variables for estimation Statistical spine : Create statistical units and so the foundations and building block on which to integrate data at microdata level and produce statistics Analytical function: Improve analysis of business population through holding more variables and most up to date data Expanded population : Include Self Assessment Tax ie very small sole traders and partnerships 16

‘Direct data feeds’ from businesses Research into: Compatability with company accounting/processing systems Accessibility Software barriers Flow alongside survey data into common platform(s) Other NSIs’ experience 17

Progress 12 surveys using new Secure File Transfer portal 5 business surveys ‘translated’ online 12 surveys using new Secure File Transfer portal Next stage is translation of rest Monthly Business Survey Short term statistics transformation in progress Equates to 68,000 eQuestionnaires to businesses Business Index in live beta trial phase SBR in design Alpha phase 18

We’d like to understand your experience in… Generic platform build across multiple statistical domains (Business, social, Census) Length of research time into use of admin data source to replace survey data Obtaining ‘direct data feeds’ from businesses Linking economic and social microdata through registers Maintaining security of data when linked at microdata level Capacity to manage transformational methods research – outsourcing to third parties used? Moratorium on change to existing systems and prcocesses whilst transforming data collection? Ensuring sound methods for integrating admin sources v transforming quickly Handling of resulting discontinuities in key economic time series 19

Thank you for listening! Contacts: debra.prestwood@ons.gov.uk nick.barford@ons.gov.uk 20