Implementing Selective Editing and Its Reflection on the Data Quality (Business Survey 2012) Copyright © 2013 Statistics Centre - Abu Dhabi Authors : Azza Omer Mohammed Aleghefli Sara Al Dhaheri
Content 2 Introduction to Abu Dhabi & UAE SCAD Business Surveys AES Editing Process Re-designing the Editing Strategy Selective Editing – Definition Selective Editing used in AES 2012 Process of Selective Editing Edit Reports Findings
3 The Emirate of Abu Dhabi Almost 43 years since the formation of the UAE. UAE comprises Abu Dhabi plus six other Emirates. Abu Dhabi accounts for over 80 percent of UAE land mass. Abu Dhabi contains around one third of UAE population. Emirati citizens make up around 20 per cent of Abu Dhabi population. Abu Dhabi oil represents around 10 per cent of global reserves. Introduction
SCAD is the official source of statistical data for Abu Dhabi. Celebrated five years of operation in April Operates in accordance with international best practice to provide range of statistics. Our Mission: 1. Develop and organize a statistical system in the Emirate. 2. Provide relevant and reliable official statistics serving policy makers, the business community and the public. 4 Statistics Centre – Abu Dhabi Introduction
SCAD Business Surveys – known as Annual Economic Surveys (AES) key data source for the compilation of economic statistics. The survey results enable the construction of key economic indicators the GDP. The suites of Annual Economic Surveys have been conducted since AES 2012 sample size 2200 Establishments Collection period 5 months Paper questionnaire - commercial accounting 5 SCAD Business Surveys
6 AES Editing Process
Questions driving the re-design of the editing strategy Do we need to re-validate every edit failure? How to leverage the automated editing to improve data quality? 7 Re-designing the Editing Strategy
Procedure which targets only some of the micro data items or records for review - OECD Follow-up of validation failure for only those contributors where likely size of the correction is expected to make a material difference to the results – NSI 8 Selective Editing – Definition
First time used in SCAD Business Surveys Method adopted was thoroughly reviewing, validating and editing key variables Optimized the sources available for editing data 9 Selective Editing used in AES 2012
10 Process of Selective Editing
11 Obs SECTORRecords Count Count OF TOTAL Edit Failures Count of RELATED Edit failure Count of LOGICAL Edit Failure 1SERVICES TRADE TRANSPORTATION TELECOM REAL ESTATE INDUSTRY INSURANCE FINANCIAL SERVICES SME HOLDING11302 CONSTRUCTION BANKING Total Edit Report I:
Obs SECTORRecords Count Count OF TOTAL Edit Failures SUM OF RELATED FRQUENCY SUM OF LOGICAL FRQUENCY 1SERVICES TRADE TRANSPORTATION TELECOM REALESTATE INDUSTRY INSURANCE FINANCIAL SERVICES SME HOLDING CONSTRUCTION BANKING32000 Total Edit Report:
Editing done in a timely manner Significant decrease of key variables edit failure Focused automated editing on a predefined set of records improve the data quality Enhancing the method by implementing the scoring techniques 13 Findings
For more information please read the paper. Website: Authors: Azza Omer Mohamed Aleghefli: Sara Aldhaheri: 14 Contact
15