OBDELAVA (PROCESIRANJE PODATKOV)

Slides:

Advertisements

Similar presentations

EU KLEMS project on Productivity in the European Union Summary presentation This project is funded by the European Commission, Research Directorate General.

Advertisements

Data Imputation United Nations Statistics Division (UNSD) 16 March 2011 Santiago, Chile.

Unido.org/statistics International workshop on industrial statistics 8 – 10 July, Beijing Non response in industrial surveys Shyam Upadhyaya.

Module B-4: Processing ICT survey data TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Module B-4 Processing ICT Survey data.

Harvard Center for Population and Development Studies1 Census Editing and the Art of Motorcycle Maintenance Michael J. Levin Center for Population and.

Exploring Administrative Records Use for Race and Hispanic Origin Item Non-Response Sonya Rastogi, Leticia Fernandez, James Noon, Ellen Zapata and Renuka.

SLICE 1.5: A software framework for automatic edit and imputation Ton de Waal Statistics Netherlands UN/ECE Work Session on Statistical Data Editing,

T T Population Sampling Distribution Purpose Allows the analyst to determine the mean and standard deviation of a sampling distribution.

T T07-01 Sample Size Effect – Normal Distribution Purpose Allows the analyst to analyze the effect that sample size has on a sampling distribution.

Brief Overview of Data Processing of Afghanistan Household Listing, Pilot Census Results, Population and Housing Census and NRVA Survey Brief Overview.

Edit and Imputation of the 2011 Abu Dhabi Census Glenn Hui and Hanan AlDarmaki Statistics Centre - Abu Dhabi UNECE CES Work Session on Statistical Data.

Eurostat Statistical Data Editing and Imputation.

Chapter 7. Balancing supply and use Comments and suggestions. By Liv Hobbelstad Simpson. 1. Why SNA 1993 and not 2008 SNA The Global Office has decided.

WS Population Census 2004 UNECE Statistical Division Technologies used by ECE countries in their 2000 round of censuses Social and Demographic Statistics.

New and Emerging Methods Maria Garcia and Ton de Waal UN/ECE Work Session on Statistical Data Editing, May 2005, Ottawa.

Topic (ii): New and Emerging Methods Maria Garcia (USA) Jeroen Pannekoek (Netherlands) UNECE Work Session on Statistical Data Editing Paris, France,

Topic (vi): New and Emerging Methods Topic organizer: Maria Garcia (USA) UNECE Work Session on Statistical Data Editing Oslo, Norway, September 2012.

for statistics based on multiple sources

Statistical Expertise for Sound Decision Making Quality Assurance for Census Data Processing Jean-Michel Durr 28/1/20111Fourth meeting of the TCG - Lubjana.

Paolo Valente - UNECE Statistical Division Slide 1 Technology for census data coding, editing and imputation Paolo Valente (UNECE) UNECE Workshop on Census.

T T Population Sample Size Calculations Purpose Allows the analyst to analyze the sample size necessary to conduct "statistically significant"

1 Statistical business registers as a prerequisite for integrated economic statistics. By Olav Ljones Deputy Director General Statistics Norway

New and Emerging Methods UN/ECE Work Session on Statistical Data Editing Vienna April 21-23, 2008.

Generic Statistical Data Editing Models (GSDEMs) Workshop on the Modernisation of Official Statistics The Hague, 24 November 2015.

An Overview of Editing and Imputation Methods for the next Italian Censuses Gianpiero Bianchi, Antonia Manzari, Alessandra Reale UNECE-Eurostat Meeting.

Overview of Programme of the Working Group on Flash Estimates of GDP Roberto Barcellan European Commission - Eurostat.

1 Handbook on Population and Housing Census Editing Department of Economic and Social Development United Nations Statistics Division Studies in Methods,

Theme (iv): Standards and international collaboration

Theme (v): Managing change

Generic Statistical Data Editing Models (GSDEMs)

Theme (i): New and emerging methods

The treatment of uncertainty in the results

GDP growth estimates for Europe at 30 days – is that feasible?

Modeling approaches for the allocation of costs

UNITED NATIONS ECONOMIC COMMISSION FOR EUROPE CONFERENCE OF EUROPEAN STATISTICIANS Work Session on Statistical Data Editing April 2017 The Hague,

Session D12: Multisource statistics New sources: new modelling approaches Author: Gras Fabrice, Eurostat, unit B1, Methodology and corporate architecture.

SPACE OF OPPORTUNITIES

Editing and Imputing Income Data in the 2008 Integrated Census prepared by Yael Klejman Israel Central Bureau of Statistics UNITED NATIONS ECONOMIC.

Modernisation of European social statistics

Informacijski model objekta BIM Building Information Modelling

ZBIRANJE IN VIRI STATISTIČNIH PODATKOV

Utišajmo mobilne telefone !

Enterprise Europe Network

The Household Budget Surveys in the Candidate Countries

Survey phases, survey errors and quality control system

Inferences and Conclusions from Data

Šalej Mirko Iskraemeco, d.d. Kranj

The European Statistical Training Programme

Google docs Jake R2b Predmet: Uiktp.

Binarna logistična regresija

UML – je standardno pogoj za univerzalno ?

Ela Reven, Katarina urbančič

Survey phases, survey errors and quality control system

GDP growth estimates for Europe at 30 days – is that feasible?

mag. Sebastjan Repnik, višji predavatelj

Tomaž Špeh, Rudi Seljak Statistical Office of the Republic of Slovenia

Working Group on Statistical Confidentiality, October 2009

Software Systems for Survey and Census

Beyond silos Social policy, official statistics and social science

Working Group European Statistical System – Learning and Development Framework (ess-ldf) & Human Resources Management (hrm) ESTP III ( ) Item.

Beyond silos Social policy, official statistics and social science

Albania 2021 Population and Housing Census - Plans

Overview of Approaches to Register-Based Populating Censuses

UNECE/Task Force on EIP

House Price Indices Laurs Nørlund Director – National Accounts, Prices and Key Indicators Eurostat - European Commission.

Task force on Crime Statistics Community Statistical Programme

Treatment of Missing Data Pres. 8

Automatic Editing with Soft Edits

Kees Zeelenberg, Winfried Ypma, Peter Struijs; Statistics Netherlands

Jeroen Pannekoek, Mark van der Loo and Bart van den Broek

Presentation transcript:

OBDELAVA (PROCESIRANJE PODATKOV) Pojem in vloga editiranja v obdelavi podatkov Osnovni pristopi in tehnike Avtomatsko editiranje Selektivno editiranje Makro editiranje Raziskovalni projekti Literatura

OBDELAVA (PROCESIRANJE PODATKOV) Vnos podatkov Editiranje Imputiranje Ocenjevanje, agregiranje Integriranje Analiza (časovne serije in sezonske prilagoditve, izračun indikatorjev, indeksov)

KAJ JE EDITIRANJE (UREJANJE) PODATKOV Editing procedure… process of detecting and handling errors in data. Glossary of Terms on Statistical Editing, UN, 2000 Editing is the examination of data for the purpose of error detection. (ABS; 1993)

KAJ PRINAŠA EDITIRANJE Informacije o kvaliteti podatkov Odpravo napak Izhodišča za izboljšanje raziskovanj v prihodnosti Nevarnost pre-editiranja

VIDIKI EDITIRANJA Kontrola polnoštevilnosti (kompletnosti) Rutinska kontrola Kontrola (veljavnosti) validnosti podatkov Relacijska kontrola Aritmetična kontrola Stohastične in deterministične kontrole

IZVEDBA EDITIRANJA Papir in svinčnik Iterativni postopek vnosa podatkov in odprave napak Računalniško podprt vnos in editiranje (head-up) Avtomatsko editiranje Selektivno editiranje

AVTOMATSKO EDITIRANJE Fellegi in Holt (1976) - identifikacija ‘okuženih’ področij; Uporaba v praksi (Kanada, Italija, Španija) Koraki pri avtomatskem editiranju: Identifikacija napak in nekonsistentnosti Nekonsistentnost: opredelitev področja z napako Popravki in imputiranje Primer Pogoji uporabe Fellegi - Holt metodologije

AVTOMATSKO EDITIRANJE Hot- deck pristop: kontinuirano korigiranje podatkov s pomočjo ažurirane tekoče baze Cold- deck pristop: korigiranje podatkov s pomočjo dane (fiksne) baze

SELEKTIVNO EDITIRANJE Odkrivanje individualnih napak- osamelcev (outlier) po vnaprej znanih kriterijih ; Hidiroglou in Berthelot (1986) – ‘Score Function’- indikator proritet za mikro editiranje Van de Pol and Molenaar (1996) - indeks rizičnosti, ki primerja velikost napake in pomen enote

MAKRO EDITIRANJE (OUTPUT KONTROLA) (Granquist, 1990; Granquist in Kovar , 1997) Agregatna metoda (primerjava agregatnih vrednosti različnih obdobij) Metoda porazdelitve (primerjava individualnih vrednosti glede na porazdelitev) Uporabnost pri ekonomskih spremenljivkah, tako kot pri mikroeditiranju težave pri sistematičnih napakah

RAZISKOVALNI PROJEKTI AUTIMP (Automatic Imputation software for business surves and population censuses) v okviru DOSIS EUREDIT (Development and Evaluation of New Methods for Editing and Imputation) v okviru EPROS CHINTEX The Change from Input Harmonisation to Ex-post Harmonisation in National Samples of the European Community Household Panel – DACSEIS Data Quality of Complex Surveys within the New Euroepan Information Society

Literatura Willeboordse Ad (ed.): Handbook on the Design and Implementation of Business Surveys, Eurostat, 7/C, 1998 UN Statistical Commission and Economic Commision for Europe: Statistical data Editing . Methods and Techniques. Volume 1. Statistical Standards and Studies. No.44, 1994, str.239. Statistical data Editing . Methods and Techniques. Volume 2. Statistical Standards and Studies. No.48, 1997, str.239.

LITERATURA UN Statistical Commission and Economic Commision for Europe: Glossary of terms on statistical data editing Evaluating efficiency of statistical data editing: general framework Work session on statistical data editing