Software Systems for Survey and Census Yudi Agusta Statistics Indonesia (Chief of IT Division Regional Statistics Office of Bali Province) Joint Meeting.

Slides:

Advertisements

Similar presentations

The 2010 World Population and Housing Census Programme ( )

Advertisements

Slide 1Slide Slide 1 International Conference on Establishment Surveys III Montreal June 18-21, 2007 United States Department of Agriculture National Agricultural.

2010 Population Census (SP2010) and 2013 Agriculture Census (ST2013) Modern Data Processing Automation in BPS-Statistics Indonesia: an Innovations Dudy.

Making the Case for Metadata at SRS-NSF National Science Foundation Division of Science Resources Statistics Jeri Mulrow, Geetha Srinivasarao, and John.

COMMITMENTS FROM THE NSDS ON THE REGIONAL STRATEGY (INDONESIA CASE) BADAN PUSAT STATISTIK SURYAMIN Chief Statistician, BPS-Statistics Indonesia ASEAN Regional.

Metadata to Support the Survey Life Cycle Alice Born, Statistics Canada Joint UNECE/Eurostat/OECD Work Session on Statistical Metadata (METIS) Geneva,

TAJSTAT: Strengthening the National Statistical System Project Mustafa Dinc TLSS and MICS Conference Dushanbe, Tajikistan July 1, 2008.

Using SMS-Gateways for Monitoring Progress and Quality of Data Collection: Lessons Learned from the 2010 Population Census of Indonesia Thoman Pardosi.

1 Mobilizing Resources for Censuses: Strategies for Reducing Census Costs/ Perspectives of Donor Countries Based on Japanese Experience Takehiro Fukui.

COUNTRY PRESENTATION – SINGAPORE INTERNATIONAL WORKSHOP ON INDUSTRIAL STATISTICS BEIJING, CHINA 8-10 JULY 2013.

Business Case for Industriali- sation in Statistics Estonia: Small Example of a Large Trend MSIS 2013 Allan Randlepp Tuulikki Sillajõe.

Brief Overview of Data Processing of Afghanistan Household Listing, Pilot Census Results, Population and Housing Census and NRVA Survey Brief Overview.

Census Data Capture Challenge Intelligent Document Capture Solution UNSD Workshop - Minsk Dec 2008 Amir Angel Director of Government Projects.

United Nations CensusInfo User Application Training Workshop, Cairo, Egypt, October World Population and Housing Census Programme United.

NATIONAL STRATEGIC PLAN: SOME NOTES ON PRIORITISATION AND DRAFTING PROCESS STATISTICS INDONESIA Titi Kanti Lestari BPS-Statistics Indonesia High Level.

United Nations Economic Commission for Europe Statistical Division Applying the GSBPM to Business Register Management Steven Vale UNECE

Integration of Agricultural Statistics System in India A Presentation By Dhrijesh K Tiwari Fourth International Conference on Agriculture Statistics,

Copyright 2010, The World Bank Group. All Rights Reserved. PREPARING FOR THE NEXT CENSUS Part 1 Quality Assurance for Census.

Copyright 2010, The World Bank Group. All Rights Reserved. Integrating Agriculture into National Statistical Systems Section A 1.

Introduction e-Census system for 2005 Integrated e-Census system for 2010 Supplement.

Quality assurance activities at EUROSTAT CCSA Conference Helsinki, 6-7 May 2010 Martina Hahn, Eurostat.

Workshop on International Standards, Contemporary Technologies and Regional Cooperation, Noumea, New Caledonia, 04–08 February 2008 Results Generated from.

Recent Developments of the OECD Business Tendency and Consumer Opinion Surveys Portal coi/coordination

Development of metadata in the National Statistical Institute of Spain Work Session on Statistical Metadata Genève, 6-8 May-2013 Ana Isabel Sánchez-Luengo.

Population Census carried out in Armenia in 2011 as an example of the Generic Statistical Business Process Model Anahit Safyan Member of the State Council.

Census Mapping A Case of Zambia UN Workshop on Census Cartography and Management, Lusaka, 8-12 th October 2007.

Data Capture Overview United Nations Statistics Division

Current and Future Applications of the Generic Statistical Business Process Model at Statistics Canada Laurie Reedman and Claude Julien May 5, 2010.

Data Capture Technology Statistical Centre Of IRAN Presented by : MS. SOMAYE AHANGAR Vice – Presidency for Strategic Planning and Supervision Statistical.

Multi-modal of data collection for the 2010 Population and Housing Census National Statistical Office, Thailand (Daejeon, Republic of Korea, April.

The 2010 Population and Housing Census of Mongolia: Census PES 1 A.Amarbal Director of Population and Housing Census Bureau, National Statistical Office.

Revision Project of the Business Register (BR) and Business Statistics in September 2013 Tuula Viitaharju.

October 28-30, 2009 UNECE Geneva Quality Assessment of 2008 Integrated Census - Israel Pnina ZADKA Central Bureau of Statistics Israel.

United Nations Economic Commission for Europe Statistical Division Mapping Data Production Processes to the GSBPM Steven Vale UNECE

Use of Administrative Data Seminar on Developing a Programme on Integrated Statistics in support of the Implementation of the SNA for CARICOM countries.

Status of Data Capture Technology in Population and Housing Censuses in the ESCAP region Statistics Division ESCAP.

National Enterprise-Wide Statistical Systems (NEWSS) NURUL EFFA AHMAD DEPARTMENT OF STATISTICS MALAYSIA 26 April 2010 Meeting on the Management of Statistical.

Instituto Nacional de Estadística, Geografía e Informática (INEGI), Mexico National Economic Surveys (NES) Jun 2007.

Quality Assurance Programme of the Canadian Census of Population Expert Group Meeting on Population and Housing Censuses Geneva July 7-9, 2010.

Statistical Expertise for Sound Decision Making Quality Assurance for Census Data Processing Jean-Michel Durr 28/1/20111Fourth meeting of the TCG - Lubjana.

United Nations Statistics Division Work Programme on Economic Census Vladimir Markhonko, Chief Trade Statistics Branch, UNSD Youlia Antonova, Senior Statistician,

Copyright 2010, The World Bank Group. All Rights Reserved. Principles, criteria and methods Part 2 Quality management Produced in Collaboration between.

Implementation of the European Statistics Code of Practice Yalta September 2009 Pieter Everaers, Eurostat.

Pilot Census in Poland Some Quality Aspects Geneva, 7-9 July 2010 Janusz Dygaszewicz Central Statistical Office POLAND.

Developing and applying business process models in practice Statistics Norway Jenny Linnerud and Anne Gro Hustoft.

Regional Seminar on Promotion and Utilization of Census Results and on the Revision on the United Nations Principles and Recommendations for Population.

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation.

Sri Lanka. History  First Population & Housing Census : 1871  139 years ago  Last Population & Housing Census : 2001  After a lapse of 20 years 

United Nations Oslo City Group on Energy Statistics OG7, Helsinki, Finland October 2012 ESCM Chapter 8: Data Quality and Meta Data 1.

Copyright 2010, The World Bank Group. All Rights Reserved. Managing processes Core business of the NSO Part 1 Strengthening Statistics Produced in Collaboration.

RECENT DEVELOPMENT OF SORS METADATA REPOSITORIES FOR FASTER AND MORE TRANSPARENT PRODUCTION PROCESS Work Session on Statistical Metadata 9-11 February.

Unified Enterprise Survey New Horizons International Conference on Establishment Surveys Daniela Ravindra and Marie Brodeur Montreal, June 2007 Statistics.

Census quality evaluation: Considerations from an international perspective Bernard Baffour and Paolo Valente UNECE Statistical Division Joint UNECE/Eurostat.

5.8 Finalise data files 5.6 Calculate weights Price index for legal services Quality Management / Metadata Management Specify Needs Design Build CollectProcessAnalyse.

Census Office Fernando Casimiro Geneva, July 2010 Portugal – Census results tailored to user needs «

Public Libraries Survey Data File Overview. What We’ll Talk About PLS: Public Libraries Survey State level data Public library data (Administrative Entities)

Public Libraries Survey Data File Overview. 2 What We’ll Talk About PLS: Public Library Survey State level data Public library data (Administrative Entities)

The business process models and quality issues at the Hungarian Central Statistical Office (HCSO) Mr. Csaba Ábry, HCSO, Methodological Department Geneva,

First meeting of the Technical Cooperation Group for the Population and Housing Censuses in South East Europe Vienna, March 2010 POST-ENUMERATION.

A Training Course for the Analysis and Reporting of Data from Education Management Information Systems (EMIS)

4–6 September 2013, Vilnius, Lithuania High-Level Seminar for Eastern Europe, Caucasus and Central Asia Countries QUALITY FRAMEWORK AT.

Introduction to Statistics Estonia Study visit of the State Statistical Service of Ukraine on Dissemination of Statistical Information and related themes.

Census Planning and Management

Implementation of Quality indicators for administrative data

Generic Statistical Business Process Model (GSBPM)

Software Systems for Survey and Census

Albania 2021 Population and Housing Census - Plans

Mapping Data Production Processes to the GSBPM

The role of metadata in census data dissemination

Presentation transcript:

Software Systems for Survey and Census Yudi Agusta Statistics Indonesia (Chief of IT Division Regional Statistics Office of Bali Province) Joint Meeting on Management of Statistical Information Systems (MSIS) – Daejeon, April 2010 Statistics Indonesia

Outline BPS – Statistics Indonesia The Needed Software Systems The Case of The 2010 Indonesian Population Census (Sensus Penduduk 2010 – SP2010)  Problem Background and Analysis  Available and Applicable Technologies  Expected Implementation  Design of Software Systems Some Hurdles Further Advancement

BPS – Statistics Indonesia Vision: BPS is the Agent of Trustworthy Statistical Data for All Mission:  To strengthen the constitutional and operational base of the institution for carrying out effective and efficient statistical activities.  To deliver competent and professional statistic human resources, supported by the use of cutting edge information technology for the improvement of Indonesian statistics.  To improve the implementation of the universal standard for classification, concept and definition, estimation, and statistics ethical code in every statistical activity.  To improve the quality of statistical information services for all parties.  To improve coordination, integration, and synchronization of statistical activities conducted by government and private sectors, within the frame of effective and efficient National Statistics Systems. Economic Growth Inflation Employment Poverty Farmer’s Terms of Trade Rice & Crops Production Export and Import Setup of Census/Survey Methodology  The Setup of Census Block, Sampling, Questionnaire Design, and Variable Definition Data Collection  Census, Survey, Compilation of Administrative Records, Special Studies Data Processing Data Dissemination and Analysis Main ActivitiesOutput

The Needed Software Systems Master File & Map Update & Browsing Systems Classification Standard Browsing Systems E-Survey Systems Concept and Definition Update and Browsing Systems CAPI Systems CATI Systems Data Entry Systems Reporting Systems Documents Handling Systems OCR/OMR Data Capturing Systems Data Validation Systems Data Imputation Systems Automatic Editing Systems Managerial Scheduling Systems Admin Communica tion Systems Admin Communica tion Systems Data Exploring Systems Data Warehouse Systems Metadata Update and Browsing Systems Data Mapping Systems Data Center Systems Digital Map Update Systems Data Dissemina tion Systems Data Dissemina tion Systems Sampling, Weighting & Estimation Systems

The Needed Software Systems Master File & Map Update & Browsing Systems Classification Standard Browsing Systems E-Survey Systems Concept and Definition Update and Browsing Systems CAPI Systems CATI Systems Data Entry Systems Reporting Systems Documents Handling Systems OCR/OMR Data Capturing Systems Data Validation Systems Data Imputation Systems Automatic Editing Systems Managerial Scheduling Systems Admin Communica tion Systems Admin Communica tion Systems Data Exploring Systems Data Warehouse Systems Metadata Update and Browsing Systems Data Mapping Systems Data Center Systems Digital Map Update Systems Data Dissemina tion Systems Data Dissemina tion Systems Sampling, Weighting & Estimation Systems

The Needed Software Systems Master File & Map Update & Browsing Systems Classification Standard Browsing Systems E-Survey Systems Concept and Definition Update and Browsing Systems CAPI Systems CATI Systems Data Entry Systems Reporting Systems Documents Handling Systems OCR/OMR Data Capturing Systems Data Validation Systems Data Imputation Systems Automatic Editing Systems Managerial Scheduling Systems Admin Communica tion Systems Admin Communica tion Systems Data Exploring Systems Data Warehouse Systems Metadata Update and Browsing Systems Data Mapping Systems Data Center Systems Digital Map Update Systems Data Dissemina tion Systems Data Dissemina tion Systems Sampling, Weighting & Estimation Systems

The Case of The 2010 Indonesian Population Census (Sensus Penduduk 2010 – SP2010)

Problem Background Communication Lag  Question and Answer  Suggestion and Confirmation  Updated News & Files, Reporting Miscommunication  Unclear Information  Misinterpretation  False in Filing Clarity of Process & Instruction Systems  No Clear Procedures  No Documentations Document Handling Problem  Bad Documentation Lack of Accuracy  Imprecise Implementation of Validation Rules  Lack of Post Processing Analysis Uses of Census Data  Lack of Preparation in Utilizing Census Data  Lack of Automated Tools in Exploring Census Data Extensive Changes/Consolidation In Terms of Concept and Definition, Scope, and Uses of Variables During The Conduct of Population Census Occurring Errors in Data Collection - the Enumerators and Respondents Point of Views Very Large Scope of Processes Needed to be Supervised The Need of Faster, Accurate, and Reliable Data Dissemination Process Problem Analysis – In Relation To The Possible Support of IT

Available & Applicable Technologies Extraction Transformation Loading Online Analytical Processing Implementation of Online Interaction System With Various Functions  Online Enumeration Q&A  Online Data Processing Q&A  Online Validation Rule Suggestion and Confirmation/Approval  Online Reporting System Implementation of Document Handling System  Record Keeping of Census/Survey Documents Implementation of Post Processing Utility System  Important Variables Analysis  Double Counting Analysis  Record Outlier Analysis Implementation of Data Exploring System  Comparison with Previous Data  Comparison Between Area  Online Analytical Processing (OLAP) Information Systems Expected Implementation Intelligent Systems Data MiningRule Base System Optical Mark Recognition Optical Character Recognition Web-Based Online System

Design of Software Systems Online Enumeration Q&A Online Data Processing Q&A Online Validation Rule Suggestion and Confirmation/Approval Online Enumeration Reporting System Online Data Processing Reporting System Online Patch and Other Supporting Files Upload and Download Online Interaction System

Design of Software Systems Record Keeping of Documents in Each Process (Receiving Batching, Editing, Cutting, Scanning, Correction, Completion, Validation, and Releasing) Documents Handling System

Design of Software Systems: SP2010 Scanning System Recognition System Correction & Completion System Releasing System Validation System System Update Validation Rules Update Data Processing System Scanning & Recognition Admin Correction & Completion Admin Correction and Completion Staffs Releasing & Validation Admin Validation Staffs & System Admin Users Involved

Design of Software Systems: SP2010 Double Counting Analysis Record Outliers Analysis Name and Address Analysis Age Analysis Name and Sex Analysis Post Processing Utility System

Design of Software Systems Area Analysis Time Series Analysis Online Analytical Processing (OLAP) Data Exploring System

Some Hurdles Information Technology Blue Print  There is still no general information technology blue print within the organisation  Expected by the year of 2012, there will be one In-House or Outsourcing  Common practice: in-house development Lack of standard, consistency, experience, and effectiveness  Outsourcing? Lack of Funding

Further Advancement Managerial Support Systems  Managerial Scheduling Systems Data Dissemination Supporting Systems  Data Center Systems  Data Warehouse Systems  Metadata Systems A More General Systems for Handling Different Types of Surveys and Censuses  General Design  Universal Development Engine

Thank You Joint Meeting on Management of Statistical Information Systems (MSIS) – Daejeon, April 2010 Statistics Indonesia