Prime Esperienze di Utilizzo di R all’Interno dell’Istat The Web-Based Information System of Italian Population Census Maura Giacummo Leonardo Tininini.

Slides:



Advertisements
Similar presentations
National Statistics Office Republic of the Philippines.
Advertisements

Audit Partner is an information management system that assists in retrieving and reviewing of field audits electronically. Partner may be used by audit-processing.
1 Survey Technology. Data Collection Tools Available in the Market 1. Paper Survey 2. Smart Paper 3. Cell Phones 4. Personal Digital Assistants - PDAs.
The 4 th International Workshop on Internet Survey Methods Statistical Center in Deajeon, Korea, September 2012 Ken Hoshino Statistics Bureau, Ministry.
Copyright Hub Software Engineering Ltd 2010All rights reserved Hub Document Manager Product Overview.
We make it easier for businesses of all sizes to safely accept checks transmodus offers clients automation utilizing our online processing platform for.
Web Caching Schemes1 A Survey of Web Caching Schemes for the Internet Jia Wang.
Statistical Metadata Strategy Elham M. Saleh - Acting Director of Economic Statistics - Director of Technical Resources Central Informatics Organisation.
Supplement 02CASE Tools1 Supplement 02 - Case Tools And Franchise Colleges By MANSHA NAWAZ.
Brief Overview of Data Processing of Afghanistan Household Listing, Pilot Census Results, Population and Housing Census and NRVA Survey Brief Overview.
Chapter 5 Application Software.
1 TOKYO STOCK EXCHANGE’s XBRL project AOSEF Market Data & Technology Collaboration Workshop 2007 Nov. Ver.1.0.
1 Introduction to Web Development. Web Basics The Web consists of computers on the Internet connected to each other in a specific way Used in all levels.
Database Systems: Design, Implementation, and Management Ninth Edition
High-Speed, High Volume Document Storage, Retrieval, and Manipulation with Documentum and Snowbound March 8, 2007.
AGENDA Welcome and introductions Brief introduction to PSI Mobile Technical Overview Demonstration Q and A Next Actions.
Mantova 18/10/2002 "A Roadmap to New Product Development" Supporting Innovation Through The NPD Process and the Creation of Spin-off Companies.
Evinco Solutions Limited Page 1. Evinco Solutions Limited Page 2 What is RoboSales? Integrated e-commerce solution for corporate and SME users Innovative.
Electronic reporting in Poland 27th Voorburg Group Meeting Warsaw, Poland October 1st to October 5th, 2012 Central Statistical Office of Poland.
Innovations in Bangladesh December 18, 2008 Shyam Lama & Sylvia Ness.
Geneva, 30 October 2009 Giuseppe Sindoni, Istat, Italy An online system for multi-channel, register-based census data collection.
5 Marzo 2007 EMERGING METHODOLOGIES OF CONTINUOUS USE OF REGISTERS AND GEOCODED DATABASES IN THE ITALIAN POPULATION AND HOUSING CENSUS Fabio Crescenzi,
1 Chapter 11 Implementation. 2 System implementation issues Acquisition techniques Site implementation tools Content management and updating System changeover.
The Web-based Data Collection in the Italian Population and Housing Census Leonardo Tininini and Antonino Virgillito ISTAT Meeting on the Management of.
Meeting on the Management of Statistical Information Systems (MSIS 2012) Washington, DC, May 2012 Development of Inter-Ministry Information System.
Introduction e-Census system for 2005 Integrated e-Census system for 2010 Supplement.
Census 2011 in Portugal: Development of e-Census system Statistics Portugal - Census Unit and IT Department Geneva, October 2009.
I.Information Building & Retrieval Learning Objectives: the process of Information building the responsibilities and interaction of each data managing.
2020 Recommendation Janusz Dygaszewicz Central Statistical Office of Poland.
Computer Emergency Notification System (CENS)
RefWorks Your Personal Online Database And Bibliography Creator.
Middleware for FIs Apeego House 4B, Tardeo Rd. Mumbai Tel: Fax:
- Ahmad Al-Ghoul Data design. 2 learning Objectives Explain data design concepts and data structures Explain data design concepts and data structures.
Electronic data collection system eSTAT in Statistics Estonia: functionality, authentication and further developments issues 4th June 2007 Maia Ennok,
 2001 Prentice Hall Business Publishing, Accounting Information Systems, 8/E, Bodnar/Hopwood Chapter 10 Electronic Data Processing Systems.
© Paradigm Publishing Inc. 5-1 Chapter 5 Application Software.
Monitoring the acquisition process by web widgets Leonardo Tininini and Antonino Virgillito ISTAT Meeting on the Management of Statistical Information.
Luxembourg, 13 October 2008 ITDG Giuseppe Sindoni, Istat, Italy 2011 Census innovations, the 2009 pilot Census and some technological implications.
Electronic data collection System in CSB of Latvia By Karlis Zeila, Vice President, CSB of Latvia IT DG meeting, October , Eurostat.
Database Management Systems (DBMS)
Enterprise Solutions Chapter 10 – Enterprise Content Management.
Clusterpoint Margarita Sudņika ms RDBMS & NoSQL Databases & tables → Document stores Columns, rows → Schemaless documents Scales UP → Scales UP.
Feb 24-27, 2004ICDL 2004, New Dehli Improving Federated Service for Non-cooperating Digital Libraries R. Shi, K. Maly, M. Zubair Department of Computer.
Text TCS INTERNAL Oracle PL/SQL – Introduction. TCS INTERNAL PL SQL Introduction PLSQL means Procedural Language extension of SQL. PLSQL is a database.
An Overview of Editing and Imputation Methods for the next Italian Censuses Gianpiero Bianchi, Antonia Manzari, Alessandra Reale UNECE-Eurostat Meeting.
Database Systems: Design, Implementation, and Management Eighth Edition Chapter 1 Database Systems.
SQL Server 2012 Session: 1 Session: 4 SQL Azure Data Management Using Microsoft SQL Server.
1 Copyright © 2005, Oracle. All rights reserved. Oracle Database Administration: Overview.
Database Principles: Fundamentals of Design, Implementation, and Management Chapter 1 The Database Approach.
Jordan Population and Housing Census 2015
ZAMBIA CENSUS MAPPING PRESETATION
Accounting Information Systems: A Business Process Approach
Modern Systems Analysis and Design Third Edition
Case Management System
Modern Systems Analysis and Design Third Edition
The Improvement of PaaS Platform ZENG Shu-Qing, Xu Jie-Bin 2010 First International Conference on Networking and Distributed Computing SQUARE.
28 November - 1 December 2016, Amman, Jordan
28 November - 1 December 2016, Amman, Jordan
Database Systems Chapter 1
Modern Systems Analysis and Design Third Edition
Sacramento Forms User Group
Use of handheld electronic devices for data collection in GeoStat
Modern Systems Analysis and Design Third Edition
The Computer-Assisted Personal
The ultimate in data organization
Census innovations in Italy and their technological implications
SOFTWARE DEVELOPMENT LIFE CYCLE
Latest developments of the data collection system for the next Italian census pilot Giuseppe Sindoni, Istat, Italy.
Modern Systems Analysis and Design Third Edition
Technical Coordination Group, Zagreb, Croatia, 26 January 2018
Presentation transcript:

Prime Esperienze di Utilizzo di R all’Interno dell’Istat The Web-Based Information System of Italian Population Census Maura Giacummo Leonardo Tininini Marina Venturi Antonino Virgillito

Antonino Virgillito, May 25th Introduction The 15 th Italian Population Census –24,700,000 households with 60,000,000 individuals –100,000 operators Several important innovations were introduced Supported by a web-based information system

Antonino Virgillito, May 25th th Italian Population Census: Main Innovations Use and analysis of local population registers –Information basis of the census –Comparison and re-alignment of the data on citizens, collected by the Census, with those stored in registers Involvement of local municipality departments in the entire census process Use of multi-channel data collection techniques –Traditional paper-based data collection and online electronic questionnaire

Antonino Virgillito, May 25th The Census Web-Based Information System Integrated web architecture for the management and the online data collection Designed and developed in Istat –Based on open-source software and platforms Web hosting service was outsourced

Antonino Virgillito, May 25th The Census Web-based Information System SGR Management System QPOP Online questionnaire RETE Documentation portal Common database Accessible from both the Census office operators and Istat personnel Allows operators to manage and follow all the phases of data collection Distribution of workload among Istat and municipalities 70 functions implemented, organized in 8 areas Accessible from both the Census office operators and Istat personnel Allows operators to manage and follow all the phases of data collection Distribution of workload among Istat and municipalities 70 functions implemented, organized in 8 areas

Antonino Virgillito, May 25th SGR Monitoring of Questionnaires SGR allowed operators to follow the evolution of every single questionnaire, in every phase –“Census tract agenda” control panel Questionnaires were initially sent to families using population registers data Under-coverage was handled through enumerator field works Questionnaires could be collected in different ways –Web –Manual return to municipality –Post shipping –Collected by enumerator

Antonino Virgillito, May 25th SGR Census-Register Comparison Operator could monitor the differences between the population registers and the census result, producing at the end a balance sheet on families and individuals at municipal level All the inconsistencies were revealed in SGR dashboard and could be processed by operators

Antonino Virgillito, May 25th The Census Web-based Information System SGR Management System QPOP Online questionnaire RETE Documentation portal Common database Web application that citizens could use to fill up their questionnaire Assisted in compilation through rule checking Completed questionnaires immediately available in SGR Could also be used by Census office operators for performing data entry Web application that citizens could use to fill up their questionnaire Assisted in compilation through rule checking Completed questionnaires immediately available in SGR Could also be used by Census office operators for performing data entry

Antonino Virgillito, May 25th QPOP Main Features All the three types of paper questionnaires were reproduced online –questionnaires for households in long and short version –questionnaire for cohabitations Access credentials –User ID is tax code of reference person for the household –password printed on the paper questionnaire Assisted input with real-time error checking –Only pre-checked data were inserted in the database –High quality of collected data Multi-language support State-of-the-art software design

Antonino Virgillito, May 25th QPOPSoftware design qualities Scalability –No performance bottlenecks –Sophisticated technical solutions were adopted for controlling the database load even in presence of high number of concurrent users Robustness –Severe test phase –No application errors Security –Redundant access controls for avoiding data corruption and intrusions –Redundant data control for guaranteeing consistency

Antonino Virgillito, May 25th QPOP Metadata-based Design All the text for the questions, response modalities and application messages is stored in specific metadata tables –Avoidance of redundant source code for the three questionnaires –Rapid adaptation to changes in the specifications Also the questions flow (“questionnaire graph”) is stored as metadata –Preserves the consistency of saved data All the metadata is cached in memory for ensuring fast access and saving database resources

Antonino Virgillito, May 25th QPOP Text Search Engine QPOP includes a sophisticated mechanism for automatic encoding of textual responses Used within the question on highest educational qualification –Dictionary with 6,000 distinct items –The user enters a list of words describing her full title of educational qualification –The system replies by proposing a list of titles taken from the available dictionary ranked according to their similarity to the search keywords –The user must select one of the proposed items Pre-processing of the dictionary for optimizing response times

Antonino Virgillito, May 25th Results 8,250,000 questionnaires were filled on the web –33% of total –Peaks of 300 questionnaire saved per minute –Severe service outage on the first day Due to inaccurate server tuning by the hosting company Recovered the day after Census-Register comparison completed for the 96% of the population (as of March 31 st )

Antonino Virgillito, May 25th Advantages of the Integrated Web Platform Decentralized management of the network Real-time monitoring of multi-channel collection Efficient and effective census-register reconciliation Both implemented systems will be reused for the forthcoming Industry and Services Census

Antonino Virgillito, May 25th Thank you