UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 PDAs-Handheld Devices/Internet for Census Data Collection

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 Overview of the Presentation  Challenges with Paper-based Data Collection and Processing  Moving to PDA/Handheld-based Data Collection and Processing  PDAs: Key Features/Other Optional Features  Internet-based Census Data Collection  Benefits/Issues  Recommendations - Conclusions

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 Paper-based Data Collection Paper-based Data Collection Paper-and-Pencil Interviewing Self-administrated Questionnaire Handheld devices Internet

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 Challenges with Paper-based Data Collection/ Processing  Slow and time-consuming  Re-keying information is inefficient and increases chance of error  Paper-based forms increase chance of error  Submitting multiple forms for a single process  Cannot capture value-added data – GIS  Data Integrity and Authenticity

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 PDA and Handheld Computer  Personal digital assistant: “A personal digital assistant (PDA) is a handheld computer, also known as small or palmtop computers.” (Wikipedia)  PDA vs Handheld computer: Handheld computer offers more features than a PDA (larger than a PDA; smaller than a Laptop!) Used interchangeably

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 Paper-based Approach vs PDA’s Approach Manual Computer-assisted -Key entry/computer-assisted - OMR/OCR/ICR Manual Computer-assisted Automated/built-in Paper- based Approach PDA ‘s Approach Data CollectionData EntryData Coding/Editing Data Collection/Entry/Coding/Editing Data Coding/Editing (partial)

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 PDA: Way of Functioning  Simultaneously data entering and data coding  Possibility to enter data in two ways: with selection from the offered list of answers (or from classification in hierarchical order ) or with typing a text  The next question could not be answered if the current one is not answered  To have report of enumerated units (cumulative) in each moment  To measure the time needed for enumeration of each separate enumeration unit

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 PDAs - Key Features  Works like a “Pocket Computer”  Processor, RAM, ROM, Operating System  Applications can we loaded on the device  Device has processing power  Increases Productivity “ on the move ”  Data can be collected in digital format in the field  Data can be directly uploaded into the server

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 Cont…  Connectivity Options  Data connectivity using GPRS /CDMA  Data Connectivity options using Wi-Fi (Wireless)  Data can be transferred by “syncing” with Computer: wired connectivity via USB cable (PDAs connect to computer)  Enhanced data storage  Increase storage capacity through add on SD cards  Optional features  Camera, Biometric, GPS, Add on Smart Card reader etc

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 Two Types of Handheld devices:  Pen Based  Pocket PC’s oStylus based input oData transfer through “sync”  Converged  Pocket PC with Connectivity oConnected via GPRS / CDMA oOptions of Camera, GPS

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 Three forms of data transfer (from HP) Collect data in the field Sync and transfer data Using PDA with data sync option Option 1 Collect data in the field Send data via Inbuilt GPRS Using PDA inbuilt GPRS capability Option 2 Collect data in the field Send data via phone Using PDA in connection with Bluetooth Phone / connected cable Option 3

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 Selection Criteria: Data Input Method  Stylus, On device keyboard, Off Device Keyboard Memory capacity  RAM: MB  ROM: Inbuilt ROM, Additional ROM via SD Card Connectivity Options  Sync through computer, In-built GPRS/CDMA, Wi-Fi, Bluetooth Ruggedness Regional Language Support  Arabic, English plus additional languages Other Options  GPS, Camera, etc.

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 Other Decision Making Criteria:  Real time data upload Vs Batch data upload  Recurring costs for data connectivity  Ease of data entry/Ease of holding device in one hand  Battery Life / Battery Charging Options

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 Managing devices in the field: Some Considerations  How do we manage the devices in the field?  Data security?  Device security?  Application version on device?  Troubleshooting on device?

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 Measures for data protection  Ensure protection from: Loosing of already entered records Ex-post data correction in entered records Unauthorized using of data  Measures: Biometric Security Security for Wireless and GPRS Encrypting Data Make it “solid” (rugged?) Make it “ugly”!

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 Optional Features  The device can be enabled with GPS to: geo-reference units visited (urban and rural) track location of data entry track location of data entry Positioning and guidance of the enumerator Positioning and guidance of the enumerator  With Cellular, camera and OS applications

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 PDAs Costs  Pocket PCs: $300-$1200  Cost dependent on User Interface Upgrading  Economy of scale  Deployment issues

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 Summary of Key Features  Integrated field platforms with GPS, cellular, camera and OS applications  Real-time task management from office  Manage field time, expenses, etc.  Geographical and map processing  Data synchronization and management  Secure applications, procedures and protocols  Ability to encrypt data for secure transmission

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 Self-administrated Questionnaire Paper-based Data Collection Paper-and-Pencil Interviewing Self-administrated Questionnaire Handheld devices Internet

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 Internet-based Census Data Collection (eCensus)  Why? Requested by the population (e.g. France) Requested by the population (e.g. France) E-Government Policy (e.g. Canada) E-Government Policy (e.g. Canada)  Some benefits Accurate and timely data collection Accurate and timely data collection Processing time reduced Processing time reduced Rapid availability of clean data for statistical analysis Rapid availability of clean data for statistical analysis Enhanced analytics Enhanced analytics Reuse and consumption by multiple Departments Reuse and consumption by multiple Departments Enhanced Efficiency: eliminating layers, reducing staff and costs Enhanced Efficiency: eliminating layers, reducing staff and costs

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 Example: Canada Experience  Government On-Line (GOL) initiative  Census 2006: 73% Mail-out via Canada Post Development and integration of Internet application and processing was outsourced to private sector Target: 20% of initial response from the Internet

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 Example: European Census Organization Pilot for 2011 The pilot includes two key aspects: eCensus (census online) and Handheld devices. They want to equip census takers with hand-held devices to update addresses nationwide, and for non-response follow up or to input information during a canvass of homes whose residents fail to submit paper census surveys. From “RGI Conference on Technology Options”, IBM

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 Recommendations for the use of PDAs  Think Integration – People, Process, Technology  Build Partnership with: Application development partner Device Manufacturer Connectivity provider Capacity building supporter  Nodal Agency: Operationalize the whole process Operationalize the whole process

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 Summary-Conclusions 1.The qualitative as well as quantitative benefits of handheld devices have been proven in field in many countries (Australia, Canada, Brazil, Malaysia, New Zealand, etc…) 2.Various Options are available for selecting handheld devices 3.Clear identification of objective is required for selecting best device 4.Important to have extensive training prior to deployment 5.Post implementation support – technical as well as hardware support ensures project success

UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation and archiving Bangkok, Thailand, September 2008 Thank You