Using SMS-Gateways for Monitoring Progress and Quality of Data Collection: Lessons Learned from the 2010 Population Census of Indonesia Thoman Pardosi – Statistics Indonesia

Presentation Outline Background: - The 2010 Indonesia’s Census: Milestones of the Census and the Census Field Organization Monitoring progress of the census listing – Listing activity as a crucial part of a census – Using SMS-gateway to monitor the progress of the census listing Monitoring quality of the Census Data – Individual long form – Monitoring activity : Standard procedure in data collection Reliability of the results

Milestones of the Census Mapping Census Enumeration Areas (EA) or cluster: 2008 – 2009 Recruitment and training filed workers: Jan-April 2010 Data collection: May 2010 (Extended to June to ensure the census coverage) – Household (HH) listing and counting HH members by sex: Using EA maps and listing instrument (L1). – Enumeration and 100% interview of HH member: Using a questionnaire with 40 questions (C1).

Additional Information about Indonesia 33 provinces 497 districts sub districts vilages population (2010 census) households (2010 census) islands km2 126 peopels / km2

Field Organization of the Census BPS District Level Sub District Coordinator Team Coordinator Interviewer Team Coordinator Interviewer Teams enumerators Working in clusters 497 districs sub districts

Sending the census data for monitoring Summary of the census results were sent by field coordinator via SMS-gateway system to the census call center established at BPS headquarter in Jakarta. The contents of the summary results: – EA identity, – number of male, and – number of female

Processes of data dissemination The census call center was designed mainly to receive the census results sent by field coordinators via SMS-gateway system and to tabulate them automatically. The SMS-based tabulation was disaggregated by EA, village, sub district, district, province, and total at national level. Using a website, the census officers at every management level (from district to national level) were entitled to access the table using their own user name and password.

Utilization and drawback of the SMS-based results The summary of the census results sent via SMS- Gateway were utilized mainly to monitor the progress of data collection and to serve as an early warning system for mitigation possible problems in the census coverage. The census results provided by SMS-gateway system were also utilized for comparison with the results provided by other systems (which were also developed during the census). Nonetheless, due to possible typing errors (in writing SMS), the results of SMS-gateway system were used only for internal BPS, not for public.

Quality Monitoring Quality assurance focused on listing, procedures, and characteristic of individual. The listing quality monitoring is to improve the coverage. The procedure monitoring is to minimize non sampling error and also improve the coverage. The monitoring of individual characteristic is to improve the validity of individual and housing data.

Organization Q.M. For data quality monitoring we recruited 1676 person : 136 person as coordinators and 1540 person as enumerators. About person of enumerators were the student of Statistical Colleagues. They were trained by 50 trainers. Their 2 days training program covering: all fields operation and how to use field instruments.

Data Collection  They were assigned to: clusters in selected villages (1.548 sub districts, 497 (all) districts, and 33 (all) provinces).  There are 7 households in one cluster chosed randomly as respondents to check individual and housing characteristics.  They checked procedures applied, counted number household and asked questions. The questions are part of complete question in real questionnaire.

Copy Data Then they copied the answer from original questionnaires, so both of them can be compared, and then it is sent to a gateway system. They do not need to judge the result which is wrong or right, but just send it. The system will immediately create tables of differences and disseminate tables and graphics. Red color in graphics indicates high differences.

Access to Website Website can be accessed by supervisor or management who are already registered. ( This internet monitoring is designed to help management in all levels to see the rechecked result as soon as possible. It is important for the management level to instruct the team to correct the same errors in all clusters.

Data Content fo Monitoring -Household member, -Relation to head of household, -Sex, -Age, -School attendance, -Marital status, -Floor, -Electricity, -Water for drink, -Sanitation, -Ownership of house,

Data Format in SMS

The Question on Coverage and Procedure Border of cluster’s map is clear or not? Is listing start from east or west side? Is listing process done part by part of sub cluster (if any)? How many census building that is no sticker and how many all census building in the cluster?

The Question … Is the number of stickers match with forms (questionnaire): all, or majority (>= 75%), or not majority (<75%)? Is the crosscheck done? Is interview with long form done after finishing listing? Are you trained? If yes, for how long? When do you scan the cluster? Before you do listing, did your team take meeting first?

The objectives To maximize coverage of buildings and households, by checking the samples. To make sure that listing applied based on the rule. To correct content error of some characteristic on individuals and housing information. Give speed information by SMS-Gateway to the officers in the district level about error indications and ask them to do checking in all clusters.

KAMSAHAMNIDA 감사합니다 Thank You