Evaluation of Content Error Pres. 10

Evaluation of Content Error Objective of Content Error Evaluation Learn consistency in reporting of information between P – and E- samples on those items that are used for matching and estimation 2 2

Examples - Tabulations for Content Error Estimates Sex as reported in the census and as reported in the PES for matched persons Age as reported in the census and as reported in the PES for matched persons Family relationship as reported in PES for matched persons NOTE: PES should check content errors only for those items that support PES procedures 3

Table for content error evaluation Age in PES Age in census Total 0-4 5-9 …… 55-59 60+ X 1. X 2. …. ….. X i. X s. X .1 … X .i X .s n 4 4

Evaluation of Content Error Net difference rate (NDR) The NDR is the difference between the number of cases in the census and number of cases in the PES that fall under a category (e.g. age-group) relative to the total number of matched persons in all response categories 5

Evaluation of Content Error (contd.) Index of inconsistency It is a relative number of cases for which the response varied between the census and PES. In a n x n table, numbers in diagonal cells show consistency (agreement). Off diagonal numbers represent inconsistency. This is calculated for each response from a category 6

Other indicators of content errors Aggregate index of inconsistency : Gross difference rate (also proportion of difference to the diagonal): number of discrepancies between response at the census and at the PES relative to the number of matched persons. 7 7

Other indicators of content errors Rate of agreement: > Complement of gross difference rate. A low rate of agreement means a high degree of variability and vice versa 8 8

How to interpret content error measures Index Low Moderate High Absolute value of NDR < 0.01 0.01-0.05 >0.05 Index of Inconsistency <20 20-50 >50 Aggregate Index of Inconsistency 9

Table for content error evaluation Age in PES Age in census Total 0-4 5-9 …… 55-59 60+ X 1. X 2. …. ….. X i. X s. X .1 … X .i X .s n 10 10

Thank You!