1. Evaluation of Content Error Pres. 10

2. Evaluation of Content Error
Objective of Content Error Evaluation
Learn consistency in reporting of information between P – and E- samples on those items that are used for matching and estimation 2 2

3. Examples - Tabulations for Content Error Estimates
Sex as reported in the census and as reported in the PES for matched persons
Age as reported in the census and as reported in the PES for matched persons
Family relationship as reported in PES for matched persons
NOTE: PES should check content errors only for those items that support PES procedures 3

4. Table for content error evaluation
Age in PES
Age in census
Total
0-4
5-9 ……
55-59
60+
X 1.
X 2. ….
…..
X i.
X s.
X .1 …
X .i
X .s n 4 4

5. Evaluation of Content Error
Net difference rate (NDR)
The NDR is the difference between the number of cases in the census and number of cases in the PES that fall under a category (e.g. age-group) relative to the total number of matched persons in all response categories 5

6. Evaluation of Content Error (contd.)
Index of inconsistency
It is a relative number of cases for which the response varied between the census and PES. In a n x n table, numbers in diagonal cells show consistency (agreement). Off diagonal numbers represent inconsistency. This is calculated for each response from a category 6

7. Other indicators of content errors
Aggregate index of inconsistency :
Gross difference rate (also proportion of difference to the diagonal): number of discrepancies between response at the census and at the PES relative to the number of matched persons. 7 7

8. Other indicators of content errors
Rate of agreement:
> Complement of gross difference rate. A low rate of agreement means a high degree of variability and vice versa 8 8

9. How to interpret content error measures
Index
Low
Moderate
High
Absolute value of NDR
< 0.01
>0.05
Index of Inconsistency
<20
20-50
>50
Aggregate Index of Inconsistency 9

10. Table for content error evaluation
Age in PES
Age in census
Total
0-4
5-9 ……
55-59
60+
X 1.
X 2. ….
…..
X i.
X s.
X .1 …
X .i
X .s n 10 10

11. Thank You!