1. Editing staff debriefings at Statistics Sweden
Jörgen Svensson
Process Owner

2. What is an editing staff debriefing?
Interview with editing staff, similar to a focus group
Gives qualitative paradata
‘Proxy cognitive interviews’
For evaluation of measurement instruments and the editing process

3. When should an editing staff debriefing be carried out?
If the measurement instrument is changed
It there are indications of problems with the measurement instrument
If the measurement instrument has not been tested before
If there are indications of deficiencies in the editing process

4. How is an editing staff debriefing carried out?
Led by a moderator (cognitive specialist)
With 5-8 editors
Taking 1-2 hours
Using a topic guide
Being recorded
Begins with more open discussion and ends with more structured questions

5. Topic guide – examples of questions
What types of respondents have problems? Why?
Can the respondents handle pre-printed figures properly?
Do you think the respondents read the instructions? Are these understood?
Are some variables estimated rather than calculated?
How could the IT system for editing be improved?

6. A summary written from the recording Supported by quotations
Analysis and report writing
A summary written from the recording
Supported by quotations
Sent for comments and clarifications
Results taken care of properly

7. Examples of debriefing results
Related changes of variable values need to be done in different parts of the production system
The distribution of net turnover is error-prone and would need to be supported by new edits
The instructions for the editing process are obsolete and must be updated
Respondents sending data through an Excel file would need to be given separate instructions

8. – editing staff debriefings
Concluding remarks
– editing staff debriefings
Can identify several problems with the measurement instrument and the editing process
The editing staff often has ideas concerning what causes problems or errors
Considerable information is obtained to a modest cost
The results give a unique contribution, complementing information obtained by other means