1. Measuring Respondent feedback Pia Thomsen Forms design team

2. Respondent feedback Voluntary questions on time usage and user-friendliness Response rate Table examples Preliminary results Comments 2

3. 3

4. Annual surveys – Response rates OnlineUser quest.Comment Environmental protections expenditures61973 %11 % External trade in organic goods21973 %10 % Research, Development and Innovation239062 %6 % Agricultural and horticultural survey119681 %20 % Raw material and industrial services69882 %11 % Patents and IP rights 2009203275 %9 % Patents and IP rights 201073192 %8 % Danish foreign affiliates 2010155985 %10 % Additional labour costs 2010141717 %4 % Public libraries 20109880 %45 % Research libraries 20107271 %39 % Use of internet 2010234495 %12 % Absence12863 %22 % Public sector finances2387 %13 % 4

5. Quarterly surveys – Response rates 5 OnlineUser questions Comments Job vacancy statistics - 3rd quarter 2011328918 %2 % Transport of goods - 3rd quarter 201147610 %5 % Pigs - 3rd quarter 20115386 %1 %

6. Monthly surveys - Response rates AnswersComments March 201165813 April3967 May3295 June2122 July2083 6 Out of ca. 900 responses via Virk.dk Industrial production and new orders

7. Respondent evaluation - aggregated 7

8. Respondent evaluation 8 Example: Environmental protection expenditures

9. 9 Access to questionnaire Understanding questions Obtaining answersData entryAverage score Time used (min) (median) Answers (Total online) Agricultural and horticultural survey 5871617867601.098 (1.668) External trade in organic goods888367868130290 (343) Additional labour costs 20108580559779120237 (1.375) Job vacancy statistics 879587979110342 (1.037) Raw material and industrial services 8980478675180322 (616) Index of retail sales 718782938310182 (431) Patents and IP rights 20109184899790101.043 (2.600) ICT investment and expenditures 8077599077602.023 (3.119) Environmental protections expenditures 877866918145547 (883) Danish foreign affiliates 20108284839285301.423 (1.902) Research, Development and Innovation 8373699279301.505 (2.790) Transport of goods 80786469736071 (378) Pigs 708776898145101 (511) Investment Expectations889487999215284 (567) Public libraries 2010 637247936948082 (98) Research libraries 2010 506344745832855 (72) Use of internet 20107473709277302.227 (2.600) Industrial production and new orders 849179978815233 (827) Absence727762556624078 (148)

10. Time usage 10 Example: Environmental protection expenditures

11. Cross-tabulation: Find information / time 11 Example: Environmental protection expenditures

12. Provisional results Across all surveys: The most difficult task is to obtain the necessary information First-time users find it difficult to get access to online portal - Virk.dk Data entry is the least difficult task 12

13. Comments and suggestions Difficult to get access to Virk.dk –Down time –Digital signature Difficult to obtain information –Discrepancy in calculation methods –Respondents don’t have access to sufficiently detailed information 13

14. Comments and suggestions Technical problems –Performance –Lost data –Browser problems Lack of relevance –Research, development and innovation survey - ca. 50% of all comments –Patents and IP rights - ca. 90 % 14

15. My Favourite Comments ”You can’t keep sending this kind of junk to me. I have other and more important things to use my time on.” ”Please send me 2 bottles of ‘Gl. dansk’ (alcohol) for the inconvenience you have caused me.” 15