Deirdre Giesen & Barbara Berkenbosch Managing perceived response burden: why and how.

Slides:



Advertisements
Similar presentations
The Response Process Model as a Tool for Evaluating Business Surveys Deirdre Giesen Statistics Netherlands Montreal, June 20th 2007 ICES III.
Advertisements

ESSnet on Standardisation Q2014 – European Conference on Quality in Official Statistics 2 nd -5 th June, 2014 Mr. Csaba Ábry (HCSO) – Ms. Deirdre Giesen.
ENBES Steering Committee report Past Initiated in 2008 i. create network of European researchers and practitioners in establishment statistics.
User Involvement Statistics Iceland’s Experience Nordic Statistical Conference August 2010 Heiðrún Sigurðardóttir Þorbjörg Magnúsdóttir.
© Statistisches Bundesamt, Institute for Research and Development in Federal Statistics Statistisches Bundesamt Business Surveys – Testing Strategies in.
Thursday, 10 July, 2008Q2008, 8-11 July 2008, Rome1 Getting Data for Business Statistics: A Response Model for Business Surveys Ger Snijkers Statistics.
B121 Chapter 7 Investigative Methods. Quantitative data & Qualitative data Quantitative data It describes measurable or countable features of whatever.
Innovation voucher EFPL Sept. 30, 2006 The effect of innovation vouchers on science-industry interaction Marc Van der Steeg Maarten Cornet Björn Vroomen.
ESSnet on Small Area Estimation Stefano Falorsi ISTAT International conference on Indicators and Survey Methodology, 2010, Wien
Page 1 Vienna, 03. June 2014 Mario Gavrić Croatian Bureau of Statistics Senior Adviser in Classification, Sampling, Statistical Methods and Analyses Department.
Ger Snijkers Vanessa Torres van Grinsven Business Survey Communication Practices UNECE Workshop on Statistical Data Collection Bureau of Labor Statistics.
1 1 Web and Paper Questionnaires seen from the Business Respondent’s Perspective Gustav Haraldsen, Statistics Norway Jacqui Jones, UK Office of National.
The effectiveness of the school’s approach to the identification and development of future school leaders – Alfred Salter Primary School What were our.
Diane K. Willimack U.S. Census Bureau Any views expressed on statistical, methodological, or technical issues are those of the authors and not necessarily.
Deirdre Giesen & Ger Snijkers EESW 9-11 September 2013 Communication with businesses and response burden.
Donatella Fazio BLUE-ETS project coordinator Maria Grazia Calza BLUE-ETS senior researcher ISTAT BLUE-ETS BLUE – Enterprise and Trade Statistics 2012 ESSnet.
The Future of Statistical Data Collection? Challenges and Opportunities Johan Erikson (Statistics Sweden) Gustav Haraldsen (Statistics Norway) Ger Snijkers.
1 1 Management Tools for Enhancing the Composition of Survey Response Q2008 European Conference on Quality in Official Statistics Rome, July 2008 Anne.
United Nations Economic Commission for Europe Statistical Division Leading, composite and sentiment indicators UNECE Statistical Division.
“Better dialogue on statistics for better development results”: Meeting data needs of users in Ghana through the National Statistical System Bamako
Development of metadata in the National Statistical Institute of Spain Work Session on Statistical Metadata Genève, 6-8 May-2013 Ana Isabel Sánchez-Luengo.
"Automated data collection in accommodation statistics: a European overview" Rome, 3 rd December 2012.
Modernisation and Quality of Business Statistics – NSI Perspective Ger Snijkers (Statistics Netherlands) Gustav Haraldsen (Statistics Norway) EESW, 9-11.
Increasing motivation for better reporting in establishment surveys Mojca Bavdaž, University of Ljubljana, Slovenia Johan Erikson & Boris Lorenc, Statistics.
Consumer Confidence in Food Risk Management in Europe Results from a multi-phase study E Van Kleef, J Houghton, G Rowe & L Frewer SRA-E, September.
Eurostat The impact of the Memobust project results.
Sander Scholtus and Leon Willenborg Editing and Imputation in the Memobust Handbook.
The MEMOBUST project Ágnes Andics EESW Nürnberg 1.
PRESENTATION ON ASSESSMENT AND PRIORISATION OF USER NEEDS By W. C. Mayaka 10/16/20111.
1 Conclusions from Sessions 4, 5, 6 Rapporteurs: Donatella Fazio, Istat Maria Grazia Calza, Istat Arianna Carciotto, Istat ESSnet Workshop 2012 Cavour.
ORGANISATION FOR ECONOMIC CO-OPERATION AND DEVELOPMENT ORGANISATION DE COOPÉRATION ET DE DEVELOPMENT ÉCONOMIQUES OECDOCDE Workshop on improving statistics.
Hallgrímur Snorrason Management seminar on global assessment Session 8: Planning, programming and priority setting under budgetary restraints; human resource.
Jenny Linnerud, 27/10/2011, Cologne1 ESSnet CORE Common Reference Environment ESSnet workshop in Cologne 27th and 28th of October 2011.
QUALITY ASPECTS WHEN MODERNIZING INTRASTAT Ales Capek Eurostat.
Thursday, June 21, 2007ICES3, June 18-21, 2007, Montreal1 Understanding the Decision to Participate in a Business Survey Ger Snijkers Martin Luppes Barbara.
CEPS, 1 Place du Congrès 1000, Bruxelles , ESSnet Workshop October, Cologne BLUE-ETS BLUE-Enterprise and Trade Statistics.
ESSnet Workshop Cologne 2011 ESSnet on measuring global value chains.
Improving the Respondent Experience in the United Kingdom Julie Curzon/Debra Prestwood UK Office for National Statistics (ONS)
Overview of measures used by NSIs to reduce response burden Conference on Administrative Simplification in Official Statistics, SIMPLY 2010 Virginie Raymond-Blaess.
Discussion Session 5: Data collection Maiki Ilves Statistics Estonia
Modernisation of Statistics Production Stockholm November 2009 Summary and Conclusions New York 24 February 2010 Mats Wadman Deputy Director General Statistics.
Q Rome Italy, July Towards Producing and Using Response Burden Data for Establishment Surveys at Statistics Sweden Johan Erikson, Dan Hedlin,
Life planning All digital literacies ICT literacy Media literacy Digital scholarship Communication & collaboration ICT literacy Digital scholarship Life.
Topic (i): Selective editing / macro editing Discussants Orietta Luzi - Italian National Statistical Institute Rudi Seljak - Statistical Office of Slovenia.
TRAFOON project is funded by the European Community's Seventh Framework Programme (FP7/ ) under grant agreement no Mrs. PATRICIA MORA GESTIONA.
Ministry of Economic Affairs | 11 April 2013 The Mark of Good Public Services A Uniform Framework for Measuring and Improving Public Services for Businesses.
Assessment and Prioritisation of user needs: Challenges Workshop on Review of the Implementation of the Reference Regional Strategy Framework for Statistical.
ESS-net DWH ESSnet on microdata linking and data warehousing in statistical production Harry Goossens – Statistics Netherlands Head Data Service Centre.
Methods to improve scb.se with a user perspective Cecilia Westström Statistics Sweden June
Linking management, planning and quality in Statistics Norway A coherent planning system Systematic quality work Portfolio management Hans Viggo Sæbø and.
1 Building a Corporate Strategic Communications Plan Agency-wide Consultations April 2009.
1 1 Reflections about the Impact Business Questionnaires have on Perceived Response Burden and Survey Quality Gustav Haraldsen Statistics Norway
What is metadata? Anne Gro Hustoft, Statistics Norway
Building Capacities for Establishment of Social Science Digital Data Archives Aleksandra Bradić-Martinović, Institute of Economic Sciences, Belgrade Achievements.
1. 2 Issues in the Design and Testing of Business Survey Questionnaires: Diane K. Willimack U.S. Census Bureau Economic Census The International.
Progress Report on Quality Issues SIPUS – Strengthening of Internationalisation Policies at Universities in Serbia February 18, 2015 Belgrade, Serbia.
1 Assessing Community Needs and Community Readiness.
ILM Level 3 Award Managing Customer Service (M3.08) Providing Quality to Customers (M3.19) Rebecca Johnson Corporate Learning & Development.
Maria João Zilhão Planning and Quality Control Unit « High Level Seminar “Quality Matters in Statistics” June, Athens, Greece Implementation of the.
Sources of Motivation in Business Surveys Vanessa Torres van Grinsven, Irena Bolko, Mojca Bavdaž,
REACH FOR POLYMERS A €480, month project aiming to increase the knowledge base of the European polymer industry, particularly SMEs, when complying.
Karin Hansson, Statistics Sweden Maja Islam, Eurostat
In Search of Motivation for the Business Survey Response Task
of the Statistical Office of the Republic of Slovenia
User Satisfaction Survey ESDS Germany Forsa Institute
Deirdre Giesen & Barbara Berkenbosch
Merlijn van Rijswijk, Marcel Kleijn et al
EMOS - European Master in Official Statistics
Overview of objectives WP5
Merlijn van Rijswijk, Marcel Kleijn et al
Presentation transcript:

Deirdre Giesen & Barbara Berkenbosch Managing perceived response burden: why and how

Actual and perceived response burden –Actual response burden: time and/or money spent on complying with statistical data requests –Perceived response burden: subjective evaluation of effort spent. E.g. ‐Did you find it quick or time consuming? ‐Did you find it easy or difficult? See also Dale & Haraldsen (2007) ‘Handbook for monitoring and evaluating business survey response burdens’. 2

Outline –Findings BLUE-ETS project: demonstrating need for management of perceived burden –Example of “Perception of Burden” project at Statistics Netherlands 3

Acknowledgements BLUE-ETS work CBS Deirdre Giesen, Vanessa Torres van Grinsven, Ger Snijkers et al. University of Ljubljana: Mojca Bavdaž, Irena Bolko et al. SSB Gustav Haraldsen, Øyvin Kleven, Tora Löfgren, Dag Gravem et al. SCB Boris Lorenc, Andreas Persson et al. SORS Rudi Seljak et al. University of Bergamo Sylvia Biffignandi Perception of Burden Project Barbara Berkenbosch, Daisy Debie, Lex Visser, Matthijs Jacobs,Vronie de Haan, Jos van den Heuvel, Max Storms, Deirdre Giesen, Vanessa Torres van Grinsven, Ger Snijkers et al.

BLUE-ETS research on burden and motivation Measurement and reduction of response burden in official business surveys NSIs practice Businesses’ perspectives on official statistics Case studies Analyses of data on burden and response behaviour in Sweden, Norway and Netherlands Studies on effects of actions to reduce burden and/or increase motivation: Experiments on improving motivation in Sweden and Slovenia, studies on effects of questionnaire design in Norway and The Netherlands BLUE-Enterprise and Trade Statistics project ( April 2010-March 2013) EU FP7 project See for all reportswww.blue-ets.eu

Slovenian experiment (Bavdaž & Bolko 2013)

Results BLUE-ETS case studies 1 Response burden related to response behaviour, e.g. more burden: lower and later response, more edits needed Perceived burden related to actual burden but also to perception of NSI and usefulness statistics

Results BLUE-ETS case studies 2 Experiments aiming at increasing motivation by better communication did not show many of the expected effects The two questionnaire studies showed that questionnaire redesign can reduce actual and perceived burden

Perception of Burden Project at SN –Ran from February 2012-August 2013 –Part of government policy to reduce burden caused by statistics –Main goal: further intensify and coordinate actions to reduce perceived burden (projects aimed at reducing actual burden ran in parallel) –Main goal: improve businesses’ and business organisations perceptions of response burden created by SN surveys 9

Assess needs by –Brainstorming workshop with representatives from various parts of bureau to 1) make inventory of current knowledge and initiatives and 2) prioritise actions needed to reduce business respondents’ irritiations about our survyes. –Additional research: telephone survey of SMEs in our samples, re-analyses of data customer satisfaction survey, analyses of sentiments regarding SN in social media 10

Actions taken –Improvement of letters –Show case approach: collaboration with businesses and business organisations in redesign of survey –Reduction of helpdesk waiting times –Improvement of service call center –Improvement of website 11

Plans for the future –Use ‘show case approach’ for future redesign projects –Develop permanent monitoring of perceived response burden –Redesign questionnaire systems to imporve uniformity and user friendliness of our questionnaires and to enable the production of survey calendars –Further professionalize our complaint handling 12

Thank you for your attention… … and please have a look at all BLUE-ETS deliverables at 13