ESF-Evaluation Partnership Meeting, Brussels, 9th October 2018 Online ESF-Questionnaire ESF-Evaluation Partnership Meeting, Brussels, 9th October 2018
Online ESF-Questionnaire Motivation Why did we develop an online survey? Idea and design What influenced the design of the online survey? How to use the online survey? Outlook What needs to change to have a paperless process?
Why did we develop an online survey Initial situation: Participants and beneficiaries have to fill out paper-based questionnaires (entry, exit and 6 months after exit). The entry questionnaire has to be signed to declare that the given information is true.
Why did we develop an online survey Initial situation: Beneficiaries have to transfer the data to the Intermediate Bodies and the Management Authority via a website. Data has to be typed into the website (likewise AIR in SFC).
Why did we develop an online survey Initial situation: Data entry form
Why did we develop an online survey Initial situation: The system validates the data while typed, yielding various differences in questionnaires and database (many beneficiaries correct the data without documentation, violating the audit trail -> information should be traceable from SFC back to the questionnaires).
Why did we develop an online survey Initial situation: Validation routines
Why did we develop an online survey Initial situation: Intermediate bodies have to check a sample of the questionnaires for errors, all questionnaires are checked when the error rate is above a certain threshold. Errors can be categorized into: misunderstanding of the questionnaires data input-errors documentation errors of corrections
Why did we develop an online survey Initial situation: Beneficiaries have to correct the errors via the website and document the corrections on the questionnaires to secure the audit trail.
Why did we develop an online survey The described process leads to a considerable workload both, at beneficiaries and Intermediate Bodies (IB) level. Thus, an Online ESF-Questionnaire was developed, to ease the workload and inspection effort and to eliminate a considerable amount of errors.
What influenced the design of the online survey Two demands guided the development of the Online ESF-Questionnaire: It has to provide an added value for beneficiaries and participants It has to reduce the error rate in questionnaires and reduce workload at beneficiary and IB level
What influenced the design of the online survey The first demand is fulfilled by Providing an easy procedure to unlock the Online ESF-Questionnaire for the beneficiaries Optimizing the Online ESF-Questionnaire for smartphones Providing multiple language support for the users (participants) Foregoing a user specific log-in procedure, using a time-limited open log-in instead
How to use the online survey https://abba-online-esf-test.ecoh.nrw.de/esf/authenticate.do
How to use the online survey https://abba-online-esf-test.ecoh.nrw.de/esf/mobile/de/index.html Login: 406975
How to use the online survey
How to use the online survey The second demand (reduced error rate and workload) is fulfilled by Live validation routines Relieving beneficiaries from error prone paper-to-website retyping Reducing audit effort/workload of IBs
How to use the online survey
How to use the online survey
How to use the online survey IBs can reduce their effort in checking questionnaires by comparing timestamps online and on paper -> identical timestamps prove that the signature on the paper questionnaire refers to the transmitted data.
What needs to change to have a paperless process The described process still needs paperwork: At present, the entry questionnaires have to be printed after they are filled out via the Online ESF-Questionnaire and signed to declare that the given information is true (audit trail). Note: The questionnaires for the information on exit and 6 months after exit can be filled out online by beneficiaries w/o using the paper-based questionnaires.
What needs to change to have a paperless process In order to allow a truly digital process, two changes are necessary: The need to sign questionnaires has to be revoked (typical for some German federal states). As this would not be necessary for register data, Audit Authorities (and the European Commission) need to recognize that the potential quality of survey data is at the same level as the potential quality of register data. The signature of the declaration of consent to the data-protection terms and conditions has to be made obsolete by obtaining this declaration digitally.
Thank You!