1 Designing IT surveys for benefit measurement Pertemuan Matakuliah: A Evaluasi Efektivitas Sistem Informasi Tahun: 2006

2 Main issues to consider 1.Survey method 2.Sampling scheme 3.Questionnaire design

3 Approaches to data collection 1.Mail surveys 2.In-company/on-board surveys 3.Telephone surveys 4.Personal interviews 5.Computer surveys

4 Types of sample 1.Non-probability sample 2.Probability sample

5 Questionnaire design Firm want to achieve Information sought Type of questionnaire used Questionnaire administered Content individual questions Type of response required Number of questions used Questions sequenced Revision needed Prior to main survey Things which help Things to avoid Techniques for questioning Sequencing of questions Pre-coded questions Particular questions

6 Guide to conducting survey Terms of reference Data collection Determine sample size and sample frame Focus group Produce questions Questionnaire design Conduct a pilot study Revise questionnaire Distribute questionnaire Collect results Code results Analyze and interpret

7 The Survey Process-Methodology There is a sequential methodology that can be used to optimize the creation and use of a survey. –Knowing what you want to achieve and planning how to get there are the best way to succeed. –This approach does take time and costs money.

8 Data Collection Costs Task Costs – Manual Surveys Labor Costs Cover letter and questionnaire –design & typing –Purchasing mailing list cost (if necessary) –Addressing mailing envelopes Cover letter and survey printing costs –Envelope costs (both ways + more) –Postage costs (both ways + more) Incentives Data entry and verification –Statistical analysis software Distribution of the final report

9 Data Collection Costs Task Costs – Automated Surveys Labor Costs Planning –Specifications –Applications –Hardware Questionnaire Design –Notification System –Participant identification Incentives Data entry and verification –Statistical analysis software Distribution of the final report