1. School of something FACULTY OF OTHER School of Computing FACULTY OF ENGINEERING Data Collection and Evaluation Undergraduate Final Year Projects Lydia Lau (Project Co-ordinator) 6 March 2014

2. Why do you want to collect data? Gather user requirements for a software product Evaluate a software product Find out people’s opinion Analyse particular situation OTHERS???

3. Example A For studying current system and compared with the improve system A combination of data collection techniques both qualitatively and quantitatively. Note the structure used in reporting a user study /experiment

4. Data gathering techniques (Rogers, Sharp and Preece, 2011)

5. Example B Data collected just run time? but in different settings for comparison. Evaluation clear about what are being evaluated and the criteria used

6. Successful data collection & evaluation What is the target group / source of data Are they a representative sample How have you selected them How you will reach /access them What is the expected response rate /ease of access? How can you ensure that you get responses / access? Do you have an alternative if you do not get responses? Your time on this project is limited and precious!

7. Successful data collection & evaluation (cont.) How are you going to analyse the raw data (quantitative v qualitative) Coding, content analysis Summative statistics Comparisons Charts Excel vs Powerful Statistical Packages How will you report the findings Aim and objectives Experimental design (participants, method, tasks, materials) Results and analysis part What to be included in the main body of the report and what should be presented in appendices

8. Examples C & D Use of both quantitative and qualitative instruments to collect data Note the presentation of results

9. References Colin Robson, Real World Research: A Resource for Social Scientists and Practitioner Researchers, 2 nd Ed., Blackwell, Oxford, 2002. Part III for methods of data collecion Chapters 13/14 for data analysis Preece, Rogers and Sharp. Interaction Design: Beyond Human-Computer Interaction, John Wiley and Sons, 3 rd Edition, 2011 Chapters 7/8