School of something FACULTY OF OTHER School of Computing FACULTY OF ENGINEERING Data Collection and Evaluation Undergraduate Final Year Projects Lydia.

Slides:

Advertisements

Similar presentations

Chapter 14: Usability testing and field studies

Advertisements

Communication Theory Lecture 1: Introduction to Communication Theory and Novel Technology Dr. Danaë Stanton Fraser.

Methodology and Explanation XX50125 Lecture 1: Part I. Introduction to Evaluation Methods Part 2. Experiments Dr. Danaë Stanton Fraser.

EDUCATIONAL RESEARCH It is a systematic enquiry made public (Stenhouse, 1975) It is the process of arriving at dependable solutions to problems through.

Observing users Chapter 12. Observation ● Why? Get information on.. – Context, technology, interaction ● Where? – Controlled environments – In the field.

Course Overview Sem 1 (13/14) Section 1 & 2

Chapter 14: Usability testing and field studies. 2 FJK User-Centered Design and Development Instructor: Franz J. Kurfess Computer Science Dept.

Usability Evaluation Evaluation should occur continually through the design and implementation process. Evaluation methods are applied as the interface.

Observing Users Paul Bogen, LaShon Johnson, Jehoon Park.

Proposed plan for the summative evaluation of a Technology Enhanced Learning Project Dean Petters, Statement of the research question Participants Method.

Paper Title Your Name CMSC 838 Presentation. CMSC 838T – Presentation Motivation u Problem paper is trying to solve  Characteristics of problem  … u.

Evaluation. formative 4 There are many times throughout the lifecycle of a software development that a designer needs answers to questions that check.

Part 4: Evaluation Chapter 20: Why evaluate? Chapter 21: Deciding on what to evaluate: the strategy Chapter 22: Planning who, what, where, and when Chapter.

This material has been developed by Georgia Tech HCI faculty, and continues to evolve. Contributors include Gregory Abowd, Jim Foley, Diane Gromala, Elizabeth.

Chapter 7 Qualitative Data Analysis and Interpretation.

Human Computer Interaction 0. Preface National Chiao Tung Univ, Taiwan By: I-Chen Lin, Assistant Professor.

Human Computer Interaction Semester 1, 2013/2013.

Human-Computer Interaction Computer Science Tripos Part II Alan Blackwell.

Introduction Methodology Results This study aims to explore the current progress of using different types of software with various autism conditions. One.

Introduction to SDLC: System Development Life Cycle Dr. Dania Bilal IS 582 Spring 2009.

©2010 John Wiley and Sons Chapter 11 Research Methods in Human-Computer Interaction Chapter 11- Analyzing Qualitative.

MK346 – Undergraduate Dissertation Preparation

Qualitative Analysis Information Studies Division Research Workshop Elisabeth Logan.

ASESORIA DECLERQ SL EUROPEAN STUDIES. Since 1998 Consultancy specialised in European programmes and in developping projects (memories, tasks, managment)

Chapter 12: Survey Designs

Objectives To identify the key parts of the clients brief. To identify possible success criteria To complete the specification sheet.

Requirements for the Course

Human Computer Interaction Southern Methodist University CSE 8316 Spring 2004.

Additional Material for Chapter 3 CS 420/620 Fall 2015.

Qualitative and Quantitative Research Quantitative Deductive: transforms general theory into hypothesis suitable for testing Deductive: transforms general.

©2010 John Wiley and Sons Chapter 12 Research Methods in Human-Computer Interaction Chapter 12- Automated Data Collection.

Human Computer Interaction

Usability testing. Goals & questions focus on how well users perform tasks with the product. – typical users – doing typical tasks. Comparison of products.

AMA INTERNATIONAL UNIVERSITY BHARAIN SOFTWARE ENGINEERING PROJECT - SBI 302 SOFTWARE ENGINEERING PROJECT - SBI 302A SOFTWARE ENGINEERING PROJECT - SBI.

Research Methods Seminar Gosia Kwiatkowska

Understanding Qualitative Assessment Skills Session #3 A-Team Training November 13, 2007.

REAL WORLD RESEARCH THIRD EDITION Chapter 8: Designs for Particular Purposes: Evaluation, Action and Change 1©2011 John Wiley & Sons Ltd.

Experimentation in Computer Science (Part 1). Outline  Empirical Strategies  Measurement  Experiment Process.

CS2003 Usability Engineering Human-Centred Design Dr Steve Love.

Identify a Health Problem Qualitative Quantitative Develop Program -theory -objectives -format -content Determine Evaluation -design -sampling -measures.

©2010 John Wiley and Sons Chapter 3 Research Methods in Human-Computer Interaction Chapter 3- Experimental Design.

Chapter 8 Usability Specification Techniques Hix & Hartson.

1 ITM 734 Introduction to Human Factors in Information Systems Cindy Corritore This material has been developed by Georgia Tech HCI faculty,

Savannah, GA FIE 2004 Work In Progress - Using User Experience Research to Develop Needs Assessment Skills of Undergraduates Laura Moody & Joan Burtner.

©2010 John Wiley and Sons Chapter 2 Research Methods in Human-Computer Interaction Chapter 2- Experimental Research.

Presenting and Analysing your Data CSCI 6620 Spring 2014 Thesis Projects: Chapter 10 CSCI 6620 Spring 2014 Thesis Projects: Chapter 10.

Research Design ED 592A Fall Research Concepts 1. Quantitative vs. Qualitative & Mixed Methods 2. Sampling 3. Instrumentation 4. Validity and Reliability.

Usability Evaluation, part 2. REVIEW: A Test Plan Checklist, 1 Goal of the test? Specific questions you want to answer? Who will be the experimenter?

Usability Evaluation. Objectives for today Go over upcoming deliverables Learn about usability testing (testing with users) BTW, we haven’t had a quiz.

Chapter 61Introduction to Statistical Quality Control, 5th Edition by Douglas C. Montgomery. Copyright (c) 2005 John Wiley & Sons, Inc.

CHAPTER 10 DATA COLLECTION METHODS. FROM CHAPTER 10 Copyright © 2003 John Wiley & Sons, Inc. Sekaran/RESEARCH 4E.

Course Outline Presentation Reference Course Outline for MTS-202 (Statistical Inference) Fall-2009 Dated: 27 th August 2009 Course Supervisor(s): Mr. Ahmed.

Paper III Qualitative research methodology.  Qualitative research is designed to reveal a specific target audience’s range of behavior and the perceptions.

PowerPoint Presentation to Accompany Management, 8/e John R. Schermerhorn, Jr. Prepared by: Jim LoPresti University of Colorado, Boulder Published by:

Market Research Market Research – What is it? Gathering information on (for example)… …finding new markets …evaluating public opinion …gaining insight.

Searching and Using Electronic Literature III. Research Design.

Marketing Research. Good marketing requires much more than just creativity and technical tools. It requires research! Who needs it? Who wants it? Where.

Program Evaluation “Most often defined as a process used to determine whether the design and delivery of a program were effective and whether the proposed.

Chapter 1: The Nature of Analytical Chemistry

Introduction to Project Management Project Monitoring and Control Lecture a This material (Comp19_Unit9a) was developed by Johns Hopkins University, funded.

A USABILITY STUDY WITH CHILDREN AND SMARTBOARD TECHNOLOGY: IMPROVING OUR METHODS IN DATA COLLECTING AND GATHERING TECHNIQUE Laili Farhana Md Ibharim &

The majority of players were born in January, February, and March

Chapter 2 Doing Sociological Research

Social Scientists in Training

Perspective Interview: Sofia Perez

Quantitative Data Analysis

Descriptive Statistics

Course Overview.

Quantitative vs Qualitative Research

Presentation transcript:

School of something FACULTY OF OTHER School of Computing FACULTY OF ENGINEERING Data Collection and Evaluation Undergraduate Final Year Projects Lydia Lau (Project Co-ordinator) 6 March 2014

Why do you want to collect data? Gather user requirements for a software product Evaluate a software product Find out people’s opinion Analyse particular situation OTHERS???

Example A For studying current system and compared with the improve system A combination of data collection techniques both qualitatively and quantitatively. Note the structure used in reporting a user study /experiment

Data gathering techniques (Rogers, Sharp and Preece, 2011)

Example B Data collected just run time? but in different settings for comparison. Evaluation clear about what are being evaluated and the criteria used

Successful data collection & evaluation What is the target group / source of data Are they a representative sample How have you selected them How you will reach /access them What is the expected response rate /ease of access? How can you ensure that you get responses / access? Do you have an alternative if you do not get responses? Your time on this project is limited and precious!

Successful data collection & evaluation (cont.) How are you going to analyse the raw data (quantitative v qualitative) Coding, content analysis Summative statistics Comparisons Charts Excel vs Powerful Statistical Packages How will you report the findings Aim and objectives Experimental design (participants, method, tasks, materials) Results and analysis part What to be included in the main body of the report and what should be presented in appendices

Examples C & D Use of both quantitative and qualitative instruments to collect data Note the presentation of results

References Colin Robson, Real World Research: A Resource for Social Scientists and Practitioner Researchers, 2 nd Ed., Blackwell, Oxford, Part III for methods of data collecion Chapters 13/14 for data analysis Preece, Rogers and Sharp. Interaction Design: Beyond Human-Computer Interaction, John Wiley and Sons, 3 rd Edition, 2011 Chapters 7/8