Animated banners - H1 Sigurbjörn Óskarsson. Research design Repeated measures N=32 (- 1 outlier) Task testing Control category + 3 levels of experimental.

Slides:



Advertisements
Similar presentations
Chapter 9: Simple Regression Continued
Advertisements

Inference for Regression
5/15/2015Slide 1 SOLVING THE PROBLEM The one sample t-test compares two values for the population mean of a single variable. The two-sample test of a population.
Using Statistics in Research Psych 231: Research Methods in Psychology.
C82MST Statistical Methods 2 - Lecture 7 1 Overview of Lecture Advantages and disadvantages of within subjects designs One-way within subjects ANOVA Two-way.
Using Statistics in Research Psych 231: Research Methods in Psychology.
Data Analysis Express: Data Analysis Express: Practical Application using SPSS.
The Experimental Approach September 15, 2009Introduction to Cognitive Science Lecture 3: The Experimental Approach.
Independent Sample T-test Often used with experimental designs N subjects are randomly assigned to two groups (Control * Treatment). After treatment, the.
Independent Sample T-test Classical design used in psychology/medicine N subjects are randomly assigned to two groups (Control * Treatment). After treatment,
Using Statistics in Research Psych 231: Research Methods in Psychology.
Analysis of Variance with Repeated Measures. Repeated Measurements: Within Subjects Factors Repeated measurements on a subject are called within subjects.
Two-Way Analysis of Variance STAT E-150 Statistical Methods.
Psy B07 Chapter 1Slide 1 ANALYSIS OF VARIANCE. Psy B07 Chapter 1Slide 2 t-test refresher  In chapter 7 we talked about analyses that could be conducted.
Chapter 9 Two-Sample Tests Part II: Introduction to Hypothesis Testing Renee R. Ha, Ph.D. James C. Ha, Ph.D Integrative Statistics for the Social & Behavioral.
Selecting the Correct Statistical Test
Chapter 13: Inference in Regression
Repeated Measures ANOVA
Lab 2: repeated measures ANOVA 1. Inferior parietal involvement in long term memory There is a hypothesis that different brain regions are recruited during.
Class Meeting #11 Data Analysis. Types of Statistics Descriptive Statistics used to describe things, frequently groups of people.  Central Tendency 
The paired sample experiment The paired t test. Frequently one is interested in comparing the effects of two treatments (drugs, etc…) on a response variable.
Statistics for Education Research Lecture 8 Tests on Three or More Means with Repeated Measures: One-Way ANOVA with Repeated Measures Instructor: Dr. Tung-hsien.
Statistics (cont.) Psych 231: Research Methods in Psychology.
1 Testing Statistical Hypothesis Independent Sample t-Test Heibatollah Baghi, and Mastee Badii.
Statistics (cont.) Psych 231: Research Methods in Psychology.
1 Analysis of Variance ANOVA COMM Fall, 2008 Nan Yu.
6/4/2016Slide 1 The one sample t-test compares two values for the population mean of a single variable. The two-sample t-test of population means (aka.
MGT-491 QUANTITATIVE ANALYSIS AND RESEARCH FOR MANAGEMENT OSMAN BIN SAIF Session 26.
Introduction to Inferential Statistics Statistical analyses are initially divided into: Descriptive Statistics or Inferential Statistics. Descriptive Statistics.
Analysis of Variance 1 Dr. Mohammed Alahmed Ph.D. in BioStatistics (011)
Social Science Research Design and Statistics, 2/e Alfred P. Rovai, Jason D. Baker, and Michael K. Ponton Within Subjects Analysis of Variance PowerPoint.
Educational Research Chapter 13 Inferential Statistics Gay, Mills, and Airasian 10 th Edition.
Single Factor or One-Way ANOVA Comparing the Means of 3 or More Groups Chapter 10.
Experimental Psychology PSY 433 Appendix B Statistics.
SW318 Social Work Statistics Slide 1 One-way Analysis of Variance  1. Satisfy level of measurement requirements  Dependent variable is interval (ordinal)
Supplementary PPT File for More detail explanation on SPSS Anova Results PY Cheng Nov., 2015.
Slide 1 Mixed ANOVA (GLM 5) Chapter 15. Slide 2 Mixed ANOVA Mixed: – 1 or more Independent variable uses the same participants – 1 or more Independent.
Stats Lunch: Day 8 Repeated-Measures ANOVA and Analyzing Trends (It’s Hot)
ONE-WAY BETWEEN-GROUPS ANOVA Psyc 301-SPSS Spring 2014.
Inferential Statistics. Explore relationships between variables Test hypotheses –Research hypothesis: a statement of the relationship between variables.
Descriptive and Inferential Statistics Or How I Learned to Stop Worrying and Love My IA.
Analysis of Variance STAT E-150 Statistical Methods.
Statistics (cont.) Psych 231: Research Methods in Psychology.
Chapter 13 Understanding research results: statistical inference.
HYPOTHESIS TESTING FOR DIFFERENCES BETWEEN MEANS AND BETWEEN PROPORTIONS.
Statistics (cont.) Psych 231: Research Methods in Psychology.
Educational Research Inferential Statistics Chapter th Chapter 12- 8th Gay and Airasian.
Inferential Statistics Psych 231: Research Methods in Psychology.
Choosing and using your statistic. Steps of hypothesis testing 1. Establish the null hypothesis, H 0. 2.Establish the alternate hypothesis: H 1. 3.Decide.
Chapter 11: Test for Comparing Group Means: Part I.
Data Screening. What is it? Data screening is very important to make sure you’ve met all your assumptions, outliers, and error problems. Each type of.
Inferential Statistics Psych 231: Research Methods in Psychology.
Don't Sweat the Simple Stuff (But it's not all Simple Stuff)
Dependent-Samples t-Test
Psych 231: Research Methods in Psychology
Regression Analysis: Statistical Inference
Non-Parametric Tests 12/1.
Non-Parametric Tests 12/1.
Non-Parametric Tests 12/6.
Non-Parametric Tests.
Issues in Inferential Statistics
Section 12.2: Tests about a Population Proportion
Psych 231: Research Methods in Psychology
CS 594: Empirical Methods in HCC Experimental Research in HCI (Part 2)
Psych 231: Research Methods in Psychology
Psych 231: Research Methods in Psychology
Psych 231: Research Methods in Psychology
Inferential Statistics
Psych 231: Research Methods in Psychology
Psych 231: Research Methods in Psychology
Presentation transcript:

Animated banners - H1 Sigurbjörn Óskarsson

Research design Repeated measures N=32 (- 1 outlier) Task testing Control category + 3 levels of experimental manipulation 4 hypothesis on: Task completion times (H1); recall & recognition (H2); gender differences (H3 + H4)

Hypothesis 1 H1 - Animated banners will have a negative effect on user's task completion times. H0 - Animated banners will not have a negative effect on user's task completion times.

Previous research Burke et al "High Cost Banner Blindness" Owens et al "Text Advertising Blindness: the New Banner Blindness" - Both deal with how banners affect visual search on sites - Both measure performance metrics (like time on task) - Burke found that sometimes banners seem to affect performance, sometimes not. There seems to be a contradiction... - Owens found that the effect the advertisements had was connected both to their nature, the context on the site and ow people searched (nature of tasks).

Variables Independent - Banner ads made in flash and photoshop Our four conditions: 1.No banners (control) 2.Static banners 3.Animated banners 4.Crazy animated banners Dependent - Task completion times measured in seconds Other dependent variables measured and used for other hypothesis were recall and recognition rates.

Data collection Usability tests All 4 versions tested - 3 experimental and control Randomized order - to counterbalance for leaning effects TIme on task noted - by certain criteria Data entered to SPSS for analysis

Statistics chosen One way repeated measures ANOVA One way: One predictor (independent) variable Repeated measures: Within subjects design - Data for each condition comes from the same people ANOVA: 4 groups (predictors) of the independent var. Since we have more than 2 groups, we must use ANOVA but not a t-test

Statistics Assumptions of RM ANOVA Normality: Central limit theorem - distribution in samples above 30 will be normally distributed Sphericity: Mauchlys test Interval data: Time data measured in seconds was continuous Homogeneity of variance Independence - Don't apply since it is a repeated measures design...

Results Assumptions Sphericity - Mauchly's test indicated that the assumption of sphericity had been met; x 2 (5) = 9.26, p >.05 - Uses a Chi square test to test for sphericity - Allowed us to continue without any corrections to sphericity - All of the other assumptions were met as noted above...

Results ANOVA The ANOVA revealed that the negative effect of banner ads on task completion time was not significant, F (3,90) =.21, p >.05 -Simple contrasts were conducted to compare the experimental categories to the control category. None were significant. - Standard contrats in SPSS - Contrasts not really necessary though since the ANOVA was not significant...

Conclusion Mean task completion times were not significantly different in the four groups. Therefore H1 must be rejected. - There was some difference between the means of our groups but apparently it was not statistically significant. - The means for the control category and the static banners was about the same but the mean for the crazy banners was the highest. - Other hypothesis found differences e.g. between gender and in how well people notice banners of different animation levels.

Discussion Why do we still see so many animated ads? - IT should be alarming to companies how much users ignore their ads Further research could explore the effect on performance by: Placement of banners context of banners nature of banners - Text ads and "hidden" ads that look like normal content are already being used.