May 2015

 “Is there a statistically significant difference in NSEs’ perception of personal qualities of NNSE who have a strong L1 influence in their English depending on the NSEs’ amount of interaction with NNSE?” [Note: NSE = Native speaker of English; NNSE = Non-native speaker of English; L1 = first language]

Hmmmm….(I use purple when I’m thinking aloud) 1) I have perception ratings collected from participants who have had a low, medium, or high amount of interaction with NNSEs. 2) The confidence ratings are collected using an instrument that yields ordinal- scale data. 3) Each participant falls into only one ‘amount of interaction’ group so there are different people in each of the comparison groups. 4) I want to know if there’s a statistically significant difference in the perception of the three groups defined by amount of interaction with NNSE. Seems like the appropriate statistic for the Kruskal-Wallis statistic.

 Null hypothesis: There is no statistically significant difference in NSEs’ perception of NNSEs’ amount of education depending on the NSEs’ amount of interaction with NNSE.  Alternative hypothesis: There is a statistically significant difference in NSEs’ perception of NNSE amount of education depending on the NSEs’ amount of interaction with NNSE. NOTE: Kruskal-Wallis supports only a two-tailed alternative hypothesis. If the null hypothesis is rejected, pairwise post hoc analyses of the 3 groups defined by the independent variable can be done using Wilcoxon Rank Sums Test (comparing Groups 1 and 2, Groups 1 and 3, and Groups 2 and 3).

 What would you like to establish as the level of probability for interpreting the findings of this study?

Kruskal Wallis because: ◦ Non-parametric analysis should be used because the data were collected using a tool that yields rankable data ◦ Independent variable has more than 2 levels ◦ There are different people in each of the levels of the independent variable ◦ The researcher wants to know whether there is a difference among the groups.

 Rebecca collected the data. All we have to do is import the dataset.  Download the dataset from the Companion Website ( /s1/datasets/) and save it on your computer as a comma separated values (csv) Excel document /s1/datasets/  This R command gives you access to your computer documents. >becca.data = read.csv(file.choose(), header=T)

The assumptions for using Kruskal-Wallis are:  the independent variable has three or more levels  the researcher wants to determine whether there is a difference among the groups defined by the independent variable.  the groups defined by the levels of the independent variable are comprised of different participants  the dependent variable yields rankable data

 kruskal.test (educate ~ interact, data =becca.data) Note: this commands work too kruskal.test(becca.data$educate~becca.data$interact)

Kruskal-Wallis rank sum test data: educate by interact Kruskal-Wallis chi-squared = , df = 2, p-value = 4.485e-06 Note: 4.485e-06 means (That is, move the decimal point 6 places to the left.)

The exact level of probability for the observed statistic is p-value =  when exact level of p > alpha accept null hypothesis  when exact level of p < alpha reject null hypothesis & accept alternative hypothesis

 I can be 95% there is a statistically significant difference in NSEs’ perception of NNSE amount of education depending on the NSEs’ amount of interaction with NNSE.

Statistical logic led us to accept the null hypothesis. I can be 95% there is a statistically significant difference in NSEs’ perception of NNSE amount of education depending on the NSEs’ amount of interaction with NNSE (Kruskal-Wallis chi-squared = , df = 2, p-value = ).

 Calculate each of the 3 pair-wise comparisons using the Wilcoxon Rank Sum statistic (flipping the order of the two levels to determined which Wilcoxon to report): ◦ Low interaction group to high interaction group ◦ Low interaction group to mid interaction group ◦ Mid interaction group to high interaction group  With R, we can extract the z-score using R and calculate effect size for each comparison (since the n-size is sufficiently large for conversion of the Wilcoxon outcomes to z scores).

 low =subset (becca.data, becca.data$interact=="1")  mid =subset (becca.data, becca.data$interact=="2")  high =subset (becca.data, becca.data$interact=="3")

 wilcox.test(low$educate,mid$educate, exact = F) W = 370*, p-value = (Then flip the two groups to determine which value of W to report )  wilcox.test(mid$educate,low$educate, exact = F) W = 591, p-value = *Report W for comparison of low to mid as W = 370.

 wilcox.test(low$educate,high$educate, exact = F) W = 164*, p-value = 4.179e-06 [ ] (Then flip the two groups to determine which value of W to report )  wilcox.test(high$educate,low$educate, exact = F) W = 797, p-value = 4.179e-06 [ ] *Report W for comparison of low to high as W = 164

 wilcox.test(mid$educate,high$educate, exact = F) W = 237*, p-value = (Then flip the two groups to determine which value of W to report )  wilcox.test(high$educate,mid$educate, exact = F) W = 724, p-value = *Report W for comparison of mid to high as W = 237

 study.model= wilcox.test(low$educate,mid$educate, exact = F)  z=qnorm(study.model$p.value/2)  effect.size = abs(z)/sqrt(62)  effect size =

 study.model =wilcox.test(low$educate,high$educate, exact = F)  z = qnorm(study.model$p.value/2)  effect.size = abs(z)/sqrt(62)  effect size =

 study.model = wilcox.test(mid$educate,high$educate, exact = F)  z=qnorm(study.model$p.value/2)  effect.size = abs(z)/(62)  effect size =

The research shows a significant difference in NSEs’ perception of NNSE amount of education depending on the NSEs’ amount of interaction with NNSE (Kruskal-Wallis chi-squared = , df = 2, p-value = ). The Wilcoxon Rank Sum statistic was used to determine that the comparison of the low and high interaction group (W = 164, p = ) and the mid and high interaction group (W = 237*, p-value = ) are statistically significant. The effect sizes for these comparisons (.58 and.44, respectively) indicate that the differences are moderate to very strong. While the difference between the low and mid interaction group (W =370, p. = ) does not show a significant difference, the effect size is moderate (.21).