Ways to make data more meaningful Maresa Ness & Barry Tolchard Chief Executive Associate Professor Mosaic Clubhouse London South Bank University

Mosaic Clubhouse An opportunity centre for people living with mental health conditions

Explanation of data Aspirations for the future The bars on the bar charts represent everyone who completed the questionnaire at each time point The statistics only compares paired samples That is the same person over all time points Therefore sometimes the bars may not look different But changes are significant as we are only comparing paired data The first chart shows all people who completed at each time point. The second char shows only those who completed all time points.

Changes in wellbeing Short Warwick-Edinburgh wellbeing scale (SWEMWS)

Changes in Wellbeing Interpretation Paired samples Comparing the sample as a whole we find a significance between the first and last completion of the measure This is less accurate, but likely does represent real change There was no significant improvement in Wellbeing between T1-T2 (p = .11) and T1-T3 (p = .70) Wellbeing may change slowly over time and so a different way of measuring this may be used

Wellbeing more importantly SWEMWS Converted to a continuous measure Compared against national data using a simple tool Add in your mean scores and it compares you against everyone else Measures identify people in five percentiles Lowest 20%; 20-40&, 40-60%, 60-80%, highest 20% Mosaic Clubhouse members T2 T1

Changes in self-esteem Rosenberg Self-Esteem Scale *** * *** p < .001 * p < .05

Changes in self-esteem Interpretation Paired samples   Paired Differences t df p M SD SE-M 95% CI of the Difference Lower Upper Pair 1 T1 – T2 -1.25 3.19 .33 -1.90 -.60 -3.84 95 .000 Pair 2 T1 – T3 -1.75 3.34 .68 -3.16 -.34 -2.57 23 .017 There was a significant improvement in Self-esteem between T1-T2 (p < .001) and T1-T3 (p < .05) Numbers were too small to ascertain a significance between T1-T4

Changes in Aspirations for the future Mosaic Aspirations Scale ** * ** p < .001 * p < .05

Changes in Aspirations for the Future Interpretation Paired samples There was a significant improvement in aspirations between T1-T2 (p < .01) and T1-T3 (p < .05) The bar chart previously does not show the paired samples Therefore even though it looks like there was no change In fact when comparing the same person using the paired statistic, there was a significance This is shown in the analysis of the first and last measures, which was highly significant   Paired Differences t df p M SD SE-M 95% CI of the Difference Lower Upper Pair 1 First - Last -.30 2.60 .06 -.41 -.19 -5.41 2200 .000 Pair 2 T1 – T2 .69 2.32 .24 .22 1.16 2.90 95 .005 Pair 3 T12 – T3 -.25 .44 .09 -.44 -.06 -2.77 23 .011

Changes in Personal Development Mosaic Personal Development Scale

Changes in Aspirations for the Future Interpretation Paired samples   Paired Differences t df p Mean Std. Deviation Std. Error Mean 95% CI of the Difference Lower Upper Pair 1 First - Last -.56 6.66 .14 -.83 -.28 -3.97 2219 .000 Pair 2 T1 – T2 .63 10.10 1.03 -1.42 2.67 .61 95 .55 Pair 3 T1 – T3 -7.00 15.42 3.64 -14.67 .67 -1.93 17 .07 There was no significant improvement in personal development between T1-T2 (p = .55) and T1-T3 (p = .07) However, the analysis of the first and last measures was highly significant

Changes in Social Provision Interpretation The Social Provision measure is broken down into four sub-scales. Therefore there is only a first – last analysis of the Social Provision total score This showed a highly significant change

Changes in Social Provision Subscales On all four sub-scales there were significant improvements at various time points

Recap The tool overall was very reliable and the five scales within the tool were equally reliable when considered alone This tool demonstrates change over time and support the model of change introduced by Mosaic. However, more is required to tease out where the change occurs and under what conditions e.g., those attending a particular unit, certain demographic characteristics and so on There were significant improvements over time on all five parts of the Mosaic questionnaire Some of these were evident from T1 to T2 while others only showed at T3 Where some measures e.g., Aspirations initially appeared to be non significant, using the less robust first-last measures did show significance

Benefits & Challenges Culture change Data base changes Training Language Anxiety Excitement Testimonials Telling a whole story

Next Steps Feed-back loop Collecting more data Publications Working on our own measures

Thank you www.mosaic-clubhouse.org