An instrument to evaluate whether health promotion interventions apply health promotion principles in their work Sara Torres, Université de Montréal Nicole Beaudet, DSPM Eric Litvak, DSPM François Chiocchio, Université d’Ottawa Julie Des Lauriers, DSPM Anne Guichard, Université Laval Lucie Richard IRSPUM, Université de Montréal CPHA Conference, Toronto Wednesday May 28, 2014

Objectives of presentation Present the evaluation research tool used to assess whether health promotion interventions apply health promotion principles in their work Present findings from the application of the tool in the context of a professional development program in health promotion

Background Health Promotion Laboratory (HPL) Implemented by the Montreal Public Health Department since 2010 The HPL supports multi ‐ disciplinary local public health teams in conceptualizing, developing, and implementing health promotion interventions HPL evaluation has been funded by CIHR- PHSI 3

ALPS Project The HPL provides a medium for team members to learn, reflect, and develop a health promotion intervention One of the evaluation components is to examine the health promotion interventions generated by the HPL 4

Two Cases Examined Team ATeam C Team composition  Nine professionals  Health & safety division  Eight professionals  Children & families services’ division Sector  Public institution & monitors a private sector business  Public sector Problematic  Environmental risks in factories  Lack of access to childcare  New immigrant families, children 0-5 years old  Isolation & poverty Targeted Issue  Workers’ Health & safety  Factors of protection for children Intervention  Counselling program  Potential business owners (opening a new enterprise or re-locating to the territory)  Four small projects (daycare access, breastfeeding, social support & neighbourhood safety) 5

Intervention Evaluation Methods Data collection strategies Document review, in ‐ depth interviews, and focus groups with health professionals involved in the program Adaptation of Guichard and Ridde’s 2009 tool: “Une grille d’analyse des actions pour lutter contre les inégalités sociales de santé” (grid to analyze actions to fight against social inequities in health) 6

Adaptation/application of tool Revising the language Discussing/research team/testing Validating the adaptation of the tool with one of the authors Developing a five element scale Applying the tool to two health promotion interventions 7

8 StagesDescription of Rubrics a) Analysis of the problematic and planning the intervention  Sources of information  Social & behavioral determinants of health, sub-groups  Involvement of partners, experts & target groups  Influence of the literature  Objectives (social determinants of health, levels of action, reduction of social inequities in health, analysis of the problematic) b) Implementation  Incentives & work methods  Definition of tasks, responsibilities, coordinators/directors  Leadership sharing  Adaptation and accessibility/target groups c) Evaluation  Evaluation plan (planning & beyond the pilot stage)  Participation of different actors in all stages  Possible negative effects/different sub-groups & long-term d) Sustainability  Activities/planning stages & going beyond the pilot stage  Human and financial resources dedicated to the intervention  Organizational risks (staff, logistics) e) Empowerment  Participants’ self-esteem, reinforce technical capacity  Critical consciousness/partners/target groups Evaluation Grid

9 StagesRubricsRankingPrinciples a) Analysis of the problematic and planning the intervention  Social determinants  Target groups  Involvement of actors  Influence of literature  Objectives  Low=  Medium =  Good & Excellent =  Non-Applicable = N/A  Equity  Holism  Participation  Intersectorality  Multiple settings & strategies  Empowerment  Intersectorality  Sustainability (Source: Rootman et al., 2001) b) Implementation  Incentives  Tasks & responsibilities  Leadership c) Evaluation  Planning  Beyond pilot stage  Negative effects d) Sustainability  Beyond pilot stage  HR and financial e) Empowerment  Self-esteem  Critical consciousness Coding and Data Analysis

Results Team C 1 of 2 10 StagesRubricsRankingPrinciple a) Analysis of the problematic and planning the intervention  Social & behavioral determinants of health, sub-groups  Involvement of partners, experts, target groups  Levels of action  Objectives/ analysis of the problematic)  Reduction of social inequities in health Equity Holism Participation b) Implementation  Incentives and work methods/ partners  Definition of tasks, responsibilities, coordinators/directors  Leadership sharing  Adaptation and accessibility to target groups Participation Intersectorality Multiple settings & strategies

Results Team C 2 of 2 11 StageRubricsRankingPrinciple c) Evaluation  Evaluation plan (planning, beyond the pilot stage)  Participation of different actors in all stages  Negative effects/different sub-groups, long-term N/AParticipation Equity Intersectorality d) Sustainability  Activities/planning stages/beyond the pilot stage  Human and financial resources  Organizational risks (staff, logistics) Equity Multiple settings &strategies e) Empowerment  Participants’ self-esteem, technical capacity  Critical consciousness/partners/target groups Equity Participation

Discussion 12 The tool facilitates… The advancement of knowledge and methods in health promotion The development of health promotion interventions that are multidimensional To be more effective… The tool should be used by evaluators and practitioners prior to starting the health promotion intervention

Conclusion This evaluation research tool gives health professionals and organizations a medium to examine how professional development programs and the resulting interventions can incorporate a health promotion approach 13

Pour plus d’information: For more information: Sara Torres: (Postdoctoral Fellow) Lucie Richard : (ALPS Principal Investigator) Nicole Beaudet : (HPL Project Manager)