1. Evaluating Communities of Practice in Child and Youth Mental Health

2. Introductions 1.Ask yourselves… What CoPs do I participate in? For today, what would I like to learn more about related to CoPs? 2.Share your reflections with others at your table.

3. In this workshop, we ask… Why evaluate the work of communities of practice (CoPs)? How might we evaluate the work of CoPs?

4. A brief review… Subject (Domain) –A shared area of interest that provides a common focus –Shared competence in this area People (Community) –A group of people who interact in an ongoing way –Emphasis on relationships as the route to collective learning Action (Practice) –Practitioners who develop a set of shared resources (experiences, stories, tools for solving problems) –Emphasis on sustained interaction over time

5. An Example: Triple P CoP Subject –Evaluation of Triple P programs in Ontario People –Service providers in charge of evaluating Triple P programs Action –An online portal for developing the evaluation framework; e-discussions and teleconferences; working towards common measures

6. Goals of a CoP Problem solving Growth and evolution of members Sharing information and experiences Reusing and recycling resources Evaluating information and developments Identifying gaps in knowledge

7. CoP Collaboration Collaborations Often time-limited Goal: Concrete tasks determined by the group Communities of Practice Longer-term, ongoing Goals: Produce or manage knowledge Change practice

8. A Community of Practice Inventory COMMUNITY OF PRACTICE INVENTORY FORM ORGANIZATION: __________________________ DEPARTMENT OR UNIT: ____________________ DATE: ____________________________________ NameCoP NamePurposeLength of time CoP has existed Formally recognized? Frequency and type of meetings 1. 2. 3. 4. Continued…

9. In small groups… Identify one community of practice you are involved in and ask yourselves: –What is the subject or domain? –Who is involved? –What are the CoPs activities? –What are the CoPs goals?

10. Why evaluate? Time Resources Validity and reliability Action A model for others

11. What do we want to know? Impact/Outcome What changes are produced by the CoP Process How the CoP works

12. Measuring Processes and Outcomes System Individual Practice Organization Profession Work of CoP (Process) Impact on Client/ Family (Outcomes) Sylvestre & Bendell, 2008

13. In small groups… Thinking about your community of practice, what goal do you want to evaluate? –How would you measure this goal? –How do you know you have achieved this goal? –Do you have any timelines for achieving this goal?

14. How might we measure processes? How is the group developing? –Assemble and Form –Storm and Order –Norm and Perform –Transform and Adjourn

15. How is the group working together? Networking, Cooperating, Partnering, Merging, Unifying (Rebecca Gajda, 2004) Awareness, Communication, Coordination, Collaboration (Gina Browne, 2004)

16. In small groups… Describe the processes in your community of practice… How it is developing (form, storm, perform, norm) How it is working (networking, communicating, coordinating, collaborating) What changes might be taking place at system, organizational, profession, and individual practice levels?

17. But what about outcomes?

18. In small groups… Describe the outcomes your community of practice might produce at different levels… –System –Organization –Profession –Individual practice How might you measure these?

19. Who do you need to talk to? What decisions need to be made? What actions need to be taken? How will the actions be evaluated? What will we do with what we know?

20. What did you find… Surprising? Important? Confusing? Applicable to the work you do?

21. FOR MORE INFORMATION Purnima Sundar, PhD Research and Knowledge Exchange Consultant psundar@cheo.on.ca 613-737-7600, ext. 3485 Evangeline Danseco, PhD Head, Evaluation and Research edanseco@cheo.on.ca 613-737-7600, ext. 3319 www.onthepoint.ca or alafinepointe.ca