Learning Target Participants will have a first step in mind toward creating a meaningful evaluation of their collaborative work. Or… Participants will have an action in mind about how to improve their evaluation of their collaborative work.

In evaluating collaboration, you can measure: the presence or absence of the core components of collaboration the amount (level) of collaboration occurring between different partners the extent to which collaborative activities are taking place specific to the content of your initiative who is sending and who is receiving information (& who is making contact and who is receiving that contact, i.e., Social Network Analysis)

What can you measure? if you are meeting the targets (short-term outcomes) set by your collaboration whether you are reaching your mutually agreed upon desired outcomes if the partners are spending their money in the way that was planned if the partners are engaged in the agreed upon activities.

How do you routinize the collection of these data? Making this all part of your contracting procedures. Other ideas???

A Model of Collaboration Thomson, Perry, & Miller (2007) Governance Administration Mutuality Norms (trust)

Governance Administration Jointly make decisions about rules that will govern behavior & relationships Working rules about who can make decisions about collective problems, cost & benefit distribution, and how information is disseminated Administration Some kind of administrative structure must exist that moves the group from governance to action About implementation and management; requires clarity of roles and responsibilities Communication channels that enhance coordination Mechanisms to monitor activities

Mutuality Interdependence: organizations that collaborate must experience mutually beneficial interdependencies based either on shared or complimentary interests Norms Can also be seen as a form of trust which is a common belief among a group of individuals that another group will: (1) make good-faith efforts to behave in accordance with any commitments both explicit and implicit, (2) be honest in whatever negotiations preceded such commitments, and (3) not take excessive advantage of another even when the opportunity is available

Why might it be important to understand the core components of collaboration?

Levels of Collaboration (Frey, Lohmeier, Lee & Tollefson, 2006) Collaboration Independent agencies function as one entity or system. Frequent communication with mutual trust. Consensus reached on all decisions. Share ideas and resources frequently. Frequent and prioritized communication. All members have vote in decision-making. Coalition Sharing information and resources on a regular basis, defined roles, frequent communication and some shared decision-making. Coordination Cooperation Providing information to each other, somewhat defined roles, independent decision-making and formal communication. Networking Characterized by awareness of an organization and low levels of communication for referral purposes.

Levels of Collaboration Why might it be important to know the level of collaboration?

Whatever your model(s) You will need to know what to track and measure It’s about the agreed upon goals and also how you agree to get there. (Process & Outcomes)

Steps to Evaluating Collaboration Logic Model Evaluation Plan

Fully detailed logic model INPUTS OUTPUTS OUTCOMES Program Investments Intermediate Activities Participation Short Term Long Term Project Objectives Process Measures Outcome Measures

Conceptualizing and Measuring Collaboration in the Context of Early Childhood Care and Education November 27, 2013 http://www.acf.hhs.gov/programs/opre/resource/conceptualizing-and-measuring-collaboration-in-the-context-of-early Office of Planning, Research, and Evaluation (OPRE) in the Administration of Children and Families (ACF) in HHS

Resources Measuring Collaboration http://www.signetwork.org/content_pages/189-collaboration-and-partnering Missouri's Instrument to Measure Collaboration: Measuring Collaboration at State, Regional, and Local Levels   PPT | SESSION RECORDING    April 24, 2013. Pam Williams, Missouri SPDG Director, Drs. Pattie Noonan and Amy Gaumer Erickson, Missouri SPDG Evaluators.  RESOURCES:   DESE Survey Levels of Collaboration Scale MITT Observation Tool 2013 RPDC Survey Willow Springs Elem Staff Survey Summary

Thank you Pam Williams, Amy Gaumer-Erickson, Patti Noonan Pat Mueller