1. Social Network Analysis for Evaluation: Open and Closed Approaches Carl Hanssen November 6, 2008 American Evaluation Association The Milwaukee Mathematics Partnership (MMP) is supported with funding from the National Science Foundation.

2. www.hanssenconsulting.com2 Agenda Context Open & Closed Approaches Strengths & Limitations

3. www.hanssenconsulting.com3 Context Milwaukee Math Partnership Comprehensive Work in multiple schools Goal: Distributed Leadership Life Sciences for a Global Community Institute partnership Work with 3 cohorts of 30 teachers Goal: Teacher leader network

4. www.hanssenconsulting.com4 Open Approach Respondent pool defined by the organization Clean slate Interested in network members inside and outside the organization Interested in specific individual roles

5. www.hanssenconsulting.com5 Low Student Achievement: 2007: 66% Proficient 3-year trend: -9%

6. www.hanssenconsulting.com6 High Student Achievement: 2007: 53% Proficient 3-year trend: +3%

7. www.hanssenconsulting.com7 Closed Respondents defined by cohort Fixed slate Interested in collaboration within network Similar expectations for all members

8. www.hanssenconsulting.com8 Cohort 1

9. www.hanssenconsulting.com9 District A Red diamond—institute participant Green box – science teacher Green square – other teacher (English, math, etc.)

10. www.hanssenconsulting.com10 Strengths Open Flexible Reduces bias Focus on roles Track evolution over time Informs action Closed Clean data collection All participants are equal Track evolution over time Informs action

11. www.hanssenconsulting.com11 Limitations Open Messy data Non-responses Closed Limited scope Requires clean subject lists Non-responses

12. www.hanssenconsulting.com12 Contact Information Carl Hanssen, Ph.D. Hanssen Consulting, LLC 1324 Lake Dr. SE, Suite 6 Grand Rapids, MI 49506 carlh@hanssenconsulting.com 616-808-2867