Does All this work?

Gains Knowledge Builds Relationships Changes Attitudes Provide Research Attracts the Policy Community to Dialogue in a Nonpartisan Educational Setting Gains Knowledge Builds Relationships Changes Attitudes Engage Policymakers and Experts to Identify Family Issues Policymakers Use Research in Their Jobs Early Outcomes Long-Term Outcome Intermediate Outcomes

of policies and programs With researchers With colleagues Policymakers Policymakers Use Research in Their Jobs On research On family impact of policies and programs Gains Knowledge With researchers With colleagues Builds Relationships Policymakers Policy administrators Legislative aides Legislative service agency personnel Governor's staff Attracts the Policy Community to Dialogue in a Nonpartisan Educational Setting Provide Research on Family Issues Relevant Useful Objective Pragmatic Innovative Economically feasible Politically feasible Problems recognized Policy solutions evidence-based Politics favorable Engage Policymakers and Experts to Identify Family Issues Evaluate Incorporate into Identify Draft Develop Enact laws legislation speeches references legislation policy that support positions families Early Outcomes Intermediate Outcomes Long-Term Outcome Changes Attitudes On the value of research On a family perspective in policymaking

Early Outcomes: Attendance % Legislative Staff 19 38.0 University Students 1 2.0 University Faculty 2 4.0 Nonprofit Agency Reps 8 16.0 Legislators 10 20.0 Other Executive Branch Rep Direct Service Providers 7 14.0 Total 50 100

Early Outcomes: Survey Completers Attendance # Completing Survey Percent of Attending who Completed Survey Legislative Staff 19 0.0 University Students 1 University Faculty 2 Nonprofit Agency Reps 8 25.0 Legislators 10 Direct Service Providers 7 4 57.1 Executive Branch Other Unknown -- Total 50 16.0

Our evidence: Early Outcomes Mean SD Overall impression 4.50 .54 Relevance to needs and interests 4.57 Usefulness to current role 4.29 .76 Educational value 4.71 .49 Objectivity 4.43 Policy options are practical 4.00 .63 Policy options are politically feasible .71 Policy options are economically feasible Policy options are innovative How useful was the discussion overall .55 How useful was the discussion in getting questions answered .89 How useful was the discussion in considering policy options 4.33 .52 How useful was the discussion in helping you get a handle on complex issues How useful was the discussion in identifying others who are interested in this issue

Early Outcomes: What They Liked Best Collaboration Dr. Gushwa Information about day to day struggles of child care workers Morning remarks; speakers with foster care experience Variety of views of issues in child welfare practice Family’s youth centered planning Legislators with foster care experience Pieces of all presentations Policy reform and need for training

Early Outcomes: Where We Can Improve Not long enough; small discussion groups would be helpful Rushed

Our evidence: Intermediate Outcomes After Before Mean SD t p Knowledge of the characteristics of child welfare workers who experience the maltreatment death of a child. 3.43 .54 2.86 .69 2.83 .03 Knowledge of child welfare workers' knowledge of risk factors for child maltreatment death. 3.29 .76 2.71 1.92 .10 Knowledge of the day to day experiences of child welfare workers in teh context of organizational culture and climate. 3.14 .90 0.31 .77 Knowledge of alternative ways to promote policy changes and practice reform. 2.43 .79 1.70 .14 Knowledge of collaboration and consistent communication among multiple stakeholders for transformation at every level of the system. 2.57 1.27 1.08 .32 Knowledge of using a comprehensive functional assessment for data-informed systemic quality improvements. 3.00 .58 1.19 .28

Our evidence: Long-term outcomes? Ways that research will be used f % To share information with colleagues 6 75.0 To identify contacts for further information 5 62.5 To identify references for further reading 0.0 To influence policymakers at state level 3 37.5 To evaluate pending legislation 2 25.0 To influence policymakers at local level To respond to constituent concerns To incorporate into speeches or presentations 1 12.5 To inform agency personnel 4 50.0 To initiate planning in organization To prepare grants To do nothing To frame budget proposals