Monitoring and Evaluation West Virginia’s Review of Funded Projects, Services and Activities

Focus on the “3 R’s” Recovery –refers to a process in which people are able to live, work, learn, and participate fully in their communities. For some individuals, recovery is the ability to live a fulfilling and productive life despite a disability. For others, recovery implies the reduction or complete remission of symptoms. There is substantial scientific and anecdotal evidence that hope is necessary for an individual’s recovery. Resilience –means the personal and community qualities that enable people to rebound from adversity, trauma, tragedy, threats, or other stresses – and to go through life with a sense of mastery, competence, and hope. Research and first-person accounts show that resilience is fostered by a positive childhood and close-knit communities which provide support for their members Reimbursement –refers to a process of purchasing those mental health services for children and adults which foster recovery and resilience. If science and experience demonstrate the value of these approaches, it would seem necessary to support (reimburse) only those services which facilitate recovery and resilience

Review Process Recipients of funds for projects, services, and activities (PSA) are provided a copy of the review criteria Written responses are forwarded to the Planning Council A team of up to five reviewers, composed of all representatives of all stakeholders, read the responses and agree on comments and questions Intent is for Peer Consultative Review Process

Review Process Representatives of the PSA meet with the review team –The PSA is discussed –The review team’s comments are discussed Some modification may occur, based on the PSA representatives’ responses A summary report is provided to the mental health authority

Review – Part 1 Quantitative –How much service did the Grantee provide? –How many people did the Grantee serve? –Does the Grantee have any plans to continue the PSA if funding is not forthcoming from this source?

Review – Part 2 Qualitative –How similar is the PSA to what other providers in West Virginia – or other States – are doing? –To what extent are stakeholders involved in designing, delivering, directing the PSA? –Are there anticipated outcomes? Are they achieved?

Review – Part 2 Qualitative (continued) –To what extent does the Grantee inform the community and stakeholders about the PSA and how to access services? –Does the PSA support and promote community integration and recovery? –How does the Grantee help staff understand the importance of recovery and resilience?

Nine Criteria – Questions for Reviewers How do you know the program, service or activity (PSA) which has been funded produces and maintains reports which indicate the amount of service provided and the number of persons served? How do you know the program, service or activity (PSA) which has been funded produces and maintains reports which provide demographic information on people served?

Nine Criteria – Questions for Reviewers How do you know the program, service or activity (PSA) which has been funded might be sustained in the absence of current funding? How do you know that the program, service or activity (PSA) which has been funded will achieve the outcomes that have been predicted? To what extent are programmatic decisions made by the people who are most directly affected by the program’s implementation?

Nine Criteria – Questions for Reviewers How well does the accomplishment of the program’s goals and objectives result in meaningful, life-enhancing outcomes for its consumers? How available is information about the program to stakeholders, potential stakeholders and the community-at-large?

Nine Criteria – Questions for Reviewers Is the program’s environment integrated into the community and how clearly does the program promote, support and demonstrate the philosophy of recovery? Does staff behavior reflect a correlation among their respective, individual values, knowledge, skills and attitudes and the value-based operating principles of the program?

Logistical Data Over 60 PSA to review Four teams Two review sites Total of five days at each site –Review of responses and consensus building 2 days –Meet with PSA representatives Total of 3 days