1. R4 – Shared Evaluation OVERVIEW, IMPORTANCE, AND RESULTS TO DATE

2. Shared Evaluation – Purpose  NOT R4 Evaluating Members – Tool for your benefit and our mutual growth  Determine the Needs/Importance of Program Attributes - Our Military Family  Determine Demographics – define areas of need/improvement  Unified data system: apples vs. oranges  R4 members – Accountable to Each Other  Development of Collateral  Direct Client Feedback  Development of Individualized Treatment Plans – Continuum of Care  Endless Points to Compare and Contrast

3. Shared Evaluation – Information Collected  Demographics  Gender  Service Member –Gender, Duty Status, Branch, Deployment, Separation Date  Supporter – Gender, Relationship to Service Member  Importance of Program Attributes  Facilities/Equipment  Staff/Volunteer  Program Factors  Satisfaction with Services Provided  Facilities/Equipment  Staff/Volunteer  Program Factors Evaluation Preview Link

4. Where did we come up with these questions?  Had our research committee lead advise on the strategy.  Starting by interviewing a focus group of Our Military Family  We asked 2 questions  What are the important factors or characteristics that influence your decision to attend veteran- focused programs?  What is it about those programs that makes you want to attend?  We drilled those responses down into a list of common factors.  Devised questions following standard IPA procedures.  Determined what demographic factors were important for extrapolating specific objectives of the evaluation

5. Shared Evaluation – Features  IRB – approved/ Client Consent  Anonymity  Customized Questions (5-8) Specific to Member Programs  Smart Phone, and Tablet Compatible  Recognition of Return Users – Short Form  Reports Generated Upon Request – by Program and/or Aggregated

6. Shared Evaluation - How It Works  Administer at the End of or Immediately After Program  Twice Annually for Community Programs  Templated or Program Email with Link  Tiers of success  Best Results – Before They Leave  If Not, Within 24 Hours of Participation  Paper If Absolutely Needed  Qualtrics Collection and Generating Reports

7. Example Report – Project Sanctuary  Open report in 2015 conference folder

8. Shared Evaluation – Combined Results  Around Individual Data Sets (Service Members, and Supporters)  Representing 14 R4 Members  R4 Combined Results Link: Open and review combined results to date

9. Shared Evaluation – Benefit Not Hindrance  Service Provided by R4 Alliance  Taking it off you plate  Rich Source of Feedback and Testimonials  Program Evolution – Immediate Feedback  Importance of Shared Measures  United Voice  Shared measurement for donors foundations

10. Shared Evaluation – Member Barriers  Too Many Forms Required by Too Many Organizations  Ruining the Experience  Lack of Staff Support  Already Using Own Evaluation Discussion:  What Other Barriers Do You Have?  How Do We Overcome These?

11. Shared Evaluation - Incentives Discussion:  What incentives would entice you to participate in using the tool?  Ideas: Participant Satisfaction Widget,

12. Shared Evaluation  Additional Q&A  For Questions or Additional Information About the Shared Evaluation Contact: info@r4alliance.orginfo@r4alliance.org