1. Evaluation Plan March 7, 2012

2. General approach to evaluation is broad with the ability to support specificity. Collecting and evaluating multiple innovations using several methods: dashboard measures (fiscal, quality, patient and staff satisfaction, etc.), administrative data, surveys, focus groups, observations and narratives. Evaluation

3. As of now, there isn't an emphasis on direct correlational measures of specific innovations. This means…we don’t expect to be able to say (for example) that the new Welcome Packet helped improve satisfaction. What we will be able to say is that we implemented X, Y, Z innovations on this unit and there is a relationship between the innovation unit and patient satisfaction, or length of stay. Please note, that if you have a specific idea or research interest, we can help design a research plan for those unit or individual specific interests. Evaluation

4. Specifically – we’re going to release a survey for the Attending Nurses probably mid next week, and the survey will get repeated a few times over the next couple years. ARNs: A link will be in your email. Evaluation

5. Qualitatively, we’re going to: Hold focus groups Conduct observation studies Evaluate narratives Evaluation

6. Quantitatively, we’re going to administer surveys: Revised Professional Practice Environment Patient Safety Culture Patient’s Feeling Known by Their Nurses Evaluation

7. Administrative data that you/ we collect as part of MGH operations such as: Indicators: Falls, Infections, Pressure Ulcers, etc. HCAHPS (Patient Satisfaction) Length of Stay (LOS) Cost per Case Mix Staff Retention Other: Unit specific innovations/ interventions Evaluation

8. Innovation Cluster Focus Areas * Communication Patient Engagement Roles & Structures Interventions ** Throughout Admission 1.Relationship-Based Care 2.Attending Nurse 3.Handover Rounding Checklist Pre-Admission 4. Pre-Admit Data Collection 5.Patient IU Welcome Packet During Admission 6.Domains of Practice 7.Interdisciplinary 8.Team Rounds 9.Electronic White Boards 10.Volte Communication 11. Tough books Post-Discharge 12.Discharge Follow-up Phone Calls Others as identified Education Evaluation (Pre, During, Post) Other measures as identified Quantitative Qualitative Culture of Safety Survey HCAHPS LOS Quality Indicators Patients Perceptions of Feeling Known (PPFKN) Readmissions Revised Perceptions of Practice Environment Scale (RPPE) Cost per Case Mix Staff Retention Focus Groups (Staff, Patients, Families, etc) Observations Narratives * The clusters are a lens with which we gain perspective on any particular intervention. ** May apply to any or all 3 of the cluster focus areas January 2012 Conceptual Schema

9. Evaluation

11. What do YOU think is important to evaluate in this work? Thoughts, Comments, Concerns??? Feel free to email me jadams9@partners.orgjadams9@partners.org Evaluation