Measuring Team Effectiveness Presented by Jill A. Marsteller, PhD, MPP Based on work by Stephen Shortell, Jill Marsteller, Michael Lin, Marjorie Pearson,

Slides:

Advertisements

Similar presentations

It Starts with a Conversation Damien Doyle, MD, CMD, FAAFP.

Advertisements

Science Subject Leader Training

CMHICMHI Building Primary Care Medical Homes for CSHCNs & Assessing the Quality 1 st Annual National EHDI Meeting February Vienna, Virginia Jeanne.

1 Physicians Involved in the Care of Patients with Recently Diagnosed Cancer CanCORS Provider Composition Writing Group Academy Health Annual Research.

Diversity in Team Composition and Performance and Creativity

Chronic Care Model Implementation Emphases M. L. Pearson, 1 S. Wu, 1 S.M. Shortell, 2 J.A. Marsteller, 3 P.J. Mendel, 1 M. Lin, 2 E.B. Keeler 1 1 RAND.

THE COMMONWEALTH FUND Figure 1. Health Care Opinion Leaders Agree on the Need for a Public–Private Entity to Coordinate Quality Source: Commonwealth Fund.

ASSESSMENT AND EVALUATION OF ADVANCED CLINICAL COMPETENCE

HUMAN RESOURCES & SECURITY What's our level of Engagement? EUPAN - HRWG 4 April 2013.

BUILDING THE CAPACITY TO ACHIEVE HEALTH & LEARNING OUTCOMES

Continuous Assessment of Practice West Midlands Mental Health in H. E. Educators Conference Steve Wilding. Clinical Educator. Bernie Kitchen – Practice.

Converting Data to Information. Know your data Know your audience Tell a story.

Building Relationships

International Conference on Implementation of the Common Assessment Framework Thessaloniki, on 10 & 11 June 2010 CAF Enforcement in the Regional Administration.

Developing Your Knowledge and Practice Unit SHC32

Presenter: Beresford Riley, Government of

Management Matters in Healthcare. 1 Agenda Measuring management practices in healthcare 2 Describing management across hospitals 3 Drivers of management.

Using the LEM to Drive Results at OU Physicians

West Hertfordshire Hospitals NHS Trust West Hertfordshire Hospitals NHS Trust Staff and Patients Setting Standards Together Patient Experience Network.

*Saniye ÇİMEN PhD, RN **Zuhal BAHAR PhD, RN *Candan ÖZTÜRK PhD, RN *Murat BEKTAŞ PhD student, RN *Dokuz Eylül University School of Nursing, Child Health.

Context Assessment Index Translation, adaptation to Swedish Health care and test of psychometric properties in a Swedish group of RNs Kerstin Nilsson Kajermo.

Crisis Shelter Program GOALS To stabilize youth and families in crisis To develop stable living conditions for youth To engage families in the resolution.

What is Pay & Performance?

Promoting Regulatory Excellence Self Assessment & Physiotherapy: the Ontario Model Jan Robinson, Registrar & CEO, College of Physiotherapists of Ontario.

1 Performance Assessment Process: The Reviewer’s Perspective May 2014.

A Healthy Workplace Canadian HW Criteria & Implementation John Perry (

1 I am a Community Health Nurse A package for Community Health Nurse practitioners in Western Australia The Community Health Nurse Western Australia Inc.

Team Structure The ratio of We’s to I’s is the best indicator of the development of a team. –Lewis B. Ergen NEXT: ®

1 Career Planning. 2 When you have completed this units you will be able to: identify what is important to you in terms of your career understand what.

Hazard Recognition and Risk Analysis

Appraising and Managing Performance (c) 2007 by Prentice Hall7-1 Chapter 7.

THE COMMONWEALTH FUND Figure 1. Nine of 10 Health Care Opinion Leaders Think Fundamental Change Is Required to Achieve Gains in Quality and Efficiency.

2011 WINNISQUAM COMMUNITY SURVEY YOUTH RISK BEHAVIOR GRADES 9-12 STUDENTS=1021.

2011 FRANKLIN COMMUNITY SURVEY YOUTH RISK BEHAVIOR GRADES 9-12 STUDENTS=332.

7/16/08 1 New Mexico’s Indicator-based Information System for Public Health Data (NM-IBIS) Community Health Assessment Training July 16, 2008.

Chapter 10 Managing Teams

1 Using K-12 Assessment Data from Teacher Work Samples as Credible Evidence of a Teacher Candidate’s Ability to Produce Student Learning Presented by Roger.

Chapter 13 Motivation MGMT Chuck Williams

PROFESSIONAL NURSING PRACTICE

IDEA What it is and How to Implement the System Texas A & M, February 2013 Shelley A. Chapman, PhD Senior Educational Consultant.

Performance Assessment Process: The Employee’s Perspective May 2014.

Comparing Job Demands, Coping Resources and Well-being Across Different Health Care Providers Working Together Jane B Lemaire MD, Jean E Wallace PhD, Janet.

Staffing And Scheduling.

Work Survey Instrument Revision for Case Management Work Jane Christianson, RN; MSN L. Sue Davis, RN; PhD.

Learning Objectives Define roles and responsibilities of team members

1. Confirming and Supplementing CAHPS® Communication Items Using Feedback from High-Performing Physicians. Ron D. Hays, Ph.D., Professor of Medicine and.

Leading in the 21 st century- New paradigms for a globalizing world MGMT-E 152 Prof. Michael Pirson Class 7: October 29.

The Role of Management Support in Implementing Innovative Clinical Practices Carol VanDeusen Lukas, EdD Mark M. Meterko, PhD David Mohr, PhD Marjorie Nealon.

Measuring the Psychosocial Quality of Women’s Family Work: Initial Findings Tamara Colton 1 BA (Hons), Laurie Hellsten 1 PhD & Bonnie Janzen 2 PhD 1 Department.

Building Your CUSP Team Part I Michael Rosen, PhD August 28, 2012 Armstrong Institute for Patient Safety and Quality Conference Number(s):

© 2009 On the CUSP: STOP BSI Building a Team. © 2009 Learning Objectives To understand the central importance of your ICU quality improvement team To.

User Study Evaluation Human-Computer Interaction.

1 The Patient Perspective: Satisfaction Survey Presented at: Disease Management Colloquium June 22, 2005 Shulamit Bernard, RN, PhD.

Promoting Team Science Participation Stephen Kritchevsky, PhD Department of Internal Medicine Associate Dean for Research Development.

Building a Team. Slide 2 Immersion Call Overview Week 1: Project overview Week 2: Science of Improving Patient Safety Week 3: Eliminating CLABSI Week.

Graduate studies - Master of Pharmacy (MPharm) 1 st and 2 nd cycle integrated, 5 yrs, 10 semesters, 300 ECTS-credits 1 Integrated master's degrees qualifications.

AN INTRODUCTION Managing Change in Healthcare IT Implementations Sherrilynne Fuller, Center for Public Health Informatics School of Public Health, University.

Team Structure The ratio of We’s to I’s is the best indicator of the development of a team. –Lewis B. Ergen NEXT:

Brenda J. Stutsky RN, PhD Development and Testing of a Conceptual Framework for Interprofessional Collaborative Practice.

Today.. Overview of my realist synthesis Reflections on the process

Sustainability and Spread of Chronic Illness Care Improvement Shinyi Wu 1 M. L. Pearson 1, S. M. Shortell 2, P. J. Mendel 1, J. A. Marsteller.

Sharing and Learning. Our team members:  Physicians, MOAs, other staff One Chronic Pain Patient:  Male/female  Age  Occupation  Main complaint 

ATTITUDE COMPETENCY. CONCEPT OF COMPETENCY  Skill Ability to accomplish  Talent Inherent ability  Competency Underline characteristics that give rise.

Fractures in the System: The Consumer Experience with Chronic Illness Susan Reinhard, RN, PhD, FAAN Senior Vice President and Director, AARP Public Policy.

Using Multiple Data Sources to Understand Variable Interventions Bruce E. Landon, M.D., M.B.A. Harvard Medical School AcademyHealth Annual Research Meeting.

Healthcare Organization Employee Experience Michael Mabanglo, PhD, LCSW February 16, 2016.

OSCAR MCKNIGHT PH.D. ASSISTANT DEAN FOR STUDENT AFFAIRS DIRECTOR OF PSYCHOLOGICAL COUNSELING SERVICES ASHLAND UNIVERSITY Student Affairs Program Evaluation:

Self Efficacy of Communication Skills in Difficult Patient Encounters: An Interdisciplinary Collaboration Rachel Bramson, M.D., M.S. Kimberly L. van Walsum,

Self Manager What life skills have you used today? Have you been a….

Hildegard Peplau Theory of Interpersonal Relations.

Presentation transcript:

Measuring Team Effectiveness Presented by Jill A. Marsteller, PhD, MPP Based on work by Stephen Shortell, Jill Marsteller, Michael Lin, Marjorie Pearson, Shinyi Wu, Peter Mendel, Shan Cretin, and Mayde Rosen. The Role of Team Effectiveness in Improving Chronic Illness Care, RAND/ UC Berkeley Improving Chronic Illness Care Evaluation. Medical Care, November 2004.

Outline of presentation Define team effectiveness Situate in team performance theory Context Factors, items & reliability Show associations -- antecedents and consequences Conclusion

Team Effectiveness Perceived organizational support Team self-assessed skill Goal agreement and participative norms Team autonomy/process ownership Information/help available

Context in which measures were tested 40 teams participating in the Improving Chronic Illness Care Evaluation (ICICE) Surveyed members of multi-disciplinary teams As many as 12 occupational categories Size 1 to 14 members One disease-specific team per organization Organizations are hospitals, physician groups, clinics, health plans, or health systems Participation was voluntary

Team Effectiveness Instrument Original creator: G. Ross Baker at U. Toronto We reduced number of items (23), defined own factors ANOVA confirmed aggregation of individual- level responses to team level Responses 1-7 (strongly agree to strongly disagree) Varimax rotation, eigenvalues 1.0, clean loading 0.4

Factors, Items & Reliability Organizational support (Alpha=0.85) This organization makes sure people have the skills and knowledge to work in teams A team that does a good job in this organization does not get any special rewards or recognition (reverse coded) Senior management in the organization strongly supports our work Senior management regularly reviews our progress in making change Senior managers in my organization see success in this project as a high priority for the organization

Factors, Items & Reliability Team Self-Assessed Skill (Alpha=0.90) Our team has been able to use measurement very effectively to design and test changes After we have completed a change, team members are excellent in reflecting and learning from the results Members of our team were very successful in using information from our change cycles to design new tests of change In making changes, our team was able to easily adapt change ideas to match the needs of our organization Our team applied enough knowledge and skill to the work to get the work done well

Factors, Items & Reliability Goal Agreement & Participative Norms (Alpha=0.90) Project team members agreed on the projects overall goals The projects goals were understood by all the project team members Most members of my team got a chance to participate in decision-making Certain individuals in this group had special skills and knowledge that the rest of us count on The contribution of every group member was listened to and considered

Factors, Items & Reliability Overall Perceived Team Effectiveness (Alpha=0.95) Organizational support Team self-assessed skill Goal agreement and participative norms Team autonomy (Alpha=0.81) Information/help available

Descriptives MeasureNMeanStd. Dev. MinMax Team Size Team Skill Goal Agree and Partic Norms Organizational Support Overall Perceived Team Effectiveness

Predicting Team Effectiveness Independent Variable Overall Perceived Team Effectiveness Coefficient (sig. lvl) Constant1.11 Team Size-0.06* Team Champion0.69*** Patient Satisfaction Focus0.49** Cultural Balance3.10* Asthma0.09 Physician Percentage on Teams1.27* N40 F5.29 p-value Adj R-Sq0.4 *indicates p<0.10; ** indicates p<0.05; *** indicates p<0.01

Predicting Quality Improvement Activity Independent VariableNumber of ChangesDepth of Changes Coefficient (sig. lvl) Constant Team Size *** Team Size Squared ** Patient Satisfaction Focus-21.58***-4.79** Cultural Balance118.85*17.54 Asthma ** Overall Perceived Team Effectiveness 12.00***4.69*** N40 F p-value Adj R-Sq * indicates p<0.10; ** indicates p<0.05; *** indicates p<0.01

Change in QI Clinical Process Score Patient Survey~1300 patients, 29 organizations Higher score greater improvement in process measures than average Team effectiveness and team skill are consistently associated with greater process improvement

Conclusion Applies to multiple settings Versatile Appropriate measures of team-level phenomena Easily understood questions High Cronbachs Alphas Well supported by theory Relate as expected to QI Questions are actionable Available free on the web,