Postgraduate Course Evidence based management: What is it?

Evidence? outcome of scientific research, organizational facts & data, benchmarking, best practices, collective experience, personal experience, intuition

All managers base their decisions on ‘evidence’

However...

Many managers pay little or no attention to the quality of the evidence they base their decisions on

Trust me, 20 years of management experience

SO...

Teach managers how to critically evaluate the validity, and generalizability of the evidence and help them find ‘the best available’ evidence

Postgraduate Course Evidence-based decision

Postgraduate Course EBP is a means to improve decision quality. It’s a career, not a course.

Postgraduate Course Evidence-based practice:  Focuses on the decision making process  Thinks in terms of probability (instead of golden bullets).

Postgraduate Course Multidisciplinary: Incorporate and aggregate information from different sources (regardless of their origin) Adaptable: Update (or change) their decision when newer or better information becomes available Self-critical: Acknowledge the limitations of their abilities and are cautious not to be overconfident Cautious: Express their predictions in probabilistic terms and consider multiple options. Empirical: Rely more on observation than theory Evidence-based managers are

Postgraduate Course The 5 steps of EBP 1.Formulate a focused question (Ask) 2. Search for the best available evidence (Acquire) 3. Critically appraise the evidence (Appraise) 4. Integrate the evidence with your professional expertise and apply (Apply) 5. Monitor the outcome (Assess)

Postgraduate Course Intuition or evidence-based decision?

Postgraduate Course  Chesley Sullenberger, USAIR pilot, has been a visiting scholar at UC Berkeley’s Collaborative for Catastrophic Risk Management since 2007  Does research on how to make decisions to maintain safety despite technological complexity and crisis conditions 1. Use of Scientific Findings

Postgraduate Course  Has written and analyzed aviation accident reports for over 20 years 2. Reliance on Reliable and Valid Organizational Facts

Postgraduate Course  Used Decision Aids to Support Good Decision: As Sully considered what decision to make that day, he had his copilot review and follow all checklists on board relevant to crash landings  Formal Education to Prime His Skills: Sully is a graduate of the U.S. Air Force Academy and holds masters degrees from both Purdue University in Industrial Psychology and the University of Northern Colorado in Public Administration 3. Mindful Decision Making & Decision Awareness

Postgraduate Course  The last person to leave the plane, Chesley Sullenberger twice walked the plane’s aisle to check all passengers were off  Sully’s last act onboard was to grab the passenger list. Used on-shore to verify rescue of all passengers and crew 4. Ethics and Responsibility to Stakeholders

Postgraduate Course In Sullenberger’s Own Words… “One way of looking at this might be that for 42 years, I've been making small, regular deposits in this bank of experience, education and training. And on January 15, the balance was sufficient so that I could make a very large withdrawal.”

Postgraduate Course 1.Get Evidence into the Conversation 2.Use Relevant Scientific Evidence 3.Use Reliable and Valid Business Facts 4.Become “Decision Aware” and Use Appropriate Processes 5.Reflect on Decision’s Ethical and Stakeholder Implications Five Good EBP Habits

Postgraduate Course 1. Set learning goals (2-5) 2. Pre-test: where does learner stand on learning goal before course? 3. Build opportunities for practicing those learnings throughout course (curriculum) 4. Post-test: Measure progress on each learning goal and provide feedback 5. Feedback & Redesign: Use feedback to make course more effective over time Five Good EBP Teaching Habits