Evaluating implicit bias training

Slides:



Advertisements
Similar presentations
1 of 19 Evaluating an Information Project Defining Content © FAO 2005 IMARK Investing in Information for Development Evaluating an Information Project.
Advertisements

Westminster Kingsway College QUALITY. Mission of Westminster Kingsway College: To support all of its students in realising their ambitions as learners.
Rgu Research into information providing and using A selective overview Dorothy Williams
The theory and evidence behind self management
FASS Disability Initiative Seminar Two: Curriculum and Course Design Dr Leanne Dowse (SSIS) and Dr Brooke Dining.
Restorative Approaches in Pentrehafod School In keeping with our priorities for 2012, Pentrehafod School is committed to embedding Restorative Practice.
Foundation of Nursing Studies in partnership with the Burdett Trust for Nursing Patients First: Supporting nurse led innovation in practice Workshop 1.
National Contracts Service Locating Equality and Diversity in the Common Inspection Framework Equality and Diversity because … The fundamental questions.
Awareness Raising Session. Aims for the Session To raise awareness of the context, rationale, aims and objectives and outcomes of the CRED Policy.
© 2014 London Cross Cultural Learner Centre intercultural competency training program September 26, 2014.
Exec Handover Training Chairing Skills
Health4U Dr. Catrin Evans, University of Nottingham; Amdani Juma and Community Research Team, African Institute for Social Development (AISD); Katie Turner,
Translating evidence into practice Conference EMCDDA Lisbon, 6 – 8 may 2009 Prof dr H.F.L. Garretsen Tranzo, Tilburg University.
Sustainable Development in Inspection Bryan Davies HMI.
Developed by Tony Connell Learning and Development Consultant and the East Midlands Health Trainer Hub, hosted by NHS Derbyshire County Making Every Contact.
“ I never thought how I learn,just that I learn…” – an evaluation of the impact of personal tutor support on first year students engagement with PDP. Julie.
Workshop 1. Patients First Introductions Poster viewing Confidence line Time capsule Hopes, fears and expectations.
Self Evaluation after a training session.  The training session was organized and well-structured.  Each student had a success rate of 70%?  The exercises.
Improving Outcomes by Helping People Take Control
EHRC call for evidence on religion or belief Dr David Perfect Research Manager Equality and Human Rights Commission.
Campaigning jef training days June definition campaign = an operation or series of operations energetically pursued to accomplish a purpose.
Taking Multicultural Competence to the Next Level A Systems Approach Jeannie Stumne, CEHD Career Services Mackenzie Sullivan, Carlson Career Services.
SESSION ONE PERFORMANCE MANAGEMENT & APPRAISALS.
Introduction to Gender Concepts Gender and Value Chain Training for LIVES Project Team, Adama, Ethiopia, August 19-21, 2013 Dr Valentine J Gandhi.
Sociology 3322a. “…the systematic assessment of the operation and/or outcomes of a program or policy, compared to a set of explicit or implicit standards.
Annamari Ylonen (Evaluation Officer) Evaluation of the project.
Ethicaltrade.org The ETI supervisor training programme: Promoting equal treatment of workers Course for supervisors.
Advocacy CAMS Gathering November 2010 Fiona Caniglia.
The Impact of Health Coaching
1 Human Resource Management Training & Development Handout 2.
Role modelling Intending Trainers’ Course Reference BMJ. 2008; 336:
Developing Business Practice –302LON Critical thinking, reading and taking notes Unit: 4 Knowledgecast: 1.
Implementing the adapted “6 steps”* approach An end of life care project for local care homes Project Outline Liaised with care home managers and invited.
Dealing with Problems in Daily Life – Unit 337
Design phase Where can we start?. This session is about … … understanding and putting to use the relation between objectives, activities, content and.
An insight into the NHS Health Check Programme in Birmingham NHS Health Check National Learning Network 14 th Workshop - London 17 th July 2012.
Victorian Health Promotion Foundation The Equal Footing Program – new approaches in new sectors 23 March 2016 Renee Imbesi Principal Program Officer, Mental.
Evaluation Planning Checklist (1 of 2) Planning Checklist Planning is a crucial part of the evaluation process. The following checklist (based on the original.
Barbara Burford Memorial Lecture Wendy Irwin Equalities Lead Royal College of Nursing.
Julie Kerry Thomas Kohut
Theories of intrapersonal capacity 2
Audience Engagement We will be using Polleverywhere throughout the presentation. If you would like to participate you can go to PollEv.com/kristabailey359.
Managing Response Rates
Provide instruction.
Peeter Mehisto, UCL Institute of Education
Quality Improvements.
Learning Into Practice Plan
MODULE 3 – LEADERSHIP BENCHMARK
Training Trainers and Educators Unit 8 – How to Evaluate
Training Course on Integrated Management System for Regulatory Body
What is Action Planning?
Standing Up to Implicit Bias
Skills for change Campaigning – where to start.
What is Action Planning?
MODULE 24 – EQUAL OPPORTUNITIES AND GENDER BALANCE
The elephant in the room. John Wattis University of Huddersfield
Employability Skills Unit introduction Ainsley Smith
New Zealand Dietitians Board
Training Trainers and Educators Unit 8 – How to Evaluate
Embedding Equality and Diversity in the Curriculum: Developing a ‘Train the Trainers’ Model Joan McLatchie Laurie Anne Campbell.
Starter Imagine - you did not do as well as you wanted to in a biology test, but your teacher praises you for working hard and trying your best. You feel.
Reviewing your final digital product
Measuring perceptions of safety climate in primary care
Resilience training – Surviving and thriving in Paediatrics
The Edward Jenner Programme
What works? Empirically informed bias training
Approaches to Multicultural Group Work Chapter 5
User CENTERED DESIGN IB TOPIC 7.
Rotterdam:15-17/11/2001.
Niall Crowley Values Lab
Presentation transcript:

Evaluating implicit bias training Dr Jules Holroyd, Dr Joseph Sweetman

Evaluation: relative to aims How well did the session achieve what we intended it to?

Putative aims -tick boxes -change individual behaviour -devolve institutional responsibility for dealing with bias/diversity/inclusion to individuals -get people to implement specific strategies to change their own biases -get people to implement specific strategies to change their own behaviour -function better as an organisation (in terms of recruitment/profit/non-diversity related goals) -get people to implement specific strategies to change the way their institution does things -raise awareness about bias -reduce implicit biases -change group behaviour -reduce explicit biases or stereotypes -reduce discrimination -equip people to notice when others are being biased -improve workplace climate -improve inclusion

Some of these are bad aims (alone) -tick boxes -devolve institutional responsibility

Some of these are infeasible aims (on the basis only of engaging in the training session): -reduce implicit bias [more is needed to do this! Cf. Devine et al 2012, but see Forscher et al 2017] -function better as an institution [issues about using this as a motivating aim?]  

Where we have modest evidence and reasons for optimism: -reduce explicit biases or stereotypes -equip people to notice when others are being biased  

Where we have modest evidence and reasons for optimism: -get people to implement specific strategies to change their own biases -get people to implement specific strategies to change their own behaviour (Devine et al 2012; Forscher et al 2017) 

Re: Changing biases and behaviour NB: changing bias does not seem to be what mediates changes in behaviour (Forscher et al 2017b)

Some of these aims are such that that we haven’t really begun to look at the relationship between implicit bias training and these aims: -get people to implement specific strategies to change the way their institution does things [requires further follow up – what changes resulted from those changes?]

Some of these aims are such that that we haven’t really begun to look at the relationship between implicit bias training and these aims: -change group behaviour -reduce discrimination -improve workplace climate -improve inclusion

What evaluative tools we use will depend on what our aims are: -Implicit measures? -Self-report measures? -Actual outcomes?

Issues: -who to ask about outcomes. People who participated in the session? People who work in the institution? Service users? (Cf Hausman 2014). Hausman: participants reported better awareness of bias. Service users – patients at Veterans Hospital – reported less positive interactions overall with those who had participated in training than those who had not.

Issues: -trade-offs: is it a win if any individual implements strategies? If some people stereotype more but others implement strategies to change behaviour, is that an acceptable trade-off? Hausman: participants reported better awareness of bias. Service users – patients at Veterans Hospital – reported less positive interactions overall with those who had participated in training than those who had not.

In sum: We need to think a bit more about what bias training should aim for (and possible tensions between different aims?]; And then about how to evaluate whether those aims have been met. Hausman: participants reported better awareness of bias. Service users – patients at Veterans Hospital – reported less positive interactions overall with those who had participated in training than those who had not.