1. The Multiple Mini-Interview CAAHP 2012 Ellen Hughes Denise MacIver

2. MMI Presentation Outline Multiple Mini Interviews (MMIs): –Why? What? Who? How? Interactive Sessions –Training –Rotations (35 minutes) –Debriefing MMIs by Distance – Can it work? Q & A

3. Why? Benefits of the MMI The MMI is an innovative, feasible, acceptable, and reliable interview technique that is: Assess different non-cognitive attributes Reliable and valid Less biased/more defensible than traditional panel interview Designed to reflect the values of the profession Multiple first impressions Ability to interview a large number of applicants in less time with less resources

4. MMI Non-cognitive qualities of an individual Formats: Discussion, Collaborative or Acting. Applicant reads a question ( 2min), enters a room, answers the question (5-10 min), leaves room and repeats at next station. 6 – 10 questions TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. MMIs: Multiple First Impressions

5. What? Assessing Non-Cognitive Abilities The MMI assesses Non-Cognitive abilities such as: Teamwork Responsibility Ethical & moral judgment Communication skills Management skills Problem solving Self awareness Conflict resolution (Career Investigation)

6. MMIs: Who? Interviewers and Candidates Station 1 Station 2 Station 3 Station 4 Station 5 Station 6 Station 7 Station 8 Candidate Collecting Room IIIIIIII

7. MMIs: How? Interviewers and Candidates Station 1 Station 2 Station 3 Station 4 Station 5 Station 6 Station 7 Station 8 IIIIIIII

8. Rotation of Candidates Station 1 Station 2 Station 3 Station 4 Station 5 Station 6 Station 7 Station 8 IIIIIIII

9. Example Rotation for 1 Interviewer (1 station) Start Time End TimeApplicant – Question 8:308:371 st Candidate 8:378:442 nd Candidate 8:448:51 3 rd Candidate 8:518:58 4 th Candidate 8:589:05 5 th Candidate 9:059:12 6 th Candidate 9:129:19 7 th Candidate 9:199:26 8 th Candidate 9:269:33 Break

10. MMI Non-cognitive qualities (decision making, ethical judgment, inter-professional skills). “Discussion” Format – 1 interviewer to 1 candidate Candidate reads a question (1 min), enters a room, answers the question (4 min), leaves room and repeats at next station. 3 questions TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. CAAHP MMIs: 3-Station Circuit

11. CAAHP 2012 Simulated MMIs: 3 Station Circuits – 5 minutes each III TimeAAA 3:15 – 3:20123 3:20 – 3:25312 3:25 – 3:30231 5 minutes to Switch Roles III TimeBBB 3:15 – 3:20123 3:20 – 3:25312 3:25 – 3:30231 III TimeCCC 3:15 – 3:20123 3:20 – 3:25312 3:25 – 3:30231 III TimeDDD 3:15 – 3:20123 3:20 – 3:25312 3:25 – 3:30231

12. Training: Role of the Candidate Prior notice of MMI style of interview Orientation/Training on Day of Interviews Review your schedule Move when the bell rings You have 1 minute to read the question (bell will ring after 1 minute) You can make notes while you read the question You have 4 minutes to answer the question (warning bell will ring after 3m, 30 secs (wrap up), then at 4 minutes – time to move to next station)

13. Training: Role of the Interviewer Confirm that the correct candidate enters the room – they will give you a label with their name to put on your score sheet Confirm no conflict of interest Ask the candidate if they have read the question Ensure a fair but rigorous opportunity for the applicant to meet the criteria for the station

14. Role of the Interviewer…cont. Remain objective and do not provide feedback or in any way divulge an opinion of the performance of an applicant Do not read the question or clarify the question for the applicant – the question is posted for the candidate Provide a considered and justifiable score at the station using the entire scale of ratings for each group of candidates

15. Scoring For the first couple of candidates, you may wish to make notes and score them on a separate piece of paper. Once you get a feeling for the question, you can transfer the scores to the score sheets. You CAN change scores you’ve given candidates who have come and gone from your room.

16. Score Sheet Record only negative comments – keep it professional ( forms are FOIP-able ) Use the entire grading scale! No half marks – only whole numbers Use check mark to score (not x’s, lines, or circles)

17. Interviewer Package Items included: –Your Scenario question –A supporting document to assist you with the question –Score sheets –Candidate Rotation Schedule –List of Candidates –Pencil & eraser, notepaper

18. CAAHP 2012 Simulated MMIs: 3 Station Circuits – 5 minutes each III TimeAAA 3:15 – 3:20123 3:20 – 3:25312 3:25 – 3:30231 5 minutes to Switch Roles III TimeBBB 3:15 – 3:20123 3:20 – 3:25312 3:25 – 3:30231 III TimeCCC 3:15 – 3:20123 3:20 – 3:25312 3:25 – 3:30231 III TimeDDD 3:15 – 3:20123 3:20 – 3:25312 3:25 – 3:30231

19. Experiences as a Candidate? Experiences as an Interviewer? Other? TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. Debriefing

20. Validity of videoconferencing for entrance interviews (not yet published) Dr Randy W. Dreger Heather Gray, BSc, Chair-Diagnostic Laboratory & Medical Transcription Joy Lutz, CLXT, Instructor-Combined Laboratory & X-Ray Technology. Denise MacIver, M.Ed., Associate Dean-SHS Ellen Hughes, M.Ed., Dean-SHS Scott Paradis, CPT, Research Assistant-SHS Technical Support Troy Gregoire, School of Information Communications and Engineering

21. Background Interviewing applicants has been and remains an important part of the selection process. Typically done in a face to face environment Not always feasible New technology may ameliorate this issue TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. Validity of videoconferencing for entrance interviews

22. Problem ProFitHR a private company who specializes in the interview process were looking to determine if their product the MMI could be performed via Skype and produce valid results. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. Validity of videoconferencing for entrance interviews

23. Research Design 23 NAIT students (no MMI experience) Cross over design 10 stations TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. Validity of videoconferencing for entrance interviews Day 1Day 2

24. Results F2F - 6.2 ±1.5. Skype - 6.1 ±1.8 no significant difference between the scores TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. Validity of videoconferencing for entrance interviews

25. Results Compared to the F2F condition the applicant ranking on Skype: 2 no change 12 did better 9 did worse suggesting no systematic difference A secondary question was to determine if there was a day to day or learning effect. The scores for day 1 were 5.9 out of 10 and day 2 was 5.8 out of 10, no significant difference TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. Validity of videoconferencing for entrance interviews

26. Results Seventy percent of the applicants preferred the F2F method while 17% preferred Skype and 13% liked either method equally. The interviewers also preferred the F2F method (70%) with 30% choosing either. When asked about performing the MMI in the future 52% of applicants would prefer F2F, 13% Skype and 35% would use either. Interviewers’ responses were 30% F2F, 10% Skype and 60% either. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. Validity of videoconferencing for entrance interviews

27. Future Projects Replicate the study with a large and more diverse sample. Replicate this study in a “non-laboratory” setting. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. TEXT PAGE: Background pattern in top band. Title text set in Arial, Uppercase, flush left/ragged right. Body text in ARIAL font, flush left/ragged right, upper & lowercase. Insert new slide by selecting ‘Insert from menu and select ‘Duplicate slide’. Validity of videoconferencing for entrance interviews

28. Thank You! Questions?