1 Mystery Shop Change Overview and Guide Effective January 2009 A focus on QSC Excellence leads to more satisfied customers The “Moment of Truth” is our.

Slides:



Advertisements
Similar presentations
INTRODUCING THE NEW NDR + On-Line Meeting and Conference Call Access Code # Deb Salinger – Training material available.
Advertisements

Rubric Design Denise White Office of Instruction WVDE.
“PD in a PowerPoint” Standards Based Grading & Reporting (SBGR)
1 H2 Cost Driver Map and Analysi s Table of Contents Cost Driver Map and Analysis 1. Context 2. Cost Driver Map 3. Cost Driver Analysis Appendix A - Replica.
Market-Based Management
GSRS 2.1 Training Module S.2.1 Navigation General
Starting an Innovation Process Life of any business is finite. For companies to endure, the drive for efficiency must be combined with excellence in.
McGraw-Hill/Irwin © The McGraw-Hill Companies, All Rights Reserved Creating Gantt Charts With Microsoft Project Technology Plug-In T12.
Opportunity Analysis.
Supplier Development Kaizen Implementation Kit
Xora StreetSmart V18 Customer Release Highlights 1 October, 2013.
Oral Presentation Rubrics Standards-based Assessment of and for Learning.
Satisfacts Customer/Employee Evaluation Program Do you want to learn about what your clients, customers, members and employees are really thinking?
SE 450 Software Processes & Product Metrics Survey Use & Design.
Welcome to Turnitin.com’s Peer Review! This tour will take you through the basics of Turnitin.com’s Peer Review. The goal of this tour is to give you.
How to Write Goals and Objectives
2010 Performance Evaluation Process Information Session for Staff
TS16949 requirements Subjects –Audit planning –Recertification audit requirements –Auditing Remote supporting functions.
Virtual Business: Retailing
Office of Project Management Metrics Report Presentation
Input Design Objectives
VIRTUAL BUSINESS RETAILING
Science & Technology Grades Spring 2007
Classroom Assessment A Practical Guide for Educators by Craig A
Office of Institutional Research, Planning and Assessment January 24, 2011 UNDERSTANDING THE DIAGNOSTIC GUIDE.
Workforce Engagement Survey Accessing your survey results and focussing on key messages in the survey data.
Why Use MONAHRQ for Health Care Reporting? May 2014 Note: This is one of seven slide sets outlining MONAHRQ and its value, available at
0 eCPIC Admin Training: Custom Calculated Fields These training materials are owned by the Federal Government. They can be used or modified only by FESCOM.
New Features in Release 9.2 (July 27, 2009). 2 Release 9.2 New Features Updated Shopping Experience Home/Shop page Shop at the top search New Hosted Supplier.
1 ADVANCED MICROSOFT EXCEL Lesson 9 Applying Advanced Worksheets and Charts Options.
Karen Herter (HMG) Mike Langley (DGS) April 15, 2008 Portfolio Manager for California State Buildings Meeting the Requirements of Executive Order S
OneView Administrator Training Leads September, 2011.
2014 © 2014, Battelle for Kids. All Rights Reserved. ROSTER VERIFICATION Teacher Guide.
Viking Survey Results Report Team Assignment 11 Team 2-1.
Alerts Manager Refer to Slide 2 for instructions on how to view the full-screen slideshow.Slide 2.
Submission Status December Submission Status: Describes the status of the UDS report while it is being prepared, reviewed, or revised, either originally.
Dr. Fowler AFM Unit 8-1 Organizing & Visualizing Data Organize data in a frequency table. Visualizing data in a bar chart, and stem and leaf display.
Human Resources 1 G-Top Global Workflow Employee View September 2014.
Systems Accreditation Berkeley County School District School Facilitator Training October 7, 2014 Dr. Rodney Thompson Superintendent.
Chapter 12 Translating Expectations to Specifications CEM 515: Project Quality Management Prof. Abdulaziz A. Bubshait King Fahd University of Petroleum.
Fidelity of Implementation A tool designed to provide descriptions of facets of a coherent whole school literacy initiative. A tool designed to provide.
Performance Improvement Project Validation Process Outcome Focused Scoring Methodology and Critical Analysis Presenter: Christi Melendez, RN, CPHQ Associate.
IHSAA Tournament Officials Rating System The ranking of contest officials applying for an IHSAA tournament series event shall have two components: 1.
Project Discovery – Monday Holyoke 561 Most updates will only have 30 minutes maximum for their presentations. At least 10 minutes should be left for Q&A.
Microsoft Project 2010 ® Tutorial 5: Tracking Progress and Closing the Project.
Quality Is in the Eye of the Beholder: Meeting Users ’ Requirements for Internet Quality of Service Anna Bouch, Allan Kuchinsky, Nina Bhatti HP Labs Technical.
Checklists EDUC 307. What is an Observation Checklist?  The observation checklist is a strategy to monitor specific skills, behaviors, or dispositions.
The FA Charter Standard Club Annual Health Check Club Presentation Guide Oct 2010.
FHA Tax Credit Equity Pay-In Requirements for All Low Income Housing Tax Credit Projects Introduction to The New Tax Credit Wheelbarrow Module Validating.
TOPSpro Special Topics Data Detective II: Data Integrity and Payment Points.
Impact Research 1 Deploying Wireless LANs for Business Benefit Summary Document.
MyFloridaMarketPlace Quality Improvement Plan. Page 2 MFMP Quality Improvement Plan  The MFMP team has developed a quality improvement plan that addresses.
1 Coupon Strategies and Tactics: The Consumer Response Association of Coupon Professionals April 20, 2016 NAM Proprietary and Confidential/For client use.
This template provides guidance for the execution of task, Analyze Capabilities (EA.040). It is in a presentation format that may be used to present.
Observational Study Working Group
Training Documentation – Replacing GSPR with RFQ 2.0
Performance Improvement Project Validation Process Outcome Focused Scoring Methodology and Critical Analysis Presenter: Christi Melendez, RN, CPHQ Associate.
IFSP Aligned with the Early Intervention Data System
Performance Improvement Project Validation Process Outcome Focused Scoring Methodology and Critical Analysis Presenter: Christi Melendez, RN, CPHQ Associate.
Sales Performance Definition Purpose Instructions
Starting a Performance Based Testing Program:
Realizing your dreams of homeownership
Survey Design & Use.
Chlamydia Learning Collaborative
HFFA Membership Study Results Wave 2
Workforce Engagement Survey
Links for Academic Learning: Planning An Alignment Study
Reporting Site Manager User Guide February 2019.
Presenter: Kate Bell, MA PIP Reviewer
2017 Regional Segmentation
Presentation transcript:

1 Mystery Shop Change Overview and Guide Effective January 2009 A focus on QSC Excellence leads to more satisfied customers The “Moment of Truth” is our customer’s experience at the Front Counter or Drive Thru – and satisfying our customers consistently means higher guest counts and increased sales over time. The Customer Satisfaction Opportunity (CSO) index is the metric used to determine how well we’re satisfying our customers and the Mystery Shop program is what we utilize to compute the CSO. We are making enhancements to the 2009 Mystery Shop program to improve the quality of the evaluation and make it easier for you to leverage results to assist in improving QSC in your restaurants. The changes that will take effect for all mystery shops conducted in 2009 and beyond are: Elimination of some unscored or non-QSC Questions All Crew member names and descriptions Satisfaction with Speed of Service Response Time changed to a non-Timing Question New Question: Was your order taken in an acceptable amount of time? (Yes / No) No opportunity for bonus points Improved Shopper Training and Tools Specialized timing device to help capture Service Time and Total Experience Time Better alignment of shopper training and tools Enhanced Restaurant Report Format Incorporates CSO messaging and trending Simpler, easy-to-read format Rationale for Mystery Shop changes is on last page of this guide What to Expect New report form and changes to response time will take effect for all shops conducted after January 1, 2009 Inquiries on any 2008 shop will only be accepted through January 10, mystery shop results will be displayed on the Performance Matrix after January 20, 2009

2 Provides current visit information including comparisons to trending of historical performance. Overall Mystery Shop scores Number of critical drivers missed during a visit Question level achievement Diagnostic details on all questions missed Shopper comments Page 2: CSO Reporting and Trending Page 3: Restaurant Ranking and Areas of Focus Page 1: Current Mystery Shop Results CSO is a very powerful metric on a Trailing 12 Month (TTM) basis because there are enough shops within 12 months to give you a realistic indication of performance. This page shows you: TTM and Year To Date CSO and comparison to the comparable prior period Question level trending and critical driver achievement Supporting driver (non-CSO question) performance Open space for notes Provides headlines on the restaurant’s ranking, top areas of opportunity and areas most improved: DT and DI rankings within the country Areas of opportunity – most missed questions Areas that have shown the most improvement over the last 6 months Open space for notes OVERVIEW OF MYSTERY SHOP RESTAURANT REPORT CHANGES We heard you! Your feedback has been incorporated into a newly enhanced restaurant level mystery shop report. It is shorter, easier to read and has a significant amount of CSO information on it. Each page of the report is described below:

3 Page 1: Current Mystery Shop Results Page 1 provides details of the mystery shop most recently conducted. Two sections are displayed below: 1) visit information and trended scoring and 2) visit details. Current visit shows Mystery Shop score for Drive Thru and Dine In. Also indicates the number of critical drivers missed versus the total number of critical drivers evaluated on this visit. CSO questions are indicated with an * = Missed Question = Achieved Full Points Diagnostics: If the question is missed, this section provides the diagnostic reason why Historical Trending: Shows Drive Thru and Dine In scores for Year to Date and Trailing 12 Month (TTM) performance (calculations include the current visit). Both show a comparison to the same comparable period. = Performance Decline = Performance Improvement Percentage represents the total number of points achieved divided by the number of possible points for that category Number of points a question is worth Notes: If your shop combines a Drive Thru and Dine In experience, remaining non-scored QSC questions will appear on the last page of the report If your shop conducts the Drive Thru and Dine In experience separately, remaining non-scored QSC questions will appear on this page of the report

4 Page 2: CSO Reporting and Trending Page 2 of the Mystery shop report provides CSO trending at the overall and question levels. The top section provides comparisons on TTM and YTD while the following sections display question level information. Indicates how the restaurant is performing on a Trailing 12 Month (TTM) basis from a CSO perspective with a comparison to the previous Trailing 12 Months. Year to Date (YTD) CSO tells how the restaurant is performing on a calendar year basis. This section will NOT be populated until April when the CSO trend has been established. Shop results for each critical driver are displayed for the last 12 months with the current shop (left) to oldest shop (right) Question level trending categories are: 1)Drive Thru Critical Drivers (CSO Questions) 2)Dine In Critical Drivers (CSO Questions) 3)All other DT and DI Questions (non-CSO Questions) All of these categories have the same format (shown below) For timing questions, if the standard is not achieved, the number will be in bold italics. If it is TET, and the critical driver is missed as well, it will have a symbol next to the seconds Question order is dynamic based on percent of time the critical driver was missed = Performance Decline = Performance Improvement = Visit missing one or more critical drivers = Visit achieving all critical drivers If critical driver is achieved, area will be blank. If it is missed, there will be an symbol Notes: There is also identical charts for Drive Thru and Dine In performance If this restaurant is a Dine In only, all shops conducted in a 12 month period will be listed.

5 Page 3: Restaurant Ranking and Areas of Focus The purpose of this page is to provide your restaurant with headlines on your ranking, top areas of opportunity and areas most improved. Your restaurant’s ranking based on the Trailing 12 Month CSO performance versus all the restaurants in highest hierarchy level listed. Variances show how your restaurant’s Drive Thru and Dine In CSO scores compare to the hierarchy levels listed. Top Improvement Areas are questions that have been achieved in the last 3 months but were missed at least twice in the previous 6 months. Top Opportunities are the mystery shop questions that were missed the most often and most recently in the last 12 months. In order to qualify as a top opportunity, the question must have been missed at least 3 times in the last 12 months. Shows the questions that have the largest opportunity for improvement based on when and the number of times the question was missed in the last 12 months. Indicates the number of times missed in last 12 months. Indicates the top reason the question was missed. A reason is listed only if the reason has been chosen more than once. Note: TET can be listed twice. 1) If the standard is not achieved (<=210 seconds) and/or 2) if the critical driver criteria is not achieved (<=300 seconds) Notes: If your restaurant does not have a Drive Thru, there will be no Drive Thru ranking provided Hierarchy levels will be defined by each country CSO questions are indicated with an *

6 Overview Throughout 2008, the mystery shop working team (made up of representatives from each area of the world) assisted in identifying areas of improvement that will have the greatest positive impact on the credibility, accuracy and adoption of the Global Mystery Shop program over the next several years. The general guidelines the team used to help define the areas of focus were: Provide better and more actionable information to the restaurant Focus on trends versus one shop Continually decrease inquiry rates and improve the perceived credibility of the program Simplifying and Decreasing the Observations a Shopper Captures We want mystery shoppers focused on capturing the critical operational standard information that will help us drive CSO performance. Therefore, the team looked at the number and complexity of observations the shopper is required to gather and streamlined them. The following changes will decrease the number of observations by 15-20%. All Crew members names & descriptions will not be captured When the Mystery Shop program started, crew members names/descriptions were used to validate that the shopper went to the correct location. This added approximately 15% more shopper observations. Receipts are now gathered to validate that the shopper went to the correct location, so we will no longer require the shopper to capture any crew member’s name or description. However, the shopper will have the ability to indicate a crew person’s name if the experience is extraordinary in the shopper comments. Satisfaction with the speed of service will not be asked This question was originally used to analyze how important speed was to our consumers. Now that we know that speed is important to our customers (validated in other tools available today), this question is no longer needed to understand this. Since it is not being used anymore, we are eliminating it. Response Time changes to a Non-Timing Question Today, the shopper is doing simultaneous activities (observing cleanliness, listening for a greeting, driving, ordering, etc) while they are capturing the majority of our timing points. To decrease the complexity of these simultaneous activities, we will no longer ask the shopper to capture the exact number of response time seconds. Instead, we will ask them to evaluate their perception (without a timing device) of response time with guidance that being asked for your order should take no more than 10 seconds. The question will now read “Was your order taken in an acceptable amount of time.” If the shopper marks the question “no”, then they will have the ability to add additional comments if the situation warrants. The question will still be worth 2 points – but there will be no opportunity for bonus points. Improved Shopper Training and Tools We have spent a significant amount of time analyzing the training materials and gathering feedback from shoppers on how to improve the guidelines we provide them. Based on that feedback, we will be focusing on improving shopper training in the following areas: Create more effective training in the Fast and Friendly areas that is easier to understand with more visual aids Test a custom timing device in top markets to make it easier for the shopper to record accurate timings Simplify shopper instructions and shopper data entry screens Enhanced Mystery Shop Restaurant Report Format We received substantial feedback in the last year that the mystery shop report had too much information, was too long / confusing and had no CSO messaging in it. Therefore, the working team developed an enhanced restaurant level report that is shorter, simpler, easier to read and has a significant amount of CSO information on it. Rationale for Mystery Shop Changes