1. multirater.com

2. SIOP ‘99 Slide - 2 multirater.com Behind the Scenes of a Web-Based 360 Feedback Process Keith Rettig

3. SIOP ‘99 Slide - 3 multirater.com Background High tech company Webmaster-for-hire Responsible for providing –Technological innovation –Internet expertise –Quality of Service I/O domain knowledge –Not required –But definitely beneficial Web site hosting & design domain knowledge –Absolutely required

4. SIOP ‘99 Slide - 4 multirater.com What You Should Expect From Your Vendor/Webmaster A “Can-Do” Attitude Should be coming to you with ideas If your survey, then fully customized interface If their survey, then fully personalized interface Number of Ratees is inconsequential –Largest cost factor (second to setup of hardware & software)

5. SIOP ‘99 Slide - 5 multirater.com What You Should Expect From Your Vendor/Webmaster (continued) Number of Raters is even more inconsequential Security –Data –Confidentiality –Anonymity Savings –Cost –Time –Administration problems

6. SIOP ‘99 Slide - 6 multirater.com Web-based 360˙ Benefits Cost savings Time savings Global access 24-7 availability Immediate processing Targeted surveys Targeted reminders

7. SIOP ‘99 Slide - 7 multirater.com Web-based 360˙ Benefits Targeted second reminders... Data, data, data! –Always up-to-date and always available Paperless office –Paper “less” office at least? –Please? Cost savings

8. SIOP ‘99 Slide - 8 multirater.com Interesting Facts 88% Return Rate! –90% if you include the raters who opted out 6420 Surveys completed –of which ¥769 were declines ¥of which –225 were auto-declined by system –127 were actual raters declining –417 were deleted for other reasons

9. SIOP ‘99 Slide - 9 multirater.com Interesting Facts (continued) 320 Ratees have completed the process ¥21 Raters per ratee average ¥Minimum 1 Rater ¥Maximum 40 Raters Rater types requested ¥328 Supervisors ¥1828 Direct reports ¥1781 Indirect reports ¥2169 Peers ¥0 Customers ¥306 Self reports

10. SIOP ‘99 Slide - 10 multirater.com Interesting Facts (continued) Rater confidentiality settings ¥3192 requested maximum level ¥1964 requested minimum (328 supervisors) Rater additional comments ¥2495 raters –44% of responding raters –52 words on average –39% overall for all surveys –21 words on average for all surveys

11. SIOP ‘99 Slide - 11 multirater.com Ideas Anyone? Training selection –Manual –Automatic Enhanced descriptions with each item “Wizard” type approaches to scoring Item branching Culture shaping

12. SIOP ‘99 Slide - 12 multirater.com Ideas Anyone? (continued) Linkage with other data –Organizational Structure –Performance –Pulse Surveys –Corporate Index Enhanced reporting –Automatic feedback by system ¥Based on item score ¥Based on multi-item scores –Link to training materials Real-time full-time 360˙ process