multirater.com

SIOP ‘99 Slide - 2 multirater.com Behind the Scenes of a Web-Based 360 Feedback Process Keith Rettig

SIOP ‘99 Slide - 3 multirater.com Background High tech company Webmaster-for-hire Responsible for providing –Technological innovation –Internet expertise –Quality of Service I/O domain knowledge –Not required –But definitely beneficial Web site hosting & design domain knowledge –Absolutely required

SIOP ‘99 Slide - 4 multirater.com What You Should Expect From Your Vendor/Webmaster A “Can-Do” Attitude Should be coming to you with ideas If your survey, then fully customized interface If their survey, then fully personalized interface Number of Ratees is inconsequential –Largest cost factor (second to setup of hardware & software)

SIOP ‘99 Slide - 5 multirater.com What You Should Expect From Your Vendor/Webmaster (continued) Number of Raters is even more inconsequential Security –Data –Confidentiality –Anonymity Savings –Cost –Time –Administration problems

SIOP ‘99 Slide - 6 multirater.com Web-based 360˙ Benefits Cost savings Time savings Global access 24-7 availability Immediate processing Targeted surveys Targeted reminders

SIOP ‘99 Slide - 7 multirater.com Web-based 360˙ Benefits Targeted second reminders... Data, data, data! –Always up-to-date and always available Paperless office –Paper “less” office at least? –Please? Cost savings

SIOP ‘99 Slide - 8 multirater.com Interesting Facts 88% Return Rate! –90% if you include the raters who opted out 6420 Surveys completed –of which ¥769 were declines ¥of which –225 were auto-declined by system –127 were actual raters declining –417 were deleted for other reasons

SIOP ‘99 Slide - 9 multirater.com Interesting Facts (continued) 320 Ratees have completed the process ¥21 Raters per ratee average ¥Minimum 1 Rater ¥Maximum 40 Raters Rater types requested ¥328 Supervisors ¥1828 Direct reports ¥1781 Indirect reports ¥2169 Peers ¥0 Customers ¥306 Self reports

SIOP ‘99 Slide - 10 multirater.com Interesting Facts (continued) Rater confidentiality settings ¥3192 requested maximum level ¥1964 requested minimum (328 supervisors) Rater additional comments ¥2495 raters –44% of responding raters –52 words on average –39% overall for all surveys –21 words on average for all surveys

SIOP ‘99 Slide - 11 multirater.com Ideas Anyone? Training selection –Manual –Automatic Enhanced descriptions with each item “Wizard” type approaches to scoring Item branching Culture shaping

SIOP ‘99 Slide - 12 multirater.com Ideas Anyone? (continued) Linkage with other data –Organizational Structure –Performance –Pulse Surveys –Corporate Index Enhanced reporting –Automatic feedback by system ¥Based on item score ¥Based on multi-item scores –Link to training materials Real-time full-time 360˙ process