1. Score room CM’s Name Here
DI Score Room
Appraiser Training 2017
Score room CM’s Name Here

2. Score Room Masters Useful email addresses Cell Phone Numbers
Explain aim/icq etc
Give bkgd about first time to do this

3. Important Websites
Destination Imagination
Your Region Destination Imagination
Score Site
DI Appraiser Basics
How did pokemon get there…?
Go over pdf
Web browsers
Explain… really bored = acropolis
addresses
Questions

4. Overview of the Training
2017 Challenges
Score Room Mission
Paperwork Flow
Scoring Considerations
Individual Jobs for Score Room
Handling Problems
Final Thoughts
Will go into more detail throughout

5. 2017 Challenges

6. Example Challenges & Colors
A: Show & Tech (Tech) Orange/Salmon
B: Top Secret (Secret) Yellow
C: Vanished! (Vanish)   Blue
D: 3-Peat (Peat) Pink/Red
E: In It Together (Together) Green
PO: Ready, Willing & Fable (Fable) Grey
IC     Purple
Score room   Black
Save the Day   White
We like to color code everything for easy sorting. Consult your RD/AD for their choice of colors!

7. General Procedures When? Report to Score Room by 9:00
Leave time for Breakfast and Sign in before this
We’ll be working until about 5:30 (we hope!)
Access to the room is limited
Not a place for visiting or hanging out
All paperwork is logged in and out of the room
Refer anything unusual to the room leaders
This allows everyone else to continue processing the “normal” scores, keeping the flow going
Add to the bottom, take from the top
This keeps paperwork flowing in time order

8. Primary Mission
The primary Mission of a DI Score Room is to provide the announcer at the conclusion of a tournament with an accurate list of place finishes for the teams that competed at that tournament.
Help keep the tournament running smoothly
Get everyone home at a reasonable hour
Goal: All scores Complete 1 hr before the award ceremony
Accuracy
Efficiency
Timeliness

9. Accuracy is foremost. Score Room Mission Never erase a score
Procedures result in all scoring operations being done twice by independent people.
These two people must agree on the resulting computation.
If in doubt ask your CM or send back to appraiser to correct
Never erase a score
Initial ALL changes

10. Efficiency is secondary to Accuracy.
Score Room Mission
Efficiency is secondary to Accuracy.
Efficiency is defined as computing the final scores by the time that the Tournament Director expects them to be done.
Typically final scores are available about an hour or less after the last team performance.

11. Timeliness Score Room Mission Process paperwork ASAP
Don’t Hold on to Packets!
Process Packets in order (first in first out)
Process and move on to the next step, then file!
Have everything completed well before the scheduled awards ceremony

12. Individual Responsibilities
Appraiser – Site, not score room personnel
Appraisal Team Organizer- Site
Score checkers
Computer operators
Score runner
Gate keeper
Paperwork Manager
Score Room Challenge Masters

13. Paperwork Flow - Central
Appraisers
Appraisers
Challenge Sites
Appraisers
Appraisers
Appraisers
Head Appraiser
Appraisal Team
Organizer
Team Manager
Runner
Logs all
Time(s) In
Time(s) Out
Score Room
Gate Keeper
Results TM, HA
Checker (optional)
Final Score
storage area
Data Entry 1
Paper Work Manager
File Manager
Data Entry 2

14. Central Score Room Sample Layout
Gate Keeper
Check In
Check and Backup
Printer / Copier
Backup
Data Entry 1
Data Entry 2
Checker
(optional)
Data Entry 1
Tournament Master
Data Entry 2
Set up a logical flow for your room. Best to have the paper moving in one general direction. Start filing early and keep it up throughout the day.
Paper Flow
Data Entry 1
Final Score
storage area
Data Entry 2

15. Scoring Guidelines Objective - Non-averaged scores Zero Score
0, 5, 10, 15
all appraisers must agree
Subjective - Averaged scores
USS Appraiser ranges 1-30
will vary between appraisers
Rounding – Score program does this for us
2 digits to right of decimal > .67 and .333 > .33
Zero Score
if element is not present
all appraisers scoring that element must agree it was not there
Deductions
all appraisers must agree
% of the points earned
reason(s) must be noted
Deduction Worksheet with highlighted entry

16. Appraiser Complete the Appraiser Score Sheet
Must complete all assigned items and no more!
Must be legible
Must agree on all deductions, zero scores or non averaged scores (0, 5, 10, 15)

17. Appraisal Team Organizer
Collect Appraiser forms, envelope and all paperwork from the team.
Check for legibility and any missing items
Place all paperwork in envelope, give to runner to deliver to checker & Computer Operator
Receive Head Appraiser and Team copies from computer operator - log times in for Head Appraiser.
Log times when team has received their copy

18. Making up the Score Packet
Team label on the upper left corner of envelope
Please put the papers in this order
Deductions worksheet if there is a Deduction
Weigh-in (Check In) sheet (Challenge E Only)
Appraisers sheets
In Order (Alpha or Numeric)
Prep area sheet
Everything else last
Small Envelope with Award Certificates
Team manager Copy of scores also goes in when complete
Stickies on the special stickies sheet stay at the appraisal site to give back to Team manager with team scores
ONLY positive comments! Trash inappropriate ones…
Label
Status Dots

19. Score Checkers
Check incoming score sheets for completeness & legibility
Check Weight held calculation (Challenge E)
Write initials next to calculation
Check order of paperwork
Deduction Work sheet
Weigh-in Sheet (Challenge E)
Appraiser sheets (in order)
Prep Area sheet
extra material last
Pass to Computer Operators.

20. Score Checker Ensure Legibility Common Errors Subjective vs Objective
Objective all must agree
Range
Deductions

21. Checking Scores
Never have two team’s paperwork out in your work area at once!
If your Head Appraiser needs you to look at something, put the current team’s paper away!
After checking, please put the score sheets in the order that they appear on the printed Appraiser Assignment sheet form before sending to score room.

22. Score Runners Very Important Job!
Introduce yourself to Head Appraiser, Appraisal Team Organizer and Gate Keeper
Pick up completed score packets from competition sites
Team challenges
Instant challenges
Deliver score packets to score room check-in
Make scheduled runs

23. Computer Operators - Central
Will use provided Computers & Printers
Computer Proficiency very helpful!
Importance of accuracy in typing numbers
1st Entry Operators
Enter scores from appraiser sheets
Place all remaining paperwork in team envelope and pass to 2nd entry computer operator
2nd Entry Operators
Re-enter scores from appraiser sheets
Check is automatically done when saved
Occasionally enter bad data to verify check
Print 1 Team, 1 Head Appraiser and 1 Score Room Copy
Score Room Copy into envelope
Team and HA copies get returned to site in folder
Can download program and be familiar with it

24. Gate Keeper / Check In Accept all incoming packets
Using Check In Computers and Program
Log in and out times on IC/TC
Log out paperwork leaving score room for questions
Do not let unauthorized individuals in score room

25. Paperwork Manager
Pick up incoming folders from gatekeeper and transfer to the correct computer operator
Pick up completed folders from Computer Operators
Deliver HA and Team score printouts to return folder
File folders in appropriate boxes by challenge and update checklist
If scores are pulled after filing, hand walk the returned envelope to computer operators and identify actions needed

26. Score Room Challenge Master
Knowledge of
the challenges
scoring program
how calculations are done
all score room jobs
Recruit and train
appraisal team organizers
score room personnel
There to help with any questions or issues

27. How to Handle Issues Talk with your score room leader
Mark team with an Issue in the program
Enter explanation in Modify Team dialog box
Use “yellow sticky” to describe issue
Put all paperwork in the package in order
Put on a red sticker
Log team red in the Check-In program
Return to team challenge room for correction

28. Processing Issues (cont.)
When a red sticker packet comes back in
Log it in at Check-In
Goes to head of the queue for the first computer
It is an older packet than those we’re processing
Could be from
A change we requested
A change the Head Appraiser is requesting
Partially cover red sticker with green sticker

29. Sticker Management
Good packet after 1st entry – put a green sticker on packet
Bad packet during 1st entry – put a red sticker on packet – return for problem resolution
Good packet after 2nd entry and check – initial green sticker – Send to File
MJA
Bad packet during 2nd entry – add red sticker – return for problem resolution
Problem resolved and re-run through 1st entry – add a green sticker
Good packet after 2nd entry and check – initial green sticker – Send to file
MJA

30. Practice Some people will not be doing data entry
Everyone should be familiar with the scoring program
In case of illness, etc.
Help during breaks
If you haven’t used it before, please download it and practice

31. Scoring Goals
Ensure that every team gets the full credit they deserve for their challenge solution
And only the credit they deserve
Turn scores around promptly
Allows team managers to review them
Maintain the confidentiality of the scores
Never leave your paperwork unattended
Let everyone get home at a reasonable hour
Have fun in the process

32. QUESTIONS!
Ask and we’ll see if we can answer.

33. Computer Entry Demo Note: Screenshots are of last year’s challenges but procedure is the same for 2016

34. Tournament Summary Window
Scoreboard for the tournament
number of teams
number whose scores are incomplete
when they should finish
when the scores were printed
Drill down to a challenge level

35. Drilling Down to Enter Scores
List of teams in a challenge level
performance time
status
being scored?
TC done?
IC Done?
A good tip is to have your computer operator use the quick search when selecting the team to enter digits of the team number is usually all it takes to narrow down to a singe team. Avoids accidentally entering results on the wrong team!

36. Entering Scores Data entry of all appraisers’ scores
Computer verifies ranges
Verifies appraiser agreement for objective scores
Computer calculates it all
Computer scales the final results and prints them

37. Error Checking

38. Entering Item-Specific Deductions
Click on the square checkbox to the left of the item’s title
Fill in the deduction value and the reason
Note that deductions can be a percent of the awarded score (not the max score!)
Click on “OK” to close the deduction dialog box

39. Entering “Other” Deductions
Deductions are not normally editable as a safety measure.
To enable:
Right click in the score area
Select “Modify Deductions”
Or, “Alt-D” for you keyboard types
All deductions MUST have a reason
Entered in the second computer

40. All Challenge Level Window a VERY useful tool!
Use with Quick Search!
Quick search is a lifesaver to quickly find a team if you don’t know for sure what challenge / level.

41. Issues Form (Modify Team dialog)

42. Thank You!
… for your time.
… for your generosity.
… for your service.
… for all you do.