Consistency During Search Without Stagnation Jaime Teevan teevan@microsoft.com Microsoft Research

Log analysis that shows people click on old and new results when returning to result pages. (27% of repeat searches click on new results!)

26% of time repeat searches at different rank. 94 seconds to re-click v. 192 seconds to re-click.

“Pick a card, any card.”

Case 1 Case 2 Case 3 Case 4 Case 5 Case 6 Abracadabra! Case 1 Case 2 Case 3 Case 4 Case 5 Case 6

Your Card is GONE!

People Forget a Lot

Change Blindness

Change Blindness

We still need magic!

Memory a Function of Rank Last result clicked more likely to be remembered (12%)

Remembered Results Ranked High Anecdote: include www.mlb.com in search for Red Sox Suggests the actual result list a person saw before might not look exactly like they remember it.

Intelligent Merging Supports Re-Finding and New-Finding Intelligent merging better than other mergings Almost as good as using the original list New-finding Knowledge re-use can help No difference between new list and Intelligent

Jaime Teevan teevan@microsoft.com Microsoft Research