1. One Click One Revisited: Enhancing Evaluation Based on Information Units Tetsuya Sakai 1 and Makoto P. Kato 2 1 Microsoft Research Asia, P.R. China tetsuyasakai@acm.org 2 Kyoto University, Japan kato@dl.kuis.kyoto-u.ac.jp AIRS 2012

2. Introduction 2

3.  The output of 1CLICK systems 3

4. Task and Data 4

5. 5

6. 6

7. Effect of the Patience Parameter 7

8. 8

9.  The LOCAL query “Menard Aoyama Resort” (name of a facility) 9

10. Results on the Patience Parameter 10

11. 11

12. 12

13. 13

14. 14

15. System Ranking by Different Metrics 15

16.  The QA query “The three duties of a Japanese citizen.” 16

17. 17

18. 18

19. Conclusions  The One Click Access Task (1CLICK) is one of the tasks of NTCIR that requires systems to return a concise multi- document summary of web pages in response to a query which is assumed to have been submitted in a mobile context.  Furthermore, we introduce the next round of the 1CLICK task called MobileClick, in which participants are required to submit a two-layered summarization suitable for mobile information access. 19

20. Thanks Y. Hou et al. (Eds.): AIRS 2012, LNCS 7675, pp. 39–51, 2012. © Springer-Verlag Berlin Heidelberg 2012 20