1. Open Access Citation Index Services Tim Brody Intelligence, Agents, Multimedia Group University of Southampton

2. 20th February 200620-21 February 2006, Berlin, Humboldt University 2 Content A slightly irreverent look at evaluation and metrics in science … based on Open Access

3. 20th February 200620-21 February 2006, Berlin, Humboldt University 3 Publish or Perish = 10 =

4. 20th February 200620-21 February 2006, Berlin, Humboldt University 4 Publish in a high impact journal or Perish ? Nature = 32.182 ACM Comput Surv = 10.037 IEEE T Inform Theory = 2.029 =2.029 * 10 = 20 ? Publish or Perish

5. 20th February 200620-21 February 2006, Berlin, Humboldt University 5 Impact Factor = Author Impact? “Use of journal impact factors conceals the difference in article citation rates (articles in the most cited half of articles in a journal are cited 10 times as often as the least cited half)” P.O. Seglen BMJ 1997;314:497

6. 20th February 200620-21 February 2006, Berlin, Humboldt University 6 Author Impact Factors … ?

7. 20th February 200620-21 February 2006, Berlin, Humboldt University 7 Names are tricky … What’s a eukaryote?

8. 20th February 200620-21 February 2006, Berlin, Humboldt University 8 But what about my IR record? eprints.ecs.soton.ac.uk =

9. 20th February 200620-21 February 2006, Berlin, Humboldt University 9 … if I could couple my publication record with a citation index?

10. 20th February 200620-21 February 2006, Berlin, Humboldt University 10 But I don’t have many citations … Citebase does track downloads of my papers (in ECS EPrints, UK arXiv.org) 

11. 20th February 200620-21 February 2006, Berlin, Humboldt University 11 The trouble with metrics … Should Lammel, S get +124 downloads? (* 628 authors)

12. 20th February 200620-21 February 2006, Berlin, Humboldt University 12 Perhaps the answer lies in many metrics …

13. 20th February 200620-21 February 2006, Berlin, Humboldt University 13 Tim Brody’s Impact Indicators Main-author: 3 papers Contributed to: 10 papers Presented at: Humboldt University Published in … –JASIST (= 2.086 IF) –ECDL Proceedings Been cited … 3 times (/ author position?) Been downloaded … 1100 times ‘Ranked 154 of 213 researchers in field …’

14. 20th February 200620-21 February 2006, Berlin, Humboldt University 14 Practicalities for … Open Access Citation Index Services Journal Publications are (for the foreseeable future) the gold standard –Can’t escape the need for journal metadata –Peer-reviewed/non-Peer-reviewed metrics Author self-archived e-prints facilitate: –Open Access Citation Services –Usage impact experiments (Web Impact Factor?) –(n.b. Increased Citation Impact)

15. 20th February 200620-21 February 2006, Berlin, Humboldt University 15 IR Implementation Needs e-print  journal manifestation linking –[combined usage/citation impact] e-print refs (and/or full-text?) export –[copyrighted e.g. book = citation + refs] e-print usage export (weblogs) authoritative publication lists … reference linking

16. 20th February 200620-21 February 2006, Berlin, Humboldt University 16 Where to Reference Link Reference linking at the source –Distributed citation index (IRs+Journals) Scalable/sustainable model for a free ‘virtual’ citation index? –IR reference linking tools/services allow authors to correct citation links –Existing structured XML from publishers –Rich OAI export (OpenURL, DIDL, METS etc.)

17. 20th February 200620-21 February 2006, Berlin, Humboldt University 17 Parsing/Linking elsewhere … Centralised/Commercial: –ISI WoK will do the job? Layered: –Reference Linking ‘middleware’ e.g. through national OA citebases Centralised/Subject: –NASA ADS, Citeseer, … –Sustainability? Duplication of effort?

18. 20th February 200620-21 February 2006, Berlin, Humboldt University 18 The Goals What technical solution will best achieve … –Promote research incentives –Experimentation and competition –Transparency

19. 20th February 200620-21 February 2006, Berlin, Humboldt University 19 Thanks for listening! Tim Brody ISI Web of Science, JCR (2004) http://eprints.ecs.soton.ac.uk/ http://www.citebase.org/ P.S. eukaryote is a single-celled or multicellular organism whose cells contain a distinct membrane-bound nucleus.