1. STIMULATE 5 Ronald Rousseau Web page: users.telenet.be/ronald.rousseau

2. Citation analysis Advanced parts Bibliographic coupling Co-citation Citation context analysis The Journal Citation Reports (JCR) Bibliometric indicators

3. Bibliographic coupling and co-citation

4. Co-citation network

5. Co-citation measures

6. Citation context analysis Cited documents become symbols for the ideas they contain. Highly cited documents can be considered as exemplars or concept symbols: illustrations of methods or theories which comprise the essential repertoire of techniques in a specialty.

7. Citation analysis of scientific journals The Journal Citation Reports (JCR) The annual publication of the JCR by ISI (nowadays Thomson-ISI) has led to a whole series of indicators. Of these the journal impact factor is the best known.

8. The publication – citation table Publ year 20002001200220032004 # Publ.35 40 45 # cit rec’d in 2000 5 # cit rec’d in 2001 105 # cit rec’d in 2002 15105 # cit rec’d in 2003 1520126 # cit rec’d in 2004 101216108

9. The ISI impact factor (synchronous) Publ year 20002001200220032004 # Publ.35 40 45 # cit rec’d in 2000 5 IF(2003) = # cit rec’d in 2001 105 (20+12)/ (35+40) # cit rec’d in 2002 15105 =0.427 # cit rec’d in 2003 1520126 # cit rec’d in 2004 101216108

10. Mathematical formulas: the general synchronous impact factor (Rousseau, 1988) CIT(Y-2,Y) + CIT(Y-1,Y) IF(Y)= --------------------------------- = IF 2 (Y) PUB(Y-2) + PUB(Y-1)

11. Diachronous impact factors Publ year 20002001200220032004 # Publ.35 40 45 # cit rec’d in 2000 5 DIF 3 (2002) = # cit rec’d in 2001 105 (5+12+16) / 40 # cit rec’d in 2002 15105 = 0.825 # cit rec’d in 2003 1520126 # cit rec’d in 2004 101216108

12. Mathematical formulas: the general diachronous impact factor

13. The source – item table Period of origin Period 1Period 2Period 3Period 4Period 5 # sources 303540 45 # items period 1 5 # items period 2 105 # items period 3 15105 # items period 4 1520126 # items period 5 101216108

14. Examples of general source-item relations Scientific journal  (publishes) articles  (receives) citations Scientific journal  (publishes) issues  (receives) citations Scientific journal  (publishes) one particular issue  (receives) citations Congress proceedings  (consists of) articles  (receives) citations Institute  (publishes) webpages  (receives) inlinks (the institute web impact factor) Country  (publishes) webpages  (receives) inlinks (from other countries) (country web impact factor) Fiction author  (writes/publishes) books  (realizes) sales Country  (publishes) articles in a particular domain  (receives) citations Journal  (publishes) articles  (receives) citations in one particular journal

15. Generalized impact factors (Frandsen – Rousseau) Publ year 20002001200220032004 # Publ.35 40 45 # cit rec’d in 2000 5 # cit rec’d in 2001 105 # cit rec’d in 2002 15105 # cit rec’d in 2003 1520126 # cit rec’d in 2004 101216108

16. The median impact factor (MIF): a new impact indicator Here TOT denotes the total number of citations received by journal J in the year Y. CPUB(Y-X,Y) denotes the cumulative number of publications in the journal J, during the period [Y-X, Y]. The symbol X denotes the median cited age.

17. References SOMBATSOMPOP, N., MARKPIN, T., PREMKAMOLNETR, N. (2004), A modified method for calculating the impact factors of journals in ISI Journal Citation Reports: polymer science category in 1997-2001. Scientometrics, 60: 217-235. ROUSSEAU, R. (2005), Median and percentile impact factors: a set of new indicators. Scientometrics, 63: 431-441.

18. Example: Scientometrics MIF(2003) TOT(2003) = 1012  TOT/2 = 506 The median cited age is 6.53 The number of articles published during these 6.53 years is 591.75 The 2003 MIF of Scientometrics is 506/591.75 = 0.855 < ISI IF (1.251). YPubl – cum.sum CitCum cit % 0383222.17 0284-1679611.66 0191-25812323.81 0082 - 3408532.21 99128-4686838.93 9884-5527846.64 9775-6276452.96

19. Recent trends Not just the ISI 2-year synchronous impact, but a whole battery of impact factors are used in science evaluation.

20. What should be the real purpose of research evaluation? The real goal of any form of research evaluation is providing those people and institutions that have the talent and motivations to carry out scientific research, with the best conditions possible under which to do so (Russell-Rousseau, 2002).

21. Evaluation and scientometric research Budgetary and other kinds of constraints make evaluations necessary for the equitable distribution of resources. The evaluation of short-term strategic research as well as long-term curiosity-driven search for new knowledge demands the same rigorous standards as scientific research itself. For this reason the application of bibliometric and scientometric techniques in research evaluation must keep up with the rapid changes occurring in scientific communication patterns. Information scientists must also constantly improve the theoretical foundation for the construction of output and impact indicators supporting peer review (Russell-Rousseau, 2002)