Presentation is loading. Please wait.

Presentation is loading. Please wait.

Today’s lineup… How do we measure impact in different contexts/fields? How do we rank people and things? How do we determine expertise? How do we traditionally.

Similar presentations


Presentation on theme: "Today’s lineup… How do we measure impact in different contexts/fields? How do we rank people and things? How do we determine expertise? How do we traditionally."— Presentation transcript:

1 today’s lineup… How do we measure impact in different contexts/fields? How do we rank people and things? How do we determine expertise? How do we traditionally look at “impact” in science and academic realms? (bibliometrics and citation analysis) Are traditional methods of measuring impact changing? If so, how?

2 how do we rank things & people in terms of impact?

3 Forbes Most Powerful People (2015)

4 Forbes Most Powerful People (2015)
power over lots of people control large financial resources powerful in multiple spheres actively use their power

5 page rank

6 How do we traditionally look at “impact” in science and academic realms?

7 Math / Statistical Analysis
BIBLIO METRICS Books Publications Bibliography Count Measurement Math / Statistical Analysis

8 Journal of Documentation (1969) 25(4):348-349
Alan Pritchard 1969 Coined the term "bibliometrics" "the application of mathematics and statistical methods to books and other media of communication“ Journal of Documentation (1969) 25(4):

9 Journal of Mammalogy, Vol. 64, No. 3. (Aug., 1983), pp. 387-396.

10 CITED CITING

11

12

13 seminal work

14 co-citation these two articles are likely related author institution
topic country language journal these two articles are likely related

15 what is citation analysis?
utilizes quantitative analysis and statistics to describe patterns of publication within a given field or body of literature [Write on board: relationships amongst reference lists]

16 what do you do with citation analysis?
researchers may use bibliometric methods of evaluation to determine the influence of a single writer, for example, or to describe the relationship between two or more writers or works production and productivity impact co-publication patterns connections between subject areas

17 useful to you…right now
Articles that cite the article you found may be of similar interest some databases include info/links (cited in this database) Google Scholar also offers this feature

18 useful to you…right now
Articles that cite the article you found may be of similar interest some databases include info/links (cited in this database) Google Scholar also offers this feature If other publications are citing a source, that may lend credence to its importance/impact useful in evaluating a source

19 After watching the first Web of Science video, I discovered what citation tracking was and how it can be beneficial for researchers. But, what I thought was interesting was that an article could be cited hundreds of times and this could mean the article was either really good or maybe really bad. How can you tell whether an article is receiving attention and being cited frequently for correct or incorrect information? It would be easy to assume that because an article is cited many times that it means it was accurate and interesting.  -Dorian Famous or infamous?!?

20 Ethics in scholarly communication

21 http://stanford. edu/~dbroock/broockman_kalla_aronow_lg_irregularities

22

23

24 Index of Citations

25 Institute for Scientific Information Building, Philadelphia
Architect: Venturi, Scott Brown and Associates, Completed 1977

26 ISI SCI SSCI A&H JCR

27 Arts & Humanities Citation Index
authors co-cited most often with…WHITMAN-W Author Co-Citation

28 80’s

29 90’s

30 00’s

31 Science Citation Index

32 Journal Impact Factor for The New England Journal of Medicine
Number of items published in: 2013 348 2012 360 Sum of recent items 708 Cites in 2014 to items published in: 18682 Cites in 2009 to items published in: 20876 Sum of recent citations 39558 Journal Impact Factor 2014 39558 / 708 55.873

33 Social Sciences Citation Index

34 Social Sciences Citation Index

35 >> E-Research by Discipline >> Frequently Used
>> E-Research by Discipline >> Frequently Used >> Web of Science (ISI) Example: Dr. Aziz Sancar, Nobel Prize in Chemistry

36 Referees revision for journal Journal final version
Idea Present to colleagues Present at conference Submit to journal Referees revision for journal Journal final version Revision to update analysis Revision to include additional new results Scholarly communication process Traditional example

37 Scholarly communication process What’s captured traditionally
Journal final version Scholarly communication process What’s captured traditionally Only one version is captured, and the same community then pays to buy back access to article

38 How is scholarly communication changing?
Think of scholarly communication as continuous process instead of single product (journal publication). Capture significant changes/versions of a work. Include all criticisms and comments about work (all stages). Support normal scholarly discourse, including authors responses as well as others’ comments. Add reviewer’s quantitative rating of material to allow better filtering based on absolute quality metric during retrieval. Add machine (automated) reviews. Include other forms of information (audio, pictures, video, graphs, datasets, statistics)

39 My question regarding that is if this increased cloud sourcing will help or hurt? Having more eyes on something normally means it reviews better, but as the article stated you are at the whim on the mob masses. If it is seen by the wrong eyes it may not be vetted correctly. Is the trade off worth it for more eyes to review the literature if someone of those may not be qualified? -Jennifer

40 traditional metrics pros cons alternative metrics

41 Provocative Questions for Discussion
What/why do you (and scholars cite? What do you infer from a reference list? Are all citations equal? Provocative Questions for Discussion

42 points to take away Cite sources you use
Supports your case/research Avoid plagiarism Places your work within scholarly dialogue Use reference lists to find additional/relevant material Look for material that cites your source – will be more recent Web of Science can also be used as a regular lit database

43 APA Publication Manual (style guide) – answers to last week’s quiz…


Download ppt "Today’s lineup… How do we measure impact in different contexts/fields? How do we rank people and things? How do we determine expertise? How do we traditionally."

Similar presentations


Ads by Google