Darrell W. Gunter EVP / CMO Collexis Holdings, Inc. March 23, 2010 Spring Conference CONTENT: Uncovering the Value and Benefits of Semantic Technology Case Study #2 - Enriching the editor’s experience with peer review

Topics for our discussion today The AACR situation The Collexis technology How the technology is applied to AACR’s situation The benefits of the solution

- The Situation AACR wanted to achieve the following objectives o Expand their Peer Reviewer pool o Find the best reviewer based on a key concept o Find the best reviewer free of conflict o Improve the efficiency and effectiveness of the Peer Review process

Collexis Technology KnowledgeBase Fingerprint Text

Expert profiles from documents Expert profiles are generated automatically from documents and publications By “simple” aggregation of the document fingerprints Right: Use of the expert profiles as “science marketing” by the John Hopkins University

The Peer Review Process Most important factor to ensure the quality of a journal Peer review process – challenges and problems o Workload for the editor and editorial team o Reviewers only coming from a "inner circle" o Avoiding incompetent reviewers o How to identify the best reviewer? o How to discover conflicts of interest? o How to balance the workload of reviewers? o How to make the larger part of the selection process as easy so that it can be handled by administrative stuff?.... but still ensure a high quality of selected reviewers!

Indexation Workflow Verification of fingerprinting results within seconds

Collexis Peer Reviewer Selection Chosing the right reviewers is one of the core processes to ensure the quality of a journal Identifying the reviewers is a very complicated and time-consuming process Collexis expert fingerprints and extensive data mining to ensure matching expertise and to avoid conflicts of interest

- the Foundation for Reviewer Selection Fully launched in April 2008, BME is the first pre- populated scientific social network generated from PubMed articles 1.8 million expert profiles generated with the Collexis disambiguation process More than 30 million co-authorship based relations 280,000+ registered users! Disambiguation quality is key for the success!

Disambiguating Authors By using our disambiguation methods, we can tell who’s who within a set of source documentation, ensuring that our ‘Fingerprint’ is an accurate proxy for that individual’s expertise. Using identifying elements, determine who’s who: Name Location Co-Authors Key Concepts more… John T. Smith JT Smith John Smith J. Smith

Disambiguating Concepts Searching for one concept doesn’t require that you know the technical MeSH term – the tools disambiguate concepts for you as well. Disambiguate searches based on: Synonyms Related terms Abbreviations So without knowing MeSH, you can navigate MeSH. A search for “neoplasm”

Applying Fingerprints to Organizational Units Aggregating individual fingerprints across organizational units allows for the organization to know what individuals know and what groups know together… DepartmentInstitute Research Group What new publications and have been published? Who are the emerging authors and where are they publishing? Who is working together? What are the emerging trends? What do we know? Individual Fingerprints Aggregated Fingerprints

4 Steps to the right reviewer Indexing the manuscripts – basic requirement for the Collexis Reviewer selection Identifying the author within the Collexis expert database BiomedExperts.com to be able to calculate shortest paths Match the submitted manuscript against the expert database biomedexperts.com Result example: matching expertise found, but a direct co-authorship between the author and potential reviewer

Reviewer Selection in 4 Steps Indexing the manuscripts – basic requirement for the Collexis Reviewer selection Identifying the author within the Collexis expert database BiomedExperts.com to be able to calculate shortest paths Match the submitted manuscript against the expert database biomedexperts.com Result example: matching expertise but only a single co-authorship degree of separation between author and potential reviewer

Reviewer Selection in 4 Steps Indexing the manuscripts – basic requirement for the Collexis Reviewer selection Identifying the author within the Collexis expert database BiomedExperts.com to be able to calculate shortest paths Match the submitted manuscript against the expert database biomedexperts.com Result example: matching expertise with multiple co-author degrees of separation between author and potential reviewer

Further steps Contacting the reviewer o After entering an address an template can be generated incorporating the expert profile of the potential reviewer asking whether he would be willing to review o Automated to the top three candidates with tracking and voting o automatic assignment if one accepts the peer review offer / burden

Research Profiles: Organizational Views

Research Profiles: Research trends over time

Research Profiles: Internal and External Coauthor Relationships

Research Profiles: Visualizations of Research Network Relationships

Technical Implementation Collexis will provide the reviewer selection service in two ways Integrated as web services into workflow systems Peer Reviewer Platform

Technical Implementation Integrated as web services into workflow systems Seamless integration Customized implementation possible – e.g. Study section builder functionalities Differentiation between internal and external reviewers Bulk processing of existing internal reviewers Licensing per article or journal XML upload of volume or copy & past of single articles Target groups: Publisher, journals, editors grant funding organizations Academic organizations for internal reviewing

- The Situation AACR wanted to achieve the following objectives o Expand their Peer Reviewer pool o Find the best reviewer based on a key concept o Find the best reviewer free of conflict o Improve the efficiency and effectiveness of the Peer Review process

Key Benefits Reviewer Finder Clarity of manuscript Determine the best reviewer Free of conflicts More efficient and effective process Ultimately increases profitability

Collexis Reviewer Finder "Your Path To Expertise" Darrell W. Gunter