1. Evaluation of NCI Research Resources
Eddie N. Billingslea, Ph.D.1, Laura Sharon, M.A.2, Grace Liou, Ph.D.1, L. Michelle Bennett, Ph.D.1
1Center for Research Strategy, National Cancer Institute, National Institutes of Health, Bethesda, MD
2The Madrillon Group Inc., Vienna, VA
ABSTRACT
RESULTS
The National Cancer Institute’s (NCI) Research Resources is a web-based, centralized directory providing access to numerous NCI-supported research tools. The purpose is to expedite cancer research progress by providing investigators with access to cost-effective resources (e.g. reagents, mice). Recently, NCI evaluated the use of Research Resources to determine the strengths, weaknesses, and opportunities for improvement in order to develop an evidence base in support of decisions about future investments. This evaluation addressed several questions using telephone interviews, in addition to earlier usability testing and heuristic assessments. Key findings from the telephone interviews will be presented. The findings suggest a need for a platform like Research Resources, especially among those in certain demographics. Future plans include determining optimal platform to implement suggested changes, expanding the number of resources, and identifying an effective strategy for increasing usage of Research Resources, especially among those in targeted demographics.
Figure 2: Map showing distribution of survey participants
BACKGROUND
As a result of NCI’s dedication to fostering and supporting research activities of cancer investigators, a centralized repository of research tools called Research Resources was created (Figure 1). It grants users access to NCI-curated databases, scientific computing resources, chemicals and biologics, animal models, and genetic resources. Currently, not many cancer investigators are accessing the portal as evidenced by web analytics. In addition to earlier usability testing and heuristics assessment, NCI wanted to identify a sample of the extramural cancer research community how they obtain resources to support their research. To that end, a data call was put forth to NCI staff seeking investigators willing to participate in the survey. To get a broad view of the NCI-supported investigators landscape, the populations targeted were:
Early stage or experienced
From research intensive or less research intensive institutions
Classified as basic, translational, or clinical researchers
The data obtained will be used to determine if continued investment is warranted and what additional features might enhance the usability of the site.
Participated a. b.
Figure 3: Summary demographic data of extramural investigator survey invitees (left) and participants (right)
Early Detection
Research
Network
NCI
Resources
Figure1: Representation of resources contained within NCI Research Resources c. d.
Types of Cancer Research Resources
No. of Participants
Databases
50% (N=14)
Reports
18% (N=5)
Chemicals and biologics
7% (N=2)
Animal resources
Genetic resources
3% (N=1)
Vectors
Other
Name of Resource
No. of Participants
PubMed
79% (N=22)
NCI website
55% (N=15)
Google
32% (N=9)
American Cancer Society (ACS)
21% (N=6)
Surveillance, Epidemiology, and End Results (SEER) Program
18 % (N=5)
CDC
State-specific registries
NIH RePORTER
Medline
11% (N=3)
Conferences
SciFinder
7% (N=2)
Cancer Control P.L.A.N.E.T.
Cancer Genome ATLAS
Table 1: Summary of most valuable resources to investigators seeking cancer-related research information.
Table 2: Summary of resources use when preparing grant applications
METHODOLOGY
CONCLUSION/ FUTURE DIRECTION
An interview guide was developed containing 10 questions to be discussed in detail during telephone interview. We wanted to ascertain how cancer investigators were accessing cancer research resources. The questions were divided into four themes:
Background information
Finding cancer research resources and information
Needs
Dissemination/getting the word out
Seventy-four investigators were invited to participate, and 28 investigators were interviewed.
Based on the data collected from the interviews, the extramural investigators who participated:
Conduct a diversity of research
Are predominantly female
Conduct internet searches based on study-related information and resource needs
Are interested in a more efficient way to identify/locate colleagues with whom they can share information and resources and potentially form collaborations
Favor having a “one-stop-shop” for all of their cancer research needs that is also well maintained, comprehensive, and current
Given the demographics of survey participants, it has been concluded that such a resource would likely be of tremendous benefit to:
Early stage investigators (e.g. graduate students and postdocs)
Investigators from less research intensive institutions
Investigators from underrepresented groups
Future directions include determining optimal platform to implement suggested changes, expanding to include other resources, and identifying an effective strategy for increasing usage of Research Resources, especially among targeted demographics.