1. Long Term Impacts of Research Capacity Building in Global Health
Fogarty International Center
Celia Wolfman, MSPPM
Rachel Sturke, PhD, MPH, MIA
Long Term Impacts of Research Capacity Building in Global Health
This presentation discusses the ways FIC explores, defines and captures the long-term impacts of its research and research training programs
Understanding the impacts not only helps inform the Institute programmatically but we get a better context of the growth of the IC and the history

2. The Fogarty Mission
Supporting and facilitating global health research conducted by U.S. and international investigators
Building partnerships between health research institutions in the U.S. and abroad
Training the next generation of scientists to address global health needs and challenges

3. The Fogarty Pipeline Foreign Chronic Infectious Implementation
Networks
Collaborations
STRENGTHENING
Institutions
Post-Doc
Doctoral
Graduate
College
Domestic
Individuals
Research
Training

4. Fogarty Values and Approach
Funded research body for training
We center around LMIC and growing a critical mass of trainees that are independent and capable researchers. This will create a sustainable research environemtn. We also value collaborations between the US and foreign institutions; and increasingly, we encourage the foreign institutions building partnerships with one another to create local networks
FIC has been around for over 35 years. We take a long-term approach and understand that most of the big impacts take time to mature before creating an impact in the LMIC

5. Components of Research Capacity Development
Supporting careers of LMIC scientists
Experience in low resource settings for US researchers
Funded research in LMICs
Encourage collaborative research
Training and Career Development
Training LMIC researchers
Training of
scientific administrators
Research
Support in
curricula development
Institution
Support in
cross-cutting research (e.g. informatics, bioethics)

6. Metrics Utilized by Fogarty
OUTPUTS
OUTCOMES
IMPACTS
Trainees
Publications
Research laboratories
New competitive grants
Institutional changes
Acquisition of leadership positions in research/policy
Critical mass scientists
Organizational partnerships/network development
More easily captured & more quantitative
Harder to Measure & often qualitative
Outputs often are easy to measure = counts
Impacts are more qualitative. We want to know what the right parameters for these metrics.

7. Articles by Topic Area (Fogarty DIEPS, 2014)
Outputs are easier for us to capture, define and count. This is an example of publications binned by category for our intramural program.
Source: NIH Library (July 2012)

8. Questions RE: Long-Term Impact
Standard metrics don’t always apply.
What have FIC funded research training programs contributed to?
What are the mechanisms through which these impacts have occurred?
What type of data should be used? (e.g. for networks, policy influence, tracking trainee careers):
What are the lessons learned that can be used by other FIC funded programs, and more broadly by other research training programs?

9. Methodological Challenges for Capturing Long-term, Distal Impacts
Establishing a universal “capacity building” metric
Defining linkages between research inputs, outputs, outcomes, and impacts
Attribution vs. contribution in multiple funder environment
Creating a framework for measuring impact that can deal with priorities of different stakeholders
The are some overarching challenges to answering these questions. For example, we don’t have a clear understanding of when capacity has been reached? What is that metric? When are we done?
Similarly, we know that the linkages between outputs, outcomes and impacts are not any easy cause effect. In a multi-funded environment with multiple stakeholders and funders, we can never take responsibility for an impact but rather “contribute” to it.

10. World RePORT
TOP 2013 INSTITUTIONS
Provides an illustrative map (and downloadable dataset) to facilitate communication and coordination of biomedical research funded by major government agencies and philanthropic organizations around the world.
So there are some systems in place that allow us to systematically capture more long term impacts. For example, to help us understand the synergies with other funders and the inputs that could impact our outcomes, NIH and other international funders have developed World RePORT. This database captures grants for multiple funders including FIC and other NIH to understand the larger context.

11. CareerTrac
CareerTrac is an innovative global trainee tracking and evaluation system for Fogarty
Document Fogarty’s investment in international capacity building
Track extramural trainee’s progress and career paths
Grantees’ need for reporting
Evaluation: Monitor output, outcome and impact
Benchmarking
CareerTrac allows us to understand our training outcome. Over 3 quarters of our programs are training. Understanding what happens to our trainees and their careerpaths is important. However, this is not a quantitative straightforward metric. Instead, we need to capture multiple outcome accomplishments (publications, employment, awards, degrees, etc) including qualitative data to understand the path of our trainees. CareerTrac allows for this.

12. Fogarty Trainees ( )
5400 Long Term Trainees from 120 Countries
Source: CareerTrac

13. Return Home Rate of Fogarty Trainees
90%
92%
97%
92%
94%
Used the canned report.
Only long term trainees (n=4694) of which 28% (n=1293) were excluded because they didn’t say whether or not they returned.
Doesn’t include trainees who ended training in 2015 (grantees haven’t entered the information into CT on whether they returned home or not).
92%
Note: 28% Not Reporting
Source: CareerTrac

14. How Case Studies Can Help
Convey a more comprehensive understanding of career development or policy development
Capture the interplay between research, research capacity, delivery of health care, and population health improvements
Complement the conventional short-term metrics of success
With these systems in place, we can use them to create case studies.
Some of the benefits include they are able to 1) Convey a more comprehensive understanding, not only of outcomes of these investments in terms of career development, but of broader effects upon institutional capacity, knowledge production and translation, policy development, and ultimately improved health in-country. 2) Capture the interplay between research, research capacity, delivery of health care, and population health improvements will provide a deep understanding of the relationship between the research capacity, a strengthened health system, and improved health outcomes.

15. Case Study Example
This is an example of a case study used in the evaluation of our Brain Disorders program evaluation. Through the development of the case studies and interviews with both foreign and US collaborators, we were able to understand the ripple effect our grant had on the larger research community. As shown, this grantee was able to create networks and train individuals in Colombia who were able to support the large scale (and currently ongoing) Alzheimer clinical trial being conducted at the local institution.

16. Fogarty Challenges: Capacity Building
What is success for Fogarty? When has capacity been reached?
Depends on what “capacity building” includes:
Institutions
Research area
Independent Scientists
Other funders’ investments
Ultimately we are trying to building a critical mass of researchers. But defining this is hard. We don’t have a universal metric of what “success” looks like in terms of capacity ? So how and when do we know we are done is complicated.

17. Thank you For questions or more information: Celia Wolfman
Links:
Fogarty:
World RePORT:
CareerTrac: