1. Jennifer Esala, Ph.D. Evaluation Core Director

2. CCTSI Organizational Structure

3. New Governance Structure
Jennifer Esala
Lead Evaluator
Shuyuan Tan
Evaluator
Liz Sweitzer
Evaluator

4. Team-based Approach

5. Specific Aims
“Develop processes for Evaluation and Continuous Improvement that ensure responsive tracking of metrics, assessment and evaluation”

6. Building on a solid foundation Overarching evaluation plan
Accomplishments
Building on a solid foundation
Overarching evaluation plan

8. Accomplishments Building on a solid foundation
Overarching evaluation plan
Program-specific evaluation plans

12. Accomplishments Building on a solid foundation
Overarching evaluation plan
Program-specific evaluation plans
Common metrics

13. IRB Duration Metric by Hub and Number of Clinical Trials (2016 only)
All Hubs Mdn = 42 days
CCTSI Mdn = 41 days
CTSA Program Common Metrics Initiative Data

14. Median Number of Days to IRB Approval
CCTSI Mdn = 41 days
CTSA Program Common Metrics Initiative Data

15. CTSA Program Common Metrics Initiative - 2016 Data
Number of Pilot Research projects that have Expended Pilot Funds Since January 1, 2012
Pilot Funding and Publications (PFP):
All Hubs x̅  = 90 pilots with expended funds since 2012; Mdn = 62
CCTSI = pilots with expended funds since 2012
All Hubs x̅  = 38% of pilots with at least one research publication; Mdn = 38%
CCTSI = 39% of pilots with at least one research publication
All Hubs x̅  = 27% of pilots with at least one subsequent award in 2016; Mdn = 28%
CCTSI = 31% of pilots with at least one subsequent award in 2016
CTSA Program Common Metrics Initiative Data

16. CTSA Program Common Metrics Initiative - 2016 Data
Number of Pilot Research projects that have Expended Pilot Funds Since January 1, 2012
CCTSI: 169 pilots
with expended funds
CTSA Program Common Metrics Initiative Data

17. Percent Pilot Research Projects with at Least 1 Research Publication
CCTSI: 39% of pilots with
at least one research publication
CTSA Program Common Metrics Initiative Data

18. CTSA Program Common Metrics Initiative - 2016 Data
Percent Pilot Research Projects with at Least 1 Subsequent Award (optional measure)
CCTSI: 31% of pilots with
at least one subsequent award
CTSA Program Common Metrics Initiative Data

19. Careers in Clinical and Translational Research (CTR)
TL1
URPs
All Hubs Mdn = 14.0% of TL1 graduates engaged in CTR are URP; x̅  = 19.3%
CCTSI % of TL1 graduates engaged in CTR are URP
Women
All Hubs Mdn = 57.9% of TL1 graduates still engaged in CTR are women; x̅  = 55.8%
CCTSI 53% of TL1 graduates still engaged in CTR are women
CTSA Program Common Metrics Initiative Data

20. CTSA Program Common Metrics Initiative - 2016 Data
The number of TL1 graduates currently engaged in CTR, the percentage of graduates engaged in CTR, and of the graduates engaged in CTR, the percentage of URPs and women
CCTSI: 77.0% of
TL1 graduates still
engaged in CTR
CTSA Program Common Metrics Initiative Data

21. CTSA Program Common Metrics Initiative - 2016 Data
The number of TL1 graduates currently engaged in CTR, the percentage of graduates engaged in CTR, and of the graduates engaged in CTR, the percentage of URPs and women
CCTSI: 13.0% of
TL1 graduates still
engaged in CTR
are URP
CTSA Program Common Metrics Initiative Data

22. CTSA Program Common Metrics Initiative - 2016 Data
The number of TL1 graduates currently engaged in CTR, the percentage of graduates engaged in CTR, and of the graduates engaged in CTR, the percentage of URPs and women
CCTSI 53% of
TL1 graduates still
engaged in CTR
are women
CTSA Program Common Metrics Initiative Data

23. Careers in Clinical and Translational Research (CTR)
KL2
URPs
All Hubs Mdn = 14.0% of KL2 graduates engaged in CTR are URP; x̅  = 15.2%
CCTSI % of KL2 graduates engaged in CTR are URP
Women
All Hubs Mdn = 53.0% of KL2 graduates still engaged in CTR are women; x̅  = 53.1%
CCTSI 50% of KL2 graduates still engaged in CTR are women
CTSA Program Common Metrics Initiative Data

24. CTSA Program Common Metrics Initiative - 2016 Data
The number of KL2 graduates currently engaged in CTR, the percentage of graduates engaged in CTR, and of the graduates engaged in CTR, the percentage of URPs and women
CCTSI: 100% of
KL2 graduates still
engaged in CTR
CTSA Program Common Metrics Initiative Data

25. CTSA Program Common Metrics Initiative - 2016 Data
The number of KL2 graduates currently engaged in CTR, the percentage of graduates engaged in CTR, and of the graduates engaged in CTR, the percentage of URPs and women
CCTSI: 16.0% of
KL2 graduates still
engaged in CTR
are URP
CTSA Program Common Metrics Initiative Data

26. CTSA Program Common Metrics Initiative - 2016 Data
The number of KL2 graduates currently engaged in CTR, the percentage of graduates engaged in CTR, and of the graduates engaged in CTR, the percentage of URPs and women
CCTSI 53% of
KL2 grads
still engaged
in CTR
are women
CTSA Program Common Metrics Initiative Data

27. Accomplishments Building on a solid foundation
Overarching evaluation plan
Program-specific evaluation plans
Common metrics
Emphasizing learning

28. Next steps / New Components
Quasi-experimental Designs
Dissemination to other CTSAs
Science of Team Science
Community Engagement
Expanding our Support

29. National CTSA Consortium Involvement
CTSA Evaluator Group

30. Thank you.