Jennifer Esala, Ph.D. Evaluation Core Director

CCTSI Organizational Structure

New Governance Structure Jennifer Esala Lead Evaluator Shuyuan Tan Evaluator Liz Sweitzer Evaluator

Team-based Approach

Specific Aims 2018-2023 “Develop processes for Evaluation and Continuous Improvement that ensure responsive tracking of metrics, assessment and evaluation”

Building on a solid foundation Overarching evaluation plan Accomplishments Building on a solid foundation Overarching evaluation plan

Accomplishments Building on a solid foundation Overarching evaluation plan Program-specific evaluation plans

Accomplishments Building on a solid foundation Overarching evaluation plan Program-specific evaluation plans Common metrics

IRB Duration Metric by Hub and Number of Clinical Trials (2016 only) All Hubs Mdn = 42 days CCTSI Mdn = 41 days CTSA Program Common Metrics Initiative - 2016 Data

Median Number of Days to IRB Approval CCTSI Mdn = 41 days CTSA Program Common Metrics Initiative - 2016 Data

CTSA Program Common Metrics Initiative - 2016 Data Number of Pilot Research projects that have Expended Pilot Funds Since January 1, 2012 Pilot Funding and Publications (PFP): All Hubs x̅  = 90 pilots with expended funds since 2012; Mdn = 62 CCTSI = 169 pilots with expended funds since 2012 All Hubs x̅  = 38% of pilots with at least one research publication; Mdn = 38% CCTSI = 39% of pilots with at least one research publication All Hubs x̅  = 27% of pilots with at least one subsequent award in 2016; Mdn = 28% CCTSI = 31% of pilots with at least one subsequent award in 2016 CTSA Program Common Metrics Initiative - 2016 Data

CTSA Program Common Metrics Initiative - 2016 Data Number of Pilot Research projects that have Expended Pilot Funds Since January 1, 2012 CCTSI: 169 pilots with expended funds CTSA Program Common Metrics Initiative - 2016 Data

Percent Pilot Research Projects with at Least 1 Research Publication CCTSI: 39% of pilots with at least one research publication CTSA Program Common Metrics Initiative - 2016 Data

CTSA Program Common Metrics Initiative - 2016 Data Percent Pilot Research Projects with at Least 1 Subsequent Award (optional measure) CCTSI: 31% of pilots with at least one subsequent award CTSA Program Common Metrics Initiative - 2016 Data

Careers in Clinical and Translational Research (CTR) TL1 URPs All Hubs Mdn = 14.0% of TL1 graduates engaged in CTR are URP; x̅  = 19.3% CCTSI 13.0% of TL1 graduates engaged in CTR are URP Women All Hubs Mdn = 57.9% of TL1 graduates still engaged in CTR are women; x̅  = 55.8% CCTSI 53% of TL1 graduates still engaged in CTR are women CTSA Program Common Metrics Initiative - 2016 Data

CTSA Program Common Metrics Initiative - 2016 Data The number of TL1 graduates currently engaged in CTR, the percentage of graduates engaged in CTR, and of the graduates engaged in CTR, the percentage of URPs and women CCTSI: 77.0% of TL1 graduates still engaged in CTR CTSA Program Common Metrics Initiative - 2016 Data

CTSA Program Common Metrics Initiative - 2016 Data The number of TL1 graduates currently engaged in CTR, the percentage of graduates engaged in CTR, and of the graduates engaged in CTR, the percentage of URPs and women CCTSI: 13.0% of TL1 graduates still engaged in CTR are URP CTSA Program Common Metrics Initiative - 2016 Data

CTSA Program Common Metrics Initiative - 2016 Data The number of TL1 graduates currently engaged in CTR, the percentage of graduates engaged in CTR, and of the graduates engaged in CTR, the percentage of URPs and women CCTSI 53% of TL1 graduates still engaged in CTR are women CTSA Program Common Metrics Initiative - 2016 Data

Careers in Clinical and Translational Research (CTR) KL2 URPs All Hubs Mdn = 14.0% of KL2 graduates engaged in CTR are URP; x̅  = 15.2% CCTSI 16.0% of KL2 graduates engaged in CTR are URP Women All Hubs Mdn = 53.0% of KL2 graduates still engaged in CTR are women; x̅  = 53.1% CCTSI 50% of KL2 graduates still engaged in CTR are women CTSA Program Common Metrics Initiative - 2016 Data

CTSA Program Common Metrics Initiative - 2016 Data The number of KL2 graduates currently engaged in CTR, the percentage of graduates engaged in CTR, and of the graduates engaged in CTR, the percentage of URPs and women CCTSI: 100% of KL2 graduates still engaged in CTR CTSA Program Common Metrics Initiative - 2016 Data

CTSA Program Common Metrics Initiative - 2016 Data The number of KL2 graduates currently engaged in CTR, the percentage of graduates engaged in CTR, and of the graduates engaged in CTR, the percentage of URPs and women CCTSI: 16.0% of KL2 graduates still engaged in CTR are URP CTSA Program Common Metrics Initiative - 2016 Data

CTSA Program Common Metrics Initiative - 2016 Data The number of KL2 graduates currently engaged in CTR, the percentage of graduates engaged in CTR, and of the graduates engaged in CTR, the percentage of URPs and women CCTSI 53% of KL2 grads still engaged in CTR are women CTSA Program Common Metrics Initiative - 2016 Data

Accomplishments Building on a solid foundation Overarching evaluation plan Program-specific evaluation plans Common metrics Emphasizing learning

Next steps / New Components Quasi-experimental Designs Dissemination to other CTSAs Science of Team Science Community Engagement Expanding our Support

National CTSA Consortium Involvement CTSA Evaluator Group

Thank you.