Outcome Evaluation of the National Cancer Institute (NCI) Career Development (K) Awards Program Julie L. Mason, Ph.D. Center for Cancer Training National.

Slides:

Advertisements

Similar presentations

Florida State University PhD Completion Project Phases I & II Nancy Marcus Judith Devine.

Advertisements

NIH K-22 Application Career Transition Award

Early Stage Investigators and the Program Perspective

Mentored Career Development (K) Award Outcomes National Advisory Council on Drug Abuse February 6, 2008 Lucinda L. Miner, Ph.D. Deputy Director, Office.

K Awards Training Grant and Research Awards. Main Categories Basic researcher vs. clinical researcher PhD-like degree vs. health professional degree Additional.

Archived File The file below has been archived for historical reference purposes only. The content and links are no longer maintained and may be outdated.

Roberta Spalter-Roth, Ph.D Director of Research American Sociological Association Enhancing Diversity in Science: Working Together to Develop Common Data,

 Why are you reading this? Both the Public Health Service and the National Science Foundation require WSU to provide all investigators training related.

DIVISION OF LOAN REPAYMENT Milton J. Hernández, Ph.D. Director Division of Loan Repayment OEP, OER Mapping your Career with NIH.

What’s NIH? National Cancer Institute National Eye Institute National Heart, Lung, and Blood Inst. National Human Genome Research Inst National Institute.

Ilya Ponomarev 1, Pawel Sulima 1, Jodi Basner 1, Unni Jensen 1, Joshua Schnell 1, Karen Jo 2, and Nicole Moore 2 A New Approach for Automated Author Discipline.

Training and Career Development Analyses: NICHD Diversity Supplements and F31 Pre-doctoral Fellowships Jennifer Guimond, PhD and Sarah Glavin, PhD Science.

Learning Health System Challenge and Planning Awards Alexander K. Ommaya, DSc Sr. Dir. Clinical Effectiveness & Implementation Research Philip M. Alberti,

Survey of Earned Doctorates National Science Foundation Division of Science Resources Statistics Mark Fiegener, Ph.D. Presentation to Clemson University.

American Evaluation Association EVALUATION 2011 November 3, 2011 Approaches to Biomedical Research and Development Portfolio Analysis: Examples From the.

1 Age Distributions of NIH Research Project Grant Investigators and Medical School Faculty, September 2007.

Education and Employment of Biological and Medical Scientists 2011 Data from National Surveys Howard H. Garrison Kim Ngo FASEB Office of Public Affairs.

Evaluating NSF Programs

1 Sally J. Rockey, PhD Deputy Director for Extramural Research National Institutes of Health NIH Regional Seminar on Program Funding And Grants Administration.

1 CRCHD-sponsored Professional Development and Mock Review Workshop June 23, 2014 NIH Funding Opportunities, Grant Applications, and Recent Changes Christopher.

TYPE 2 TRANSLATIONAL RESEARCH 2009 GRANT PROGRAMS UW Institute for Clinical and Translational Research (ICTR) Community-Academic Partnership Core (CAP)

Overview of the Continuing Umbrella of Research Experiences (CURE) Grant Mechanisms Dr. Peter Ogunbiyi Diversity Training Branch Center to Reduce Cancer.

Wishwa N. Kapoor, MD, MPH, Director Doris M. Rubio, PhD, Co-Director Multidisciplinary Clinical Research Scholars Program.

Designing an Evaluation of the Effectiveness of NIH’s Extramural Loan Repayment Programs.

NCRR American Society of Plant Biologists NIH Science Education Partnership Award (SEPA)

Overview of CRCHD Diversity Training Programs H. Nelson Aguila, DVM Center to Reduce Cancer Health Disparities National Cancer Institute.

American Evaluation Association Annual Meeting, November 2011 Using Multiple Methods and Data Sources to Analyze Complex Cancer Research Portfolios Joshua.

Who will play the most important role in your career? Department Chair Colleagues The NIH Mentor Trainees!!!

Data provided by the Division of Statistical Analysis & Reporting (DSAR)/OPAC/OER Contact: Best Practices: Leveraging Existing Data.

Lessons learned from programs for URM scientists What is the problem? What do we need to know to develop and implement better programs? Anthony L. DePass.

In-depth Interviews of Alumni from a Structured Postdoctoral Training Program Jessica M. Faupel-Badger 1, David E. Nelson 1, Kimberley Raue 2, Sophia Tsakraklides.

A Collaborative Project to Build Capacity Through Quality Teacher Preparation.

NIH LOAN REPAYMENT PROGRAM EVALUATION Milton J. Hernández, Ph.D. Director Division of Loan Repayment OEP, OER, OD National Institutes of Health Bethesda,

Ph. D. Completion and Attrition: Analysis of Baseline Data NSF AGEP Evaluation Capacity Meeting September 19, 2008 Robert Sowell Council of Graduate Schools.

American Evaluation Association EVALUATION 2009 November 14, 2009 Building Data Systems to Support Evaluation in a Biomedical Research and Development.

“An Educational Partnership Program with Minority Serving Institutions: A Framework for Producing Minority Scientists in NOAA-Related Disciplines” Larry.

+ Meeting of Assistant Professors June 29, Faculty and Academic Affairs Leadership Steven Abramson, M.D., Vice Dean for Education, Faculty and.

State of the College Address Friday August 31, 2012 COLLEGE OF BEHAVIORAL AND COMMUNITY SCIENCES.

Archived File The file below has been archived for historical reference purposes only. The content and links are no longer maintained and may be outdated.

1 Preparing an NIH Institutional Training Grant Application Rod Ulane, Ph.D. NIH Research Training Officer Office of Extramural Research, NIH.

Ninth Annual Women’s Health Research Conference Sponsored jointly by: Center for Women’s Health Research UNC BIRCWH Program.

NSF STEM Scholarship Program. Outline NSF-STEM program information – One submission per year – Mission – Regulations What we learned last time – Strengths.

NOAA Cooperative Institutes John Cortinas, Ph.D. OAR Cooperative Institute Program, Program Manager NOAA Cooperative Institute Committee, Chairperson.

The Importance of a Strategic Plan to Eliminate Health Disparities 2008 eHealth Conference June 9, 2008 Yvonne T. Maddox, PhD Deputy Director Eunice Kennedy.

Education and Employment of Biological and Medical Scientists 2015 Data from National Surveys Howard H. Garrison and Elisabeth Campbell FASEB Office of.

National Research Council Assessment of Doctorate Programs: The Methodology Report E. L. Fink & S. Chai University of Maryland.

Data provided by the Division of Information Services, Reporting Branch NATIONAL INSTITUTES OF HEALTH (NIH) DATA BOOK Fiscal Year 2010.

Research Funding Opportunity & Scientific Capacity Building in Developing Countries By Dina R. Andersson 1.

Promotions on the Physician Scientist/Basic Science Investigator Track Larry L. Swift, Ph.D. Vice Chair for Faculty Affairs Department of Pathology, Microbiology.

Education and Employment of Biological and Medical Scientists Data from National Surveys Howard H. Garrison Kimberly McGuire FASEB Office of Public Affairs.

Archived File The file below has been archived for historical reference purposes only. The content and links are no longer maintained and may be outdated.

Mid-Career Transitions…..or What am I going to do tomorrow? Michael A Sesma PhD Branch Chief for Postdoctoral Training Division of Training, Workforce.

Evaluating Training and Career Development Grants in the Biomedical Sciences: Methods, Measures, Benchmarks, & Best Practices.

Michael Sesma, Ph.D. National Institute of Mental Health Early Stage Investigators and the Program Perspective.

An Evaluation of Pipeline Interventions for Minority Scholars An Evaluation of Pipeline Interventions for Minority Scholars Roberta Spalter-Roth, Jean.

Peer Review and Grant Mechanisms at NIH What is Changing? May 2016 Richard Nakamura, Ph.D., Director Center for Scientific Review.

Training Program Evaluation: Creating a Composite Indicator to Measure Career Outcomes National Institutes of Health / National Cancer Institute & Thomson.

Career Sustainability Survey of KL2 Programs: Preliminary Results

HIP Buffet: Mapping Your Career with NIH

The Pathway to Independence: Early

AEA Annual Meeting November 13, 2015

Coalition for National Science Funding (CNSF) 

American Evaluation Association

Feinberg School of Medicine Faculty Promotion and Tenure Program

Training Research Scientists: Fostering Independence

Evan Siemann for Faculty Senate 11/16/16

NIH Requirements for Training in Responsible Conduct of Research

Graduate Training Grants

Florida State University PhD Completion Project Phases I & II

Patient-Centered Outcomes Research Institute (PCORI)

Presentation transcript:

Outcome Evaluation of the National Cancer Institute (NCI) Career Development (K) Awards Program Julie L. Mason, Ph.D. Center for Cancer Training National Cancer Institute National Institutes of Health

2 K Program Background 3-5 years support to early-career scientists, clinicians, health professionals Facilitate independent cancer research careers Broad range of K grant mechanisms No systematic evaluation of the NCI K program performed Feasibility study, outcome evaluation

Evaluation Objectives Determine demographics of NCI K award program applicants Identify post-K outcomes Determine impact of NCI K award receipt on participant outcomes 3

4 Full Evaluation Cohort Mechanism Years Analyzed Total Applications Total Awards Percent Awarded K % K , % K % K , % K % K % K % K % K % TOTAL ,4451, % Mechanism Applicants Awardees Non- Awardees Percent Awarded TOTAL3,982 1, Scholars 2, %

5 Outcome Evaluation Framework INPUTSACTIVITIESOUTCOMES AND IMPACT Implement career development plan Perform research Transition to independence Qualifying degree Degree field of study Gender Race/ethnicity Years since degree Age at application Prior NIH support Institutional characteristics K Applicants Goals Mechanisms included Timeframe evaluated Number of K applications and applicants K success rates K Program  NSF Doctorate Records File  AAMC Faculty Roster  IMPAC II  NCI Fact Book

Creation of the Comparison Cohort Cutting point (payline) n = 293 FUNDED K awardees NOT FUNDED K non-awardees Least fundable scores Most fundable scores 6

7 Outcome Evaluation Framework ACTIVITIES Implement career development plan Perform research Transition to independence NIH applications & awards NCI applications & awards Non-NIH awards Time to first R01 Subsequent Funding  IMPAC II  International Cancer Research Partnership (ICRP)  ScienceWire ® (DoE, NSF) OUTCOMES AND IMPACT

8 Outcome Evaluation Framework ACTIVITIES Implement career development plan Perform research Transition to independence NIH applications & awards NCI applications & awards Non-NIH awards Time to first R01 Subsequent Funding  IMPAC II  International Cancer Research Partnership (ICRP)  ScienceWire ® (DoE, NSF) OUTCOMES AND IMPACT YES (1)NO (0) YES (1) NO (0) 6101,077 K Funded Had Subsequent NIH Grant OR = 2.53, p<0.001  IMPAC II  International Cancer Research Partnership (ICRP)  ScienceWire ® (DoE, NSF)

Outcome Evaluation Framework 9  IMPAC II  MEDLINE  Web of Science  ClincialTrials.gov  US Patent and Trade Office ACTIVITIES Implement career development plan Perform research Transition to independence OUTCOMES AND IMPACT NIH applications & awards NCI applications & awards Non-NIH awards Time to first R01 Subsequent Funding Number of publications Citations and impact Patents awarded Clinical trial participation Productivity

Outcome Evaluation Framework NIH applications & awards NCI applications & awards Non-NIH awards Time to first R01 Subsequent Funding 10 Number of publications Citations and impact Patents awarded Clinical trial participation Productivity  IMPAC II  MEDLINE  Web of Science  ClincialTrials.gov  US Patent and Trade Office ACTIVITIES Implement career development plan Perform research Transition to independence OUTCOMES AND IMPACT

11 Outcome Evaluation Framework Number of publications Citations and impact Patents awarded Clinical trial participation Productivity Career Appointments Faculty appointment Participation on advisory committees & panels Professional society membership Registered health practitioner listing NED listing  IMPAC II  AAMC Faculty Roster  HealthLink/Lodestone  NIH Employee Directory  FIDO.gov  AACR  FASEB  ASCO ACTIVITIES Implement career development plan Perform research Transition to independence NIH applications & awards NCI applications & awards Non-NIH awards Time to first R01 Subsequent Funding OUTCOMES AND IMPACT

12 Outcome Evaluation Framework Faculty appointment Participation on advisory committees & panels Professional society membership Registered health practitioner listing NED listing Career Appointments Funded research activity Broader scientific engagement Number of publications Citations and impact Patents awarded Clinical trial participation Productivity OUTCOMES AND IMPACT NIH applications & awards NCI applications & awards Non-NIH awards Time to first R01 Subsequent Funding

13 Funded Research Activity Awarded a competitive grant from NIH, Dept. of Energy (DoE), or International Cancer Research Partnership (ICRP), or Key personnel on a clinical trial Is a funded researcher: K applicants

14 Funded Research Activity Full cohort Comparison cohort K Awardees n = 1,204 K Non-awardees n = 1,685 K Awardees n = 293 K Non-awardees n = 293 p<0.001 p=0.0076

15 Broader Scientific Engagement Is engaged: Federal advisory committee or review panel Published subsequent papers Matched to NIH Employee Directory (NED) Membership in scientific professional societies Registered health practitioner Is a funded researcher Not a funded researcher Did not include individuals in the “Is a funded researcher” category

16 Broader Scientific Engagement Is engaged: Federal advisory committee or review panel Published subsequent papers Matched to NIH Employee Directory (NED) Membership in scientific professional societies Registered health practitioner Is a funded researcher Not a funded researcher Did not include individuals in the “Is a funded researcher” category

17 Broader Scientific Engagement Full cohort Comparison cohort K Awardees n = 407 K Non-awardees n = 927 K Awardees n = 111 K Non-awardees n = 144 p<0.001 p=0.0012

18 Jonathan Wiest, NCI Ming Lei, NCI Jessica Faupel-Badger, NCI Erika Ginsburg, NCI James Corrigan, NCI Lawrence Solomon, NCI Melissa Stick, NIDCD Joanne Tornow, NSF Rodney Ulane, NIH OD Joshua Schnell Laurel Haak Yvette Seger Leo DiJoseph Faye Liu John Seibel Thomson Reuters/Discovery LogicAdvisory Committee Data Partners NSF Doctorate Records File AAMC Faculty Roster American Association for Cancer Research American Society of Clinical Oncology Federation of American Societies for Experimental Biology International Cancer Research Partners Partial Funding NIH Evaluation Set-Aside Program Acknowledgements

19 Additional Questions? Julie L. Mason, Ph.D. Tel: Center for Cancer Training National Cancer Institute