Associate Director, Center for Cancer Training Assessing Early Outputs of a Program Exposing Postdoctoral Fellows to Careers Beyond Research Julie L. Mason, Ph.D. Associate Director, Center for Cancer Training

NCI’s Trainees I High school students Pre- and post-baccalaureates Graduate & Medical Students Postdoctoral & research fellows

NCI’s Trainees I High school students Pre- and post-baccalaureates Graduate & Medical Students Postdoctoral & research fellows

“I have trained dozens of Postdocs “I have trained dozens of Postdocs. One of them even got a faculty position!”

Trainees’ Needs Help!

Trainees’ Needs 88% interested in site visits to explore multiple career paths* *Data from the 2014 NCI Center for Cancer Research fellows and trainees survey

Explore On Site (EXPOSE) Our Response Explore On Site (EXPOSE)

Three Tenets Experiential (site visits) Leverage local ties Build evaluation from onset

NCI Explore On Site (EXPOSE) Program Share & Use Engage Stakeholders Justify Conclusions Describe Program Gather Evidence Evaluation Design From the CDC Framework for Program Evaluation

NCI Explore On Site (EXPOSE) Program Share & Use Engage Stakeholders Justify Conclusions Describe Program Gather Evidence Evaluation Design From the CDC Framework for Program Evaluation

Stakeholders Postdoctoral fellows Training colleagues Local employers

Stakeholders Postdoctoral fellows Training colleagues Local employers Incorporate feedback into program design Postdoctoral fellows Training colleagues Local employers

NCI Explore On Site (EXPOSE) Program Share & Use Engage Stakeholders Justify Conclusions Describe Program Gather Evidence Evaluation Design From the CDC Framework for Program Evaluation

Logic Model

Logic Model

Logic Model

Logic Model

Logic Model

Program Structure Post-survey Pre-survey Site visits Workshop 2 Describe Program Applications submitted Review & selections myIDP Workshop 1 Workshop 2 Site visits Pre-survey FDA MedImmune NIH AAAS Qiagen

Program Structure Post-survey Pre-survey Site visits Workshop 2 Describe Program Applications submitted Review & selections myIDP Workshop 1 Workshop 2 Site visits Pre-survey FDA MedImmune NIH AAAS Qiagen Clearly outlining goals sets realistic expectations

NCI Explore On Site (EXPOSE) Program Engage Stakeholders Share & Use Justify Conclusions Describe Program Gather Evidence Evaluation Design From the CDC Framework for Program Evaluation

Knowledge and Skill Gain Please select your best assessment of your knowledge/skill* *Possible responses: No skill (1), little (2), some (3), good degree (4), great degree (5)

Post-EXPOSE Connections Have you contacted (or been contacted by) any professionals you met through the site visits?

Post-EXPOSE Connections Have you contacted (or been contacted by) any professionals you met through the site visits? What was the nature of your contact? Details, internships, other training Building network Job opportunities Applying for job Job interview Mentoring/shadowing

Future Employment Will you consider seeking employment at one of the organizations visited through EXPOSE?

Where We Were Help! ? ? ?

Hires and New Positions (1) Patent specialist, law firm (3) FDA Commissioner’s fellowship (1) FDA-NCI joint fellowship (1) Project manager, biotech company Total of 19 fellows in the cohort

Hires and New Positions (1) Patent specialist, law firm (3) FDA Commissioner’s fellowship (1) FDA-NCI joint fellowship (1) Project manager, biotech company Think more ambitiously about all the data you wish to collect Total of 19 fellows in the cohort

NCI Explore On Site (EXPOSE) Program Share & Use Engage Stakeholders Justify Conclusions Describe Program Gather Evidence Evaluation Design From the CDC Framework for Program Evaluation

Why This Worked Incorporated stakeholder feedback early Designed program with the end in mind Identified success metrics early Assessed achievement toward those metrics Started the process over again!

Acknowledgements Program/Workshop Team Site Visit Coordinators Jonathan Wiest, NIH Lori Conlan, NIH Randy Ribaudo, SciPhD MedImmune/AstraZeneca: Kristine Freind, Chrissy McKenzie FDA: Devon Thomas AAAS: Sean Gallagher Qiagen: Sheila Smaw