CCTS UIC Center For Clinical and Translational Science SUCCESS CASE METHOD: APPLICATION IN A CTSA CONTEXT Nancy J Bates, DrPH, RD, CHES Timothy Johnson,

Slides:

Advertisements

Similar presentations

PhD Completion Project of Brown University Overview and Plans Sheila Bonde Dean, Graduate School July 11, 2007.

Advertisements

Connecting Libraries to Organizational Mission: Using Assessment to Strengthen the Academic Health Sciences Librarys Institutional Role James Shedlock,

1 Mid-Term Review of The Illinois Commitment Assessment of Achievements, Challenges, and Stakeholder Opinions Illinois Board of Higher Education April.

Background This linked collaborative is intended to identify opportunities to exchange best practices, administrative and regulatory support models and.

Department of Medicine Three Year Review Workshop Job Descriptions November 21, 2012 Joan Wither Co-Chair, Three Year Review Joan Wither Co-Chair, Three.

Department of Medicine Three Year Review Job Descriptions Job description should be defined when started in the Department of Medicine – last minute changes.

Succession and talent management

END OF SEASON REFLECTION LONDON, JUNE AGENDA 1.OBJECTIVES 2.CONTEXTUAL INFORMATION 3.PROCESS 4.END OF SEASON REFLECTION 5.KEY LEARNINGS 6.DEVELOPING.

Tweet the Retreat at #UMBCretreat UMBC Data Gallery Tour.

PEER REVIEW OF TEACHING WORKSHOP SUSAN S. WILLIAMS VICE DEAN ALAN KALISH DIRECTOR, UNIVERSITY CENTER FOR ADVANCEMENT OF TEACHING ASC CHAIRS — JAN. 30,

Overview of Mentored K Awards Shawna V. Hudson, PhD Assistant Professor of Family Medicine and Community Health UMDNJ-RWJMS The Cancer Institute of New.

Meeting of Assistant Professors Discussion of Promotion and Tenure July 25, 2011.

ARE WE GETTING THE JOB DONE? TEACHING FINANCIAL COMPETENCIES FOR PUBLIC HEALTH Louis C. Gapenski, PhD Michael E. Morris, MPH, MPA, CPH Peggy A. Honoré,

1 Faculty Leadership Development Programs at Virginia Tech Peggy Layne, P.E., Director, AdvanceVT.

Process Management Robert A. Sedlak, Ph.D Provost and Vice Chancellor, UW-Stout Education Community of Practice Conference At Tusside in Turkey September.

Better Organizations Through Better Science ® © 2009 Valtera Corporation. All Rights Reserved. Management-Based Evidence SIOP New Orleans April 2, 2009.

Cancer Disparities Research Partnership Program Process & Outcome Evaluation Amanda Greene, PhD, MPH, RN Paul Young, MBA, MPH Natalie Stultz, MS NOVA Research.

1 Accelerating Research to Improve Health How the CCTS can Accelerate Your Research & Advance Your Career.

Evaluation. Practical Evaluation Michael Quinn Patton.

1 NIH Grant-Writing Workshop Leora Lawton, Ph.D. Executive Director, Berkeley Population Center Summer 2015 Dlab Workshop Session 5: Human Subjects and.

Copyright © 2011 American Institutes for Research All rights reserved. Pilot Implementation Data: What We’ve Learned So Far Gretchen Weber Director of.

How an Advanced Degree Can Help You Reach Your Career Goals Marcella K. Vaicik Ph.D. Candidate in Biomedical Engineering Illinois Institute of Technology.

Rethinking the PhD in the Humanities Russell A. Berman Stanford University.

Department of Mechanical Engineering

Why Publish? Public Health Translation Research Eric Tai, MD MS Comprehensive Cancer Control Branch Division of Cancer Prevention and Control Centers for.

Assessing Chronic Illness Care in Prison (ACIC-P): A Tool for Tracking Chronic Illness Care in Prison Emily Wang, M.D., MAS Yale University School of Medicine.

Strengthening the quality of research for policy engagement in the African context – achievements and aspirations Tebogo B. Seleka Botswana Institute for.

UNIKE Survey on Doctoral Education By Corina Balaban and Sue Wright Ljubljana Summer School 7-11 July 2014.

Kirkpatrick model of evaluation to assess public health workforce preparedness training American Public Health Association November 5, 2013 Boston, MA.

Building an Information Community: IT and Research Working Together Responsive Evaluation in the Community College: An Alternative Approach to Evaluating.

Leadership: Connecting Vision With Action Presented by: Jan Stanley Spring 2010 Title I Directors’ Meeting.

Introduction of Myself I currently serve as professor ＆ Dean, school of Nursing and Graduate School at the Tzu Chi University. For past 20 years, I worked.

Gina Washington, Director Colin Neumeyer, ELA Teacher Bette Bergeron, SOE Dean.

Academic Promotion in Different Career Paths David J. Bjorkman, MD, MSPH Florida Atlantic University.

© 2011 Partners Harvard Medical International Strategic Plan for Teaching, Learning and Assessment Program Teaching, Learning, and Assessment Center Strategic.

Introduction of e-Learning Center in Korea National Open University

Back to Basics – Electronic Patient Registry Essentials Adam Baus MA, MPH West Virginia University Department of Community Medicine Office of Health Services.

RDE Projects Sheryl Burgstahler Director, DO-IT (Disabilities, Opportunities, Internetworking, & Technology) Director, UW Accessible Technology University.

Senior Capstone Experience Framework A Guide for South Dakota Schools.

Effective Learning Support: The key to quality and success Enhancement of Learning Support.

Building a Culture of Leadership at Belmont High School Michael M. Harvey, Ed.D. Principal, Belmont High School.

Developing a Framework In Support of a Community of Practice in ABI Jason Newberry, Research Director Tanya Darisi, Senior Researcher

Learning Goals at St. John Fisher College Peter J. Gray, Ph.D. Director of Academic Assessment United States Naval Academy May 2004.

Research Needs to Support FDA Risk Communication Nancy M. Ostrove, Ph.D. Director for Risk Communication May 1, 2009.

This action-based research study used a descriptive triangulation process, which included quantitative and qualitative methods to analyze nursing students’

 Office of Extramural Research National Institutes of Health U.S. Department of Health and Human Services Henry Khachaturian, Ph.D. Acting NIH Research.

The Los Angeles Public Health Leadership Institute: An Intra-organizational Approach To Leadership Development APHA Session: The Challenge of Leadership.

Clarifying the Evaluation Focus in a Complex Program Context Howard Kress, PhD* Natalie Brown, MPH** *Battelle Memorial Institute, with National Center.

One Room, Many Doors: Logistics of Recruiting and Training Students in Neuroscience through an Undifferentiated Biomedical Program.

A Framework for Assessing Needs Across Multiple States, Stakeholders, and Topic Areas Stephanie Wilkerson & Mary Styers REL Appalachia American Evaluation.

ASSOCIATE PROFESSOR ADVANCEMENT Spring 2016 Workshop.

RADIATION ONCOLOGY DIRECTORS OF TRAINING WORKSHOP 30 MAY 2014.

Barriers and Facilitators to the Formative Use of Course Assessments in the Classroom by Teaching Assistants Mechelle Sanders University of Rochester,

Evaluation What is evaluation?

1 Vanderbilt University Name: Vanderbilt TAR Fellows Program Persons responsible: Thomas R. Harris, Derek Bruff, Jean Alley Time Commitment: Introductory.

Methods for Longitudinally Tracking Graduates of NCI’s R25E Short-term Cancer Research Training Program John Waterbor, MD, MS, DrPH 1, Luz A Padilla, MD.

The following is a presentation prepared for NASFAA’s 2016 National Conference in Washington, DC July 10 – 13, 2016.

Application of a Quantitative Methods degree within Industry

Presented by the Association of African Universities (AAU)

NIHR Post-doctoral Fellowship

Success in Graduate Study: Customize Your Education

Organizational Conditions For Excellence

Academic career development: Career development support for PhD-students and post-docs Janne Tienari.

Adjunct, newbies, and non-tenure track faculty – oh my!

Graduate Training Grants

Evaluation in the GEF and Training Module on Terminal Evaluations

Heather Brod, Executive Director of Faculty Affairs and FAME

Advising Doctoral Students

PhD Completion Project of Brown University Overview and Plans

Presentation transcript:

CCTS UIC Center For Clinical and Translational Science SUCCESS CASE METHOD: APPLICATION IN A CTSA CONTEXT Nancy J Bates, DrPH, RD, CHES Timothy Johnson, PhD University of Illinois at Chicago

OVERVIEW SCM Steps Focusing and planning the SCM Creating an impact model Surveying for best and worst cases Interviewing & documenting success cases Communicating findings, conclusions and recommendations TL1 Success Case Example Lessons Learned

The SCM Book

Background: SCM SIMILAR to other evaluation methods UNIQUE purpose is to help stakeholders understand what worked, what did not, what important results have been achieved what can be done to improve program delivery and outcomes DOES NOT claim to be a comprehensive evaluation Focusing and planning the SCM

Creating an impact model O U T C O M E S ACTIVITIES OUTPUTS SHORT-TERM LONGER-TERM Established TL1 training program & TR program Develop/ Implement formal program for TL1s and Pre- doctoral Support for Translational Research (TR) Program Develop/ Implement formal program for TL1s and Pre- doctoral Support for Translational Research (TR) Program # TL1s & TRs admitted/graduated TL1s & TRs /faculty feedback/evaluation # TL1s & TRs students supported by programs # programs developed # TL1s & TRs admitted/graduated TL1s & TRs /faculty feedback/evaluation # TL1s & TRs students supported by programs # programs developed Increased # of successful CTS researchers: ↑ TL1/TR placement in CTS track after grad ↑ CTS publications Increased # of successful CTS researchers: ↑ TL1/TR placement in CTS track after grad ↑ CTS publications

SURVEY FOR BEST AND WORST CASES Brinkerhoff recommends creating surveys to find relevant cases Existing CCTS User data

Inclusion Criteria More/Less Successful Cases

Interviews: Brinkerhoff’s Main Questions What’s really happening? What results, if any, is the program helping to produce? What is the monetary value of the results? How can the initiative be improved ?

TL1 Selected Interview Questions 1. What are you career goals? How will the program help you get there?

TL1 Selected Interview Questions 1. What are you career goals? How will the program help you get there? 2. In what ways is the program meeting (not meeting) your goals/needs?

TL1 Selected Interview Questions 1. What are you career goals? How will the program help you get there? 2. In what ways is the program meeting (not meeting) your goals/needs? 3. How are (will) you use the training in your work?

TL1 Selected Interview Questions 1. What are you career goals? How will the program help you get there? 2. In what ways is the program meeting (not meeting) your goals/needs? 3. How are (will) you use the training in your work? 4. What barriers do you experience?

TL1 Selected Interview Questions 1. What are you career goals? How will the program help you get there? 2. In what ways is the program meeting (not meeting) your goals/needs? 3. How are (will) you use the training in your work? 4. What barriers do you experience? 5. What challenges in balancing your time with the program?

TL1 Selected Interview Questions 1. What are you career goals? How will the program help you get there? 2. In what ways is the program meeting (not meeting) your goals/needs? 3. How are (will) you use the training in your work? 4. What barriers do you experience? 5. What challenges in balancing your time with the program? 6. What else would make the program more useful?

INTERVIEWING & DOCUMENTING SUCCESS CASES INTERVIEWING & DOCUMENTING SUCCESS CASES Semi-structured interviews Triangulation of data sources and methods Cross case analysis Atlas.ti software v. 6

INTERVIEWING & DOCUMENTING SUCCESS CASES INTERVIEWING & DOCUMENTING SUCCESS CASES Brinkerhoff’s Impact Profile Impact at a Glance Impact Story: Background and setting. Impact Story: Immediate outcomes. Impact Story: Organizational impact. Impact Story: What helped and what did not.

Documenting Case Example: Impact at a Glance: Outputs Are you reaching the audience you intended to reach? Yes # students admitted = 6 # students graduated = 2 Attrition: None Student feedback: Very grateful for the opportunity and pleased with the program.

Impact at a Glance: Long Term Outcomes ↑ TL1 placement in CTS track after grad: Grad 1: PhD: Job in consulting and life science Grad 2: MD/PhD: matched a residency program that was her top choice “[I hope to be] at a research institute teaching, doing research and clinical work. So if I can couple all those, I mean, that's my absolute dream to do.” ↑ CTS publications: MD/PhD grad: 2 published, writing others.

Impact Story: Background and Setting Program Description: This mentored TL1 consists of... Program Director: Larry Tobacman, MD,... Target group: Basic biomedical PhD candidates and MD/PhD candidates who have a translational topic for their dissertation and are preparing for careers as translational researchers. Reach: Are you reaching the people you intended to reach? All meet the eligibility criteria. Attrition: None.

Impact Story: What Helped? Funding Allows them to focus on their research Educational fund gives them a sense of ownership Helps PIs tremendously since they don’t have to pay their whole stipend

Impact Story: What Did Not Help? Did not understand the need for a clinical mentor MD/PhD: clinical training, clinicians on dissertation committee BUT very excited to have a PhD advisor who did clinical work PhD: just getting to clinical research

Impact Story: What to Improve? Sense of TL 1 Community Didn’t meet the other UIC TL1s until St. Louis meeting Didn't know What the administrative roles of people were How the details of everything worked Defined the community as having a: Physical location for TL1s Go-to person Listserv Place to hang out together and have informal conversations about their work.

COMMUNICATING FINDINGS, CONCLUSIONS AND RECOMMENDATIONS Brinkerhoff: Impact Profiles are often adequate in themselves Our experience: Generally true

LESSONS LEARNED We found that incorporating the SCM with cross-case study analysis methods of Yin (2008) and Stake (1995) added to our overall understanding of program success.

REFERENCES Brinkerhoff, Robert O. The Success Case Method: Find Out Quickly What’s Working and What’s Not. Berrett-Koehler Publishers, Stake, Robert E. The Art of Case Study Research. Sage Publications, Yin, Robert K. Case Study Research: Design and Methods. 4th ed. Sage Publications, 2008.

UIC Mascot Sparky D. Dragon

CCTS UIC Center For Clinical and Translational Science Nancy J Bates, DrPH, RD, CHES CCTS Senior Evaluation Specialist Timothy Johnson, PhD, Director, CCTS Evaluation and Tracking Professor, Department of Public Administration Director, Survey Research Laboratory This project was supported by the University of Illinois at Chicago (UIC) Center for Clinical and Translational Science (CCTS), Award Number UL1TR from the National Center for Research Resources. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Center for Research Resources or the National Institutes of Health.