Developing & Disseminating Endurable Educational Products as a Form of Educational Scholarship Melly Goodell, MD ( Prog Dir, Racine Fam Med Residency) Deb Simpson, PhD (Director of Faculty Development) Sabina Diehr, MD (Director, Fam Med Student Interest Grp) Department of Family & Community Medicine Society for Teachers of Family Medicine April 29, 2006

Why Is this Important to Family Medicine Educators What we care about… Re-inventing the wheel Time efficient Quality – proven resources Build a community of educators Colleagues in education Advance our field and ourselves Teaching and Patient Care – integrated to improve care!

Objectives Define attributes associated with endurable educational products = criteria of scholarship Review existing outlets for publication of educational products Describe process for converting educational materials into submissions for peer reviewed educational repositories

Session Outline Overview of Education and Scholarship Endurable Products = Scholarship Overview of Repositories via brief discussion of selected products POwER Precepting Toolkit Mentoring & E-learning module OSVE Discussion

Overview of Education & Scholarship

Earnest Boyer Scholarship Reconsidered 1990

Glassick’s Scholarship Assessed Clear Goals Adequate Preparation Appropriate Methods Significant Results Effective Presentation Reflective Critique Objectives Current in educ + subject matter Select methods = obj Evaluation Dissemination to Peers Revise

Public (effectively presented) Peer reviewed IS IT SCHOLARSHIP? YES, IF IT’S… (3Ps) Public (effectively presented) Peer reviewed Platform others can build on —Shulman/Simpson PubLISH  Repositories

Making Public Endurable Products Name at least 3 places to obtain peer review dissemination of education related materials (endurable products) AAIM – Alliance for Academic Internal Medicine AAMC – MedEdPORTAL ACGME - RSVP ASE EPERC FMDRL - Family Medicine Digital Resources Library Health Sciences Consortium MERLOT POGOe STFM Bookstore

AAMC - MedEdPORTAL POwER Precepting Toolkit Faculty Development Module Video, CD ROM, speakers notes Can adapt to various audiences Accepted through peer review to MedEdPORTAL and STFM Bookstore Microsoft producer Started from a simple question, “what is active precepting” from Program Requirements. Initially a q/I project, then a national presentation. Strong national interest in topic/lively discussions at RAP/STFM. Everyone wanted the video. Went back to model (revise video, clean up concepts). With revised better quality video, had the start of a product. Added in presentations which included highlights from discussion time from prior presentations. STFM Bookstore, MedEdPORTAL, FMDRL.

MedEdPORTAL www.aamc.org/mededportal AAMC repository for medical education materials Multi-specialty Continuum Predoc-CME Peer reviewed and non Types of materials Curriculum modules Evaluation tools/assessments Teaching tools Didactic Materials This is just those listed by specialty under Fam Med. Can search by topic, AAMC “hot topic,” specialty etc. Some are available directly through links. Some you contact author for use. I have done both. Some are free, some small cost. Curric—case based, multimedia e-learning modules, guidelines Eval/Assesment tools—competencies Teaching: Critical Teaching Incident casebook, OSTE for residents as teachers Didactics—analyzing quality data, tutorials

Connects Boyer’s Scholarship forms and Glassicks criteria for scholarship – as the review criteria.

See handout 1=strongly agree

MedEdPORTAL & FMDRL Agreement to collaborate FM materials can be indexed on both sites Peer review of one will be accepted by the other Non peer review “dual” acceptance still under discussion FM materials would have broader medical education audience on MedED, since not just FM. Peer reviewed acceptance by FMDRL, product on server. Indexed on BOTH sites. MedED links to FMDRL for materials. Peer reviewed acceptance by MedEdPORTAL, indexed on BOTH sites. If product not compatible with server, links to author/purchase etc. MedEdPORTAL

www.fmdrl.org

STFM Bookstore  FMDRL Audience Content Mentors and Protégés Mentor Model Resources & References Annotated Case Examples Sabina: describe how project got started, submission process. Sabina be familiar with FMDRL.

Under Review with FMDRL & AAMC-MedEdPORTAL E-learning Course Under Review with FMDRL & AAMC-MedEdPORTAL

REMINDER: FMDRL & STFM Bookstore product linking is “in process” Enhance sharing and development of educational resources among FM educators Also includes proceedings from STFM and NAPCRG Option: Peer reviewed or non Materials: Conference presentations, curriculum, evals, didactics, multimedia MedEdPORTAL products might be on MedED server, or might be a link to the author for use of product, or for purchase. Sabina list examples?? REMINDER: FMDRL & STFM Bookstore product linking is “in process”

FMDRL Review Process Screen Peer Reviewed Right file sent? Content - appropriate for medical education? Peer Reviewed Submit their work as a Peer Reviewed Resource Review process equivalent to peer reviewed journal A group editor Chooses two reviewers from the STFM group author chose during the submission process. Makes the final accept/reject or accept pending revision Not Blinded Couldn’t find any reviewer checklist or additional detail for author submissions despite registering. http://www.fmdrl.org/index.cfm?event=c.auxPage&pageID=3#Review

This is what is displayed on ACGME site This is what is displayed on ACGME site. An abstract of tool, or summary of project

http://www.mcw.edu/display/router.asp?docid=9233 Also Accepted in: STFM Bookstore → FMDRL AAMC-MedEdPORTAL POGOe http://www.mcw.edu/display/router.asp?docid=9233

ACGME-RSVP Recognize Success Via imPlementation Showcase for works-in-progress Tools to teach and assess the general competencies Stimulation of ideas/development by GME community Brief (max 350 words) description/abstract, some with links to tool http://www.acgme.org/outcome/implement/rsvp.asp

Discussion What do you wish you could borrow from someone else? Where would you look to find them? Quality of product/repository (rigor/status) Potential breadth of dissemination What concepts/projects would others want to borrow from you? More rigor, status, broader dissemination

Summary of Today’s Discussion Why are we doing this? REVISITED We care about it Build upon others’ work, advance field QUALITY: Better education, better patient care Get familiar with the various repositories Examine the work you are already doing for dissemination Follow pathway of education & scholarship Excellence, informed, peer reviewed Mention my 3am L&D experience, suddenly planning for faculty retreat, increased familiarity with sites already has had impact. We should be sharing what we are doing, and also looking at these sites to see what we can use. We already work hard enough, let’s use what is being shared!

Other Repositories for Peer Reviewed Endurable Educational Products (if time to discuss)

POGOe Portal of Geriatric Online education Online clearinghouse for dissemination of high quality geriatric educational products Users can use or adapt tested products, authors can gain feedback Partnered with MedEdPORTAL Link to author site, upload tool to POGOe, or obtain product through communication with author Not Peer reviewed unless co-submit to MedEdPORTAL www.pogoe.org

POGOe Resources to enhancement patient assessment Pocket cards Web-based modules Virtual patient cases Didactics Syllabi

HEAL Health Education Assets Library Free digital resources for health sciences educators (medicine, nursing, pharm, etc) “promotes the preservation and exchange of useful educational assets while respecting ownership and privacy” Peer reviewed Individual submissions and “affiliated collections” www.healcentral.org

HEAL Triage Process – Sept 2004

HEAL Peer Review Content Process similar and criteria = AAMC MedEdPORTAL Content Case Studies Images Lectures Tutorials Virtual patient