ISRAEL LEDERHENDLER, PH.D NATIONAL INSTITUTES OF HEALTH EVALUATION 2009 NOVEMBER 12, 2009
Managing information overload Outputs and Outcomes Exploiting knowledge; Finding disruptive ideas Scientist are entrepreneurs Making ideas count Measuring Innovation It’s Almost Always About Innovation Lederhendler, Nov 2009
Factors Driving NIH Decisions Public Interest and Societal Demands Public Health Requirements Scientific Opportunities NIH Funding Priorities Funding Priorities of Institutes and Centers Lederhendler, Nov 2009
APPLICATIONPEER REVIEWPROGRAM & COUNCIL GRANTS MANAGEMENT PROGRAM: PRE & POST AWARD TitleSummary Statement RFAs, RFPs, PA’s Special Actions Notice of Grant Award Progress reports, checklist AbstractMerit EvaluationFunding Recommendation Terms & conditionsWorkshops, conferences Specific AimsEvaluate Specific Aims Administrative Actions ChecklistScientific Initiatives Research MethodsSignificance ImpactInitiatives, mission relevance Training Data PersonnelExpert RosterRosterAdministrative Assistance Technical Scientific Assistance Budget RequestBudget considerations Final budget approvalBudgetary Adjustments & Oversight Scientific Oversight InstitutionBars, regulationsInstitute PolicyRegulatory compliance oversight Opportunities, trends, gaps Do cuments and Decisions NIH Data is Mostly Generated from the Grants Business Process Str uctured Data Unstructured Data Lederhendler, Nov 2009
Office of the NIH Director Publications & Biomedical Progress Databases (examples) Think Tanks (examples) Reports to CongressConference AbstractsThomson ISINAS/Institute of Medicine Reporting Data Calls MedlineScopusRAND Scientific Coding Portfolio Analysis PubMed CentralOvidFamilies USA Trans-NIH InitiativesResearch AdvancesGene OntologyResearchAmerica! Workforce & Infrastructure Clinical TrialsSwiss-ProtIDA/STPI Budget PreparationDrugs, Diagnoses & Treatments ClinicalTrials.GovNIH Consensus Conference Policy Policy Analysis Treatment Guidelines Additional Data from Analysis and Other sources Outputs and Outcomes Data External to Grants Database Lederhendler, Nov 2009
Publications & Citations Data Adoption and diffusion of academic ideas History and structure of scientific communities Identification of disruptive ideas DIMENSIONS OF INNOVATION Lederhendler, Nov 2009
Validity Data quality New communication media PUBLICATION AND CITATION DATA Can’t live without it Lederhendler, Nov 2009
Adoption and Diffusion Science of Networks
History and Structure of a Field Lederhendler, Nov 2009
This visualization tracing citations shows that two seminal papers in 2002 and 2003 are widely cited in the community. Visual Overviews for Discovering Key Papers and Influences Across Research Fronts. Aleks Aris1, Ben Shneiderman1, Vahed Qazvinian2, and Dragomir Radev2 – thanks to Ping Want EVALUATING IMPACT IDENTIFYING DISRUPTIVE IDEAS Lederhendler, Nov 2009