Dr. Jennifer Weil Arns, Associate Professor, Dr. Robert V. Williams, Distinguished Professor Emeritus, Ms. Karen Miller, Doctoral Student School of Library.

Slides:



Advertisements
Similar presentations
The Robert Gordon University School of Engineering Dr. Mohamed Amish
Advertisements

RESEARCH PROPOSAL DR.URJA MANKAD.
A Meta-Assessment of Statewide Program Evaluations Jeffrey Pomerantz Carolyn Hank School of Info. & Library Science UNC Chapel Charles R.
Chapter 2 Analyzing the Business Case.
MANAGERIAL ACCOUNTING
ICS 442 Software Project Management
Systems Analysis & Design 7 th Edition Systems Analysis & Design 7 th Edition Toolkit 3.
To navigate the slide presentation, use the navigation bar on the left OR use your right and left arrow keys. Move your mouse over the key terms throughout.
Student Learning Development, TCD1 Systematic Approaches to Literature Reviewing Dr Tamara O’Connor Student Learning Development Trinity College Dublin.
GENERALIZING RESULTS © 2012 The McGraw-Hill Companies, Inc.
The Campbell Collaborationwww.campbellcollaboration.org Education Panel Session Comments and Points for Discussion Sandra Jo Wilson Vanderbilt University.
Chapter 2.
Spending Public Money Wisely Scaling-Up Educational Interventions Barbara Schneider John A. Hannah University Distinguished Professor College of Education.
Systems Analysis & Design Sixth Edition Systems Analysis & Design Sixth Edition Toolkit Part 3.
Analyzing the Business Case
Econ 231: Natural Resources and Environmental Economics SCHOOL OF APPLIED ECONOMICS.
Step 4: Gather Evidence Luann D’Ambrosio, MEd. Review: What to measure What amount of $ and time were invested What did the program actually consist of.
ALISE 2014 Conference Jeonghyun Kim & William E. Moen
FSU Center for Economic Forecasting and Analysis (CEFA) Economic Impact Study for the GFMC By Dr. Tim Lynch, Director Dr. Julie Harrington, Asst. Director.
ENHANCE Update Research Underway on the Validity of the Child Outcomes Summary (COS) Process ECO Center Advisory Board Meeting March 8, 2012 Arlington,
University of Sunderland CIFM02 Unit 3 COMM02 Project Evaluation Unit 3.
What research is Noun: The systematic investigation into and study of materials and sources in order to establish facts and reach new conclusions. Verb:
TEACHERS APPROACH TO ELECTRONIC INFORMATION RESOURCES Dr. G.SIVAPRASAD Lecturer in Library Science, MVGRR Degree college, Bhattiprolu Guntur (Dt.) B. DHANA.
WHERE TO START © 2012 The McGraw-Hill Companies, Inc.
A structured approach to writing a successful thesis and completing your PhD within time: the 5 chapter thesis Dr. Terence Love Curtin Research Fellow.
AU- MAEL Dr. Dan Bertrand
Program Evaluation. Program evaluation Methodological techniques of the social sciences social policy public welfare administration.
Research Designs Murray W. Enns Professor of Psychiatry.
CHAPTER 15, READING AND WRITING SOCIAL RESEARCH. Chapter Outline  Reading Social Research  Using the Internet Wisely  Writing Social Research  The.
“Say something worth saying about something worth saying something about.” Dr. Richard Paul & Dr. Linda Elder, “How to Write a Paragraph” 2007.
LECTURE 2 EPSY 642 META ANALYSIS FALL CONCEPTS AND OPERATIONS CONCEPTUAL DEFINITIONS: HOW ARE VARIABLES DEFINED? Variables are operationally defined.
Methods: Pointers for good practice Ensure that the method used is adequately described Use a multi-method approach and cross-check where possible - triangulation.
How to read a scientific paper
Contribution of TVET to economic growth: an Australian case study Peter Holden Executive Director, International.
Survey Methodology Lilian Ma November 6, Three aspects 1. How questions were designed 2. How data was collected 3. How samples were drawn Probability.
CHAPTER 12 Descriptive, Program Evaluation, and Advanced Methods.
บทบาทของนักสถิติต่อภาคธุรกิจ และอุตสาหกรรม. Scientific method refers to a body of techniques for investigating phenomena, acquiring new knowledge, or.
Centre for the Study of Learning and Performance: Systematic Review Theme Robert M. Bernard (Theme Leader) Philip C. Abrami Richard F. Schmid Anne Wade.
META-ANALYSIS, RESEARCH SYNTHESES AND SYSTEMATIC REVIEWS © LOUIS COHEN, LAWRENCE MANION & KEITH MORRISON.
Feasibility Study.
ProQuest Jennifer Jackson, Regional Sales Manager, ProQuest.
Systematic Approaches to Literature Reviewing Dr Tamara O’Connor Student Learning Development
Technical Review Process and Guidelines Dr. Pushpa Raj Sharma Professor in Child Health Institute of Medicine.
EBM --- Journal Reading Presenter :呂宥達 Date : 2005/10/27.
Research article structure: Where can reporting guidelines help? Iveta Simera The EQUATOR Network workshop 10 October 2012, Freiburg, Germany.
Copyright © 2011 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 18 Systematic Review and Meta-Analysis.
METHODS IN BEHAVIORAL RESEARCH NINTH EDITION PAUL C. COZBY.
Research Design Evidence Based Medicine Concepts and Glossary.
Erik Augustson, PhD, National Cancer Institute Susan Zbikowski, PhD, Alere Wellbeing Evaluation.
Economic valuation OF NATURAL RESOURCES
Evidence Based Practice (EBP) Riphah College of Rehabilitation Sciences(RCRS) Riphah International University Islamabad.
CRJS 4466 PROGRAM & POLICY EVALUATION LECTURE #6 Evaluation projects Questions?
 First thing that the reader will see and this will often determine whether they will read on  Capture their attention, so the title needs to succinctly.
PHYSICAL INVESTMENT, HEALTH INVESTMENT AND ECONOMIC COMPETITIVENESS IN AFRICA By Abiodun O. Folawewo and Adeniyi Jimmy Adedokun Department of Economics,
CHAPTER 1 THE FIELD OF SOCIAL PSYCHOLOGY. CHAPTER OBJECTIVES After reading this chapter, you should be able to: Offer a definition of social psychology.
Sociology. Sociology is a science because it uses the same techniques as other sciences Explaining social phenomena is what sociological theory is all.
Multivariate Analysis - Introduction. What is Multivariate Analysis? The expression multivariate analysis is used to describe analyses of data that have.
STEPS IN RESEARCH PROCESS 1. Identification of Research Problems This involves Identifying existing problems in an area of study (e.g. Home Economics),
Evidence Synthesis/Systematic Reviews of Eyewitness Accuracy
Multivariate Analysis - Introduction
Acquire information to guide business decision making.
Supplementary Table 1. PRISMA checklist
Research Methods Project
Chapter Six Training Evaluation.
Systematic Approaches to Literature Reviewing
Chapter Two: Review of the Literature
Chapter Two: Review of the Literature
Multivariate Analysis - Introduction
Meta-analysis, systematic reviews and research syntheses
Presentation transcript:

Dr. Jennifer Weil Arns, Associate Professor, Dr. Robert V. Williams, Distinguished Professor Emeritus, Ms. Karen Miller, Doctoral Student School of Library and Information Science University of South Carolina A Research Project Funded by IMLS

Source: Value Problem

 South Carolina (carried out by the University of South Carolina as a service to the South Carolina State Library; 2003, 2011) Cost and benefit estimates were based on a business model and standardized Public Library Survey income and expenditure data. Examined both direct and indirect benefits. State of Florida (Griffths, et al, 2004). Using a variety of estimation techniques, the report built on earlier work by Fraser, Nelson and McCure (2001,2002). Recent Response: Cost-Benefit Studies team.html

US Institute of Museum and Library Services Laura Bush 21 st Century Librarian Program. Grant #: RE : Assessing the Economic Value of Public Library Collections and Services: A Review of the Literature and Meta-Analysis (META) - a multi year research project designed to provide insight into these questions and a more robust model of the economic value of public libraries. Principle Investigator: Jennifer Weil Arns

The information I’m going to share with you today represents the preliminary result of a nationally funded study conducted primarily by a small group of dedicated researchers who, perhaps unwisely, decided to tackle this problem, first reviewing the literature on this topic and then conducting an experiment. Primary Researchers

Research questions: 1) Is there consistent and mounting evidence that public libraries contribute to the economic prosperity of the communities they serve 2) What steps might be taken in order to strengthen this assertion.

Approach and Methodology Meta-Analysis Meta-analysis is the statistical procedure for combining data from multiple studies. When the treatment effect (or effect size) is consistent from one study to the next, meta-analysis can be used to identify this common effect. When the effect varies from one study to the next, meta-analysis may be used to identify the reason for the variation.treatment effect Clinicians and applied researchers in medicine, education, psychology, criminal justice, and a host of other fields use meta- analysis to determine which interventions work, and which ones work best. Meta analysis is also widely used in basic research to evaluate the evidence in areas as diverse as sociology, social psychology, sex differences, finance and economics, political science, marketing, ecology and genetics, among others. Source:

An initial corpus of 143 value related studies was identified using Dialog file 438 Library Literature and Information Science; and the results of this search were analyzed and extended using University of South Carolina search services provided by Wilson Web (HW Wilson), CSA Illumina, and EBSCO. Internet searches were also conducted using the Google advanced search feature (search terms “libr* valu*) and random searches to locate referenced citations. Phase 1: The User’s Perspective Cost/ Benefit Analysis

For the purposes of analysis, the “treatment” of interest was considered to be an action: the expenditure of public funds. The intensity of the treatment was thought to be reflected in the size of the expenditure, and the effect of interest was initially defined as the benefits derived from these investments, all of which would be described in dollars. Phase 2: The Institutional Perspective Cost/ Benefit Analysis

Public HealthPublic Libraries Type of studyDrug trialPublic library survey ParticipantsPatientsIndividual libraries TreatmentDrugsPublic money EffectDrug responseExpenditure Metric of interestImprovement Net benefit

Data Collection IMLS Public Library Survey data were used for analysis. The full file includes elements that pertain to each of the over 9,000 public library systems located in the U.S., U.S. Territories, and the District of Columbia. The smaller State Summary file aggregates these data. These sources were attractive for several reasons: The variables were accompanied with operational definitions, the units of analysis were uniform, and the data were for the most amenable to analysis.

The Institutional Perspective Preliminary Results 2009 State Summary File: Descriptive Statistics Table 3: Phase 2 Descriptive Statistics 2009 Direct Return 2009 Indirect Return2009 Total Return 2011 Inflation Adjusted Total Return Total$4.15$1.54$5.69$5.97 Mean$4.43$1.55$5.97$6.26 Median$4.34$1.51$5.89$6.17 Min$1.77$1.32$3.20$3.35 Max$6.52$1.97$8.14$8.53

The Institutional Perspective Regional Analysis

The Institutional Perspective

Preliminary Results: Phase 2 Regional Meta-Analysis The Institutional Perspective The results of the preliminary meta-analysis we performed using the updated USC formula and the IMLS state summary file data suggest that we can be 95% confident that the mean total value is between $5.69 and $5.91

When the results described above are taken into consideration, the answer to our first research question appears to be yes – the analyses performed for this project suggest mounting and moderately consistent evidence that public libraries contribute to the economic prosperity of the communities they serve and that these benefits may be expected to range around $5.00 to $6.00 for every dollar spent. Research Question 1. Is there consistent and mounting evidence that public libraries contribute to the economic prosperity of the communities they serve

 Further meta-analysis  Better use of survey data.  Further examination of the intangible outcomes and benefits that are typically not taken into account in these cost benefit estimates. Three pathways to added value