1. Selection & Evaluation of Information Sources and Services
Dr. Dania Bilal
IS 530
Fall 2007

2. Why Evaluate Services?
Assess and improve the quality of existing services
Identify the need for new types of services or programs
Justify funding and support

3. Why Evaluate Services?
Manage human and physical resources more effectively and efficiently
Justify the need for maintaining services and need for additional programs

4. Levels of Evaluation
Lancaster’s scheme:
Inputs
Outputs
Outcomes

5. Levels of Evaluation: Inputs
Materials available to provide a service
Reference collection
Print and electronic
External materials (virtual)

6. Levels of Evaluation: Outputs
Measurement of quality of providing a service:
Answering reference questions
accuracy
completeness
Assistance given in using sources

7. Levels of Evaluation: Outcomes
Meeting user information needs
Level of satisfaction
Level of knowledge gained or improved
Discussion Question: How should professionals assess user satisfaction?

8. Evaluation Guidelines
RUSA guidelines for reference services

9. Selection of Reference Sources
RUSA Reference Committee
Outstanding Reference Sources
Annually in May issue of American Libraries
Print sources
Small- and medium-sized academic and public libraries
Online via RUSA website

10. Selection of Reference Sources
ARBA (American Reference Books Annual)
Guides
Guide to Reference Books
Walford’s Guide to Reference Materials
Recommended Reference Books for Small and Medium-Sized Libraries and Media Centers
Guide to Reference Materials for School Library Media Centers (Safford, Barbara R.)

11. Selection of Reference Sources
Booklist (Reference Book Bulletin)
Library Journal (print, websites, and databases)
School Library Journal
Reference & User Services Quarterly
Books in Print With Book Reviews
Choice (reviews electronic databases in each issue
Many other sources are listed in your text (Vol. I, chap. 3). These Sources serve as selection and evaluation tools.

12. Evaluation of Print Sources
Criteria:
Purpose
Authority
Currency
Physical condition
Format
Curriculum needs
Target audience
Objectiveness of content
Online availability
Cost

13. Evaluation of Electronic Databases
Purpose
Design
User Interface
Search and Retrieval features
Record structure
Navigation
Visual elements (icons, metaphors, colors, etc.)
Ease of use
Links to external resources (e.g., SFX)

14. Evaluation of Electronic Databases
Authority
Coverage (time period)
Scope (type of publications covered/indexed)
Full-text availability of articles
Target audience
Curriculum needs
Cost
Other criteria?

15. Evaluation of Intermediaries
Approachability
Knowledge of reference collection
Knowledge of local services and referral
Skills in identifying user needs (mediation)
(we will cover the evaluation of the reference process and mediators later in the course)
Communication with users

16. Evaluation of Reference Transactions
Types:
Obtrusive
Issues & challenges
Unobtrusive
Reference statistics

17. Evaluation of User Satisfaction
Assess satisfaction of all types of users, including specific populations
Techniques
interviews
telephone
Web