Florida’s Outcome-Based Evaluation Program Finding the Fit with Multitype Library Cooperatives Sondra Taylor-Furbee June 15, 2002

LSTA and Outcomes n 1998 Florida participated in first IMLS pilot project to begin looking at outcomes n Revisited our sub-grant program

LSTA Grants n Application must be developed with anticipated outcomes n Annual and mid-year reports address outcomes n Outcomes are stated in terms of the benefit to customer

Traditional Project Measurement:

Outcomes Measurement

Categories for LSTA Grants n Access for Persons Having Difficulty Using Libraries n Library Technology Connectivity and Services

Sample Common Outcomes n Public uses technology to get information Public learns to use technology

Eligible Types of Libraries n Public Libraries n Academic Libraries n Special Libraries n School Libraries Multitype Library Cooperatives

n Central Florida Library Cooperative n Northeast Florida Library Information Network n Panhandle Library Access Network n Southeast Florida Library Information Network n Southwest Florida Library Network Tampa Bay Library Consortium

MLC Membership n Total Membership: 358 Libraries *121 Academic *106 Public *87 Special *44 School

Operating Income by Source n Local39% n State 23% n Federal38%

LSTA Grant from CFLC: Technology Training for Central Florida Libraries n Purpose: Provide technology training to the staff of member libraries to assist in service to the public.

Activities n Hire Continuing Education Coordinator n Develop and update curriculum n Schedule workshops n Develop offsite training facilities n Conduct workshops

Outcomes: n Library staff is able to use technology to assist patrons to obtain information n Library staff is able to use technology to assist patrons in operating computers

Indicators: n 75% staff attending workshops increase technology knowledge and comfort level of working with patrons

Evaluation n Sample outputs –Number of classes –Number of participants n For outcome: –Training workshop evaluations –Trainer observation –Follow up survey

Midyear Report: n Developed 2 new workshops n More training opportunities n Developed trainers observation checklist n Developing follow-up survey n Developing automated evaluations for classes

TBLC Anytime Anywhere Library n Brings together resources of Tampa Bay libraries for access by anyone, at anytime, from anywhere, via the Internet. n Pilot regional virtual library including ILL. n

Outcomes n Public uses technology to get information n Participants learn to use technology

Activities n Create virtual library umbrella web site for use by the public n Expand pilot regional virtual catalog and ILL system n Enable customers of participating library to request materials n Implement remote authentication for customers

Evaluation n Outputs –# hits on Alleycat website –# requests for ILL –# training sessions –# content links n Outcome Source Methods: – survey to Alleycat users –Training Class evaluation forms

NEFLIN n Digital Imaging of Special Collections –Local history collections from Alachua County,Putnam County, and Jacksonville University –User surveys

PLAN n Plan Academy - Technology Training –Evaluation forms –Post training surveys –Anecdotal report

SEFLIN n Has LSTA grant applications online - can see LSTA outcome model n Mi Servicio de Biblioteca –Access to library services for Spanish- speaking population –Online survey

SWFLN n Technology Training –Workshop evaluations –Postcard survey

Benefits n Cooperatives have impacts can report to members, potential members, funders n State Library can aggregate changes MLCs have made in Florida

MLC web sites n CFLChttp://cflc.net/ n NEFLINhttp:// n PLANhttp://plan.lib.fl.us/ n SEFLINhttp:// n SWFLNhttp:// n TBLChttp://