Alliance Annual Report Data and Measures for Alliance Member Staff Annie Downey, Assessment Team Chair Summer Meeting 2016

Background and Framework Re-direction of the Assessment Team’s work by the Board Focusing on items for an Alliance annual report What member staff need (here!) What Council members need Narrative: Explain the difference between administrative and operational needs, the importance of framing an annual report that captures BOTH Emphasize that there will be a parallel session in the Council meeting later this week; what’s captured here and what’s there are both part of the final list of needs Dana and Faye are here as observers

Questions and Data Capture Give them the handout, invite individual work for a few minutes Then call on six discussion leaders around the room to do the small groups and record on flip charts Then use following slides to solicit suggestions for each area; mark up flip charts with anything additional from group

Collaborative Workforce Are members participating in the Alliance’s collaborative work?

Collection Development What resources are available through the Alliance Shared Content, Courier and CCD Programs and services? Does Alliance activity in this area save members money?

Ex Libris Support System Do we have effective support mechanisms from central staff and Ex Libris to meet member needs? Are Alliance members participating in Ex Libris-sponsored activities to improve the product? Is Ex Libris meeting obligations under the contract?

Shared Infrastructure Are we testing enhancements to products on behalf of membership to facilitate organization-wide and institution decision making? Are we ensuring that all user interfaces associated with the Alliance meet commonly accepted standards for usability and accessibility?

Member Participation in Alliance Activities Are members participating in the Alliance’s shared work? Who is over- or under- participating?

Education & Training of Members Are members participating in training? Are members satisfied with the training?

Compare With Current Data Collected

Resources Available through SC, Courier, and CCD Programs/Services # of books shared/year # of Courier packages/year # ebook subscriptions # DDA ebook subscriptions # of finding aids retrieved from Archives West (forthcoming) # of digital objects aggregated Collection Development first

Does Alliance activity in this area save members money? DDA transaction reports EBL weekly expenditures Subscription savings for Alliance and per member eBrary academic complete usage

Do we have effective support mechanisms from central staff and Ex Libris to meet member needs? # of open cases at Ex Libris Length of time cases are open (new) Member satisfaction with support Now on to the Ex Libris support system

Are Alliance member participating in Ex Libris-sponsored activities to improve the product? # of people participating in Ex Libris-sponsored activities (working groups, ELUNA, etc.)

Is Ex Libris meeting obligations under the contract? (proposed) Information related to performance on Service Level Agreement

Are we testing enhancements to products on behalf of membership to facilitate organization-wide and institution decision making? Number of Ex Libris product enhancements/releases tested through collaborative efforts Number of member institutions participating in usability testing

Are we ensuring that all user interfaces meet commonly accepted usability and accessibility standards? Google Analytics on Primo (proposed) and Archives West (in place) expose strengths and weaknesses Adherence to current accessibility standards

Are members participating in the Alliance’s shared work? # of individuals from each organization participating in all groups Now on to member participation

Are members participating in training? # of training opportunities offered each year # of people participating Last, education and training

Are members satisfied with this training? Information from end-of-training surveys on level of satisfaction