“Guerrilla Assessment”: Make It Manageable

Slides:



Advertisements
Similar presentations
March 23, Todays Outcomes By the end of todays workshop, participants will be able to... Revise and/or finalize SAOs within their areas Discover.
Advertisements

Measuring Information Literacy from Third Grader to College Senior Carolyn Radcliff, M.L.S., SAILS Project Director Julie Gedeon, Ph.D., TRAILS Assessment.
Gathering Evidence Educator Evaluation. Intended Outcomes At the end of this session, participants will be able to: Explain the three types of evidence.
15 th Distance Library Services Conference Outreach to International Campuses: Removing Barriers and Building Relationships Susan Mee Global Education.
Periodic Department Review A System of Affirmation LaMont Rouse Executive Director of Assessment, Accreditation & Compliance.
College of Education Graduate Programs Portfolio Workshop.
Understanding Teaching Effectiveness and Assessment Projects.
Dr. Timothy S. Brophy Director of Institutional Assessment University of Florida GRADUATE AND PROFESSIONAL PROGRAM ASSESSMENT PLANS.
Program Assessment Workshop Kathleen Harring. What is Assessment? Assessment is the systematic gathering and analysis of information to inform and improve.
How to Develop a Project Evaluation Plan Pat Gonzalez Office of Special Education Programs
Learning Outcomes Assessment RESULTS AND ACTION PLAN Beth Wuest Director, Academic Development and Assessment Lisa Garza Director, University Planning.
Accreditation: An Opportunity to Promote Information Technology Fluency NLII Annual Meeting San Diego, CA January 26, 2004 Joan K. Lippincott CNI.
Departmental Assessment Process.  The institution identifies expected outcomes, assesses the extent to which it achieves these outcomes, and provides.
A Breakout Session - Fall 2009 ASCCC Plenary Presented by Scott Lee, Antelope Valley College & John Koetzner, Mendocino College.
Helping Your Department Advance and Implement Effective Assessment Plans Presented by: Karen Froslid Jones Director, Institutional Research.
Applying the Principles of Prior Learning Assessment Debra A. Dagavarian Diane Holtzman Dennis Fotia.
Assistant Principal Meeting August 28, :00am to 12:00pm.
THE ASSESSMENT TWO-STEP: It’s more than a line dance.
SLOs for Librarians Kevin BontenbalScott Lee Cuesta CollegeAntelope Valley College.
EXAMINING AND EVALUATING REFERENCES SOURCES Determine the need, then devise an effective strategy to locate the information before evaluating and prescribing.
NEASCNEASC Standards Committees Kick-off Today’s Topic: Overview of the NEASC Game Plan and instructions for today’s work.
SACS CASI Southern Association of Colleges and Schools/ Council on Accreditation and School Improvement
Student Services Learning Outcomes and Assessment Jim Haynes, De Anza College Sept. 17, 2010.
Practicing Meaningful Learning Outcomes Assessment at UGA Department of Crop and Soil Sciences August 10, 2015 Dr. Leslie Gordon Associate Director for.
Student Support Services Standard II B & C. II.B. The institution recruits and admits diverse students who are able to benefit from its programs, consistent.
Closing the loop on information literacy instruction Toni Carter Instruction/Reference Librarian Auburn University Libraries GaCOMO & SELA 2012
Translation, Articulation, Communication Sarah Laleman Ward, Outreach Librarian Stephanie Margolin, Instructional Design Librarian CUNY Hunter College.
2006 Fall Workshop PLANNING and ASSESSMENT: A TUTORIAL FOR NEW DEPARTMENT CHAIRS – A REFRESHER COURSE FOR OTHERS.
Information Literacy: Assessing Your Instruction Texas Library Association District 10 Fall Workshop October 15, 2005 Michelle Millet Information Literacy.
College of Education Graduate Programs
Career Connections: Professional Literacy WPWVC ACRL Spring Meeting June 5, 2015 Dr. Janice Krueger Dr. Marilyn Harhai.
Assessment of Student Learning February Where we were Where we are now Where we are headed The Road to Assessment…
August 15th 2007 Assessment of Student Learning Outcomes by Kirby Hayes.
Learning Goals at St. John Fisher College Peter J. Gray, Ph.D. Director of Academic Assessment United States Naval Academy May 2004.
Assessment of Student Learning Outcomes February 2006.
LIBRARY MEDIA SPECIALISTS… Impacting Student Achievement.
The Importance of Professional Learning in Systems Reform AdvancED Performance Accreditation Bev Mortimer Concordia Superintendent
Council March PREVIOUS Reductionistic Whole = Sum of the Parts A Snapshot of the institution at a specific moment in time NEW Synergistic Whole.
Banned Books Week (Sept 25 – 29) Library Media Center CPHS.
Institutional Effectiveness: Administrative and Educational Support Assessment Units A Practical Handbook Incorporating TracDat Terminology.
A Commitment to Continuous Improvement in Teaching and Learning Michaela Rome, Ph.D. NYU Assistant Vice Provost for Assessment.
December 9, 2010 Laura A. Bayless, PhD Dean of Students St. Mary’s College of Maryland.
Effective Practices in Accreditation: Standard I Mission, Academic Quality and Institutional Effectiveness, and Integrity Stephanie Curry—Reedley College.
Assessment 101: Or Why and How to Assess ACRAO Spring Conference 2011 Presenter: Gladys Palma de Schrynemakers.
CONVOCATION AUGUST 14, 2014 THE LOOK AND FEEL OF TASKSTREAM.
325K: COMBINED PRIORITY FOR PERSONNEL PREPARATION Webinar on the Annual Performance Report for Continuation Funding Office of Special Education Programs.
325D: PREPARATION OF LEADERSHIP PERSONNEL Webinar on Project Objective and Performance Measures for the Annual Performance Report for Continuation Funding.
1 Institutional Quality and Accreditation: A Workshop on the Basics.
Assessment Strategies for Student Affairs
CBU CALIFORNIA BAPTIST UNIVERSITY Assessment, Accreditation, and Curriculum Office CBU - OIRPA.
Sarah Gilchrist, MLS Research and Instruction Librarian Albert S. Cook Library.
Instructional Leadership for a Professional Learning Culture:
CALIFORNIA BAPTIST UNIVERSITY Office of Educational Effectiveness
Objective The objective of creating a portfolio is to have one focused collection of evidence that documents TC success in meeting the learning outcomes.
Achieving the Dream Mark A. Smith.
Effective Outcomes Assessment
Building a Framework to Support the Culture Required for Student Centered Learning Jeff McCoy | Executive Director of Academic Innovation & Technology.
ED 690: Reflecting, Writing, and Reviewing the PDP
Preparing for the NWCCU 10-year Self-Study
BEST PRACTICES IN LIBRARY INSTRUCTION FORUM November 7, 2007
Strategic Directions: Taking Stock, year 2
Effective Practices in Accreditation: Standard I Mission, Academic Quality and Institutional Effectiveness, and Integrity Stephanie Curry—Reedley College.
Assessment and Program Review Learning Centers
Presented by: Skyline College SLOAC Committee Fall 2007
Assessing Academic Programs at IPFW
February 21-22, 2018.
Vernon Martin, ASCCC Accreditation Committee, Sierra College
Comprehensive Evaluation: Institutional Effectiveness Committee Recommendations Presentation to College Council Office of Institutional Effectiveness.
The Library Service Area Program Review
Institutional Self Evaluation Report Team Training
Presentation transcript:

“Guerrilla Assessment”: Make It Manageable Carol Smith, University Librarian, Colorado School of Mines Library Assessments Workshop, November 18, 2016

Meaningful: impact/improvement Quick review of strategic planning process ACRL Standards for Libraries in Higher Education Achievable assessment Meaningful assessment Assessment deliverables First steps (group work and individual homework) Impact (vs. just # of volumes – if the data doesn’t lead to impact/change, it isn’t meaningful assessment)

ACRL College Library Director Mentoring Program 2013 Cohort Susan Barnes Whyte / Linfield College Melissa Jadlos / St. John Fisher College Melissa Jadlos Library Director St. John Fisher College 585-385-8164 mjadlos@sjfc.edu Susan Barnes Whyte Library and Media Services Director Linfield College 503-883-2517 swhyte@linfield.edu http://acrl.ala.org/dirmentoring/

ACRL Standards for Libraries in Higher Education (2011) http://www.ala.org/acrl/standards/standardslibraries 9 Principles 57 (+/-) Performance Indicators Outcomes Assessment Evidence 9 Principles (standards) 57(+/-) associated Performance Indicators (library-centered) Outcomes: measurable ways in which library users are changed as a result of their contact with the library’s resources and programs (user-centered). Assessment: Gathering of qualitative and quantitative data to determine success of desired outcomes. Evidence: Demonstration of degree of success in desired outcomes (not all evidence requires assessment)   Outcome should be user-centric, preferably focusing on a specific population and articulating specifically what the user is able to do as an outcome of the performance indicator. The outcome examples provided follow a simple pattern: population, action (verb), object (what the population does). +/-: can toss some out, can add some specific to our library Impact (vs. just # of volumes – if the data doesn’t lead to impact/change, it isn’t meaningful assessment) Not all evidence requires assessment: for example: For each outcome, identify evidence: Some but not all evidence will require assessment/data gathering We already have more data than we think P.10 Professional Values: Libraries advance professional values of intellectual freedom, intellectual property rights and values, user privacy and confidentiality, collaboration, and user-centered service. 2.2.1 The library resists all efforts to censor library resources (our censorship display) 2.2.2 The library protects each library user’s right to privacy and confidentiality (ILS protections: III Sierra-no checkout history recorded; purging of patron records; creation of standard policy for NSA/FBI inquiries) 2.2.4 The library supports academic integrity and deters plagiarism through policy and education (included in library instruction? Document it) 4. Discovery LibGuides 8. Personnel 8.8.2 Library personnel have education and experience sufficient to their positions and the needs of the organization (gather CV’s; page from student training manual)

Achievable Assessment Impossible to assess everything continually (57+ performance indicators) Don’t feel pressure; keep it simple Break into small, achievable steps Address a limited # of performance indicators each year 4/year (Jadlos) = 14 years to assess all 57 indicators 6/year (1/librarian) = 10 years to assess all 57 indicators Select indiators that align with strategic plan objectives Create a cycle timed with accreditation cycle For accreditation, only need to look at one indicator when assessing a standard, not all. Try to review all standards by end of accreditation cycle. Meet/review regularly Guerrilla = achievable Must cover all 9 standards in cycle (see Jadlos example) Melissa Jadlos, Library Director, 2012 Library Journal Mover and Shaker, Lavery Library, St. John Fisher College, Rochester, NY 10-15 years: that’s okay with accreditation and assessment experts. It’s just important to show that you’re working on it. Might not revisit a principle until 2017 – way ok Assessment Fridays – but we can have monthly assessment reports or another mechanism 2016 HLC visit – nice, ties to our strategic plan

Meaningful Assessment: Close the loop for continuous improvement Choose Performance Indicator Identify desired outcome Assess Analyze for degree of success Identify and execute changes to make based on results Assess and describe impact of changes Describe the impact of what you did. As a result of assessment, we now do this. Assess, test, analyze, make changes based on results If you see a weakness, document it.

Deliverables Include assessment efforts in annual library reports Collect ongoing assessment efforts in a binder for HLC visits: 1 page summary about the library 1 page summary of overall assessment process followed Copy of ACRL Standards document 1 tab for each standard 1 page summary of each performance indicator assessed Evidence for each performance indicator Show to visiting accrediting agency Print it – not just electronic

Carol E. Smith Colorado School of MInes cesmith@mines.edu