BEST PRACTICES IN LIBRARY INSTRUCTION FORUM November 7, 2007

Slides:

Advertisements

Similar presentations

Knowledge without boundaries. Outcome evaluation of PLIP projects: what, why and how? Ugne Lipeikaite PLIP Impact Manager

Advertisements

Proactive librarianship. Learning objectives On completion of this unit, participants will have: –Reviewed the key concepts of proactive librarianship.

Gathering Evidence Educator Evaluation. Intended Outcomes At the end of this session, participants will be able to: Explain the three types of evidence.

The Massachusetts Model System for Educator Evaluation Training Module 5: Gathering Evidence August

Unit 10: Evaluating Training and Return on Investment 2009.

The Impact of Immersion in a Local Research Problem on Technology Skills and Use CENTRAL WASHINGTON UNIVERSITY PREPARING TOMORROW’S TEACHERS TO USE TECHNOLOGY.

Evaluating and Revising the Physical Education Instructional Program.

S.M.Israr Training Evaluation By Dr Syed Israr Aga Khan university Karachi, Pakistan.

Shelley Zion, Ph.D. University of Colorado Denver

STUDENT AFFAIRS ASSESSMENT BOOT CAMP BALL STATE UNIVERSITY OCTOBER 22, 2009 ALAN HARGRAVE, ED.D. Writing Learning Outcomes.

Develop Systematic processes Mission Performance Criteria Feedback for Quality Assurance Assessment: Collection, Analysis of Evidence Evaluation: Interpretation.

How to Focus and Measure Outcomes Katherine Webb-Martinez Central Coast and South Region All Staff Conference April 23, 2008.

1. Continue to distinguish and clarify between Student Learning Outcomes (SLOs) and Service Area Outcomes (SAOs) 2. Develop broad SLOs/SAOs in order to.

Professional Growth Plan / Professional Development Guide.

Instructional/Program Design Produced by Dr. James J. Kirk Professor of HRD Western Carolina University.

Logic Models Handout 1.

Educational Solutions for Workforce Development Unit 8 – How to Evaluate Aim To provide an overview of how to effectively evaluate learning programmes.

Food Safety Professional Development for Early Childhood Educators Evaluation Plan.

LEARNING OUTCOMES WORKSHOP Dr. Jan Hillman University of North Texas January 8, 2007.

Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,

Outcome Based Evaluation for Digital Library Projects and Services

Introduction to Evaluation January 26, Slide 2 Innovation Network, Inc. Who We Are: Innovation Network National nonprofit organization Committed.

Kirkpatrick’s Levels of Evaluation

TRAINING EVALUATION WHAT? WHAT? WHY? WHY? HOW? HOW? SO WHAT? SO WHAT?

Foundations of Assessment I Understanding the Assessment Process.

ASSESSMENT. Assessment is the systematic and on-going process of collecting and reviewing evidence about the College's academic and administrative programs.

November 20, :00am – 11:00am As you enter, if you can hear.

W HAT IS M&E  Day-to-day follow up of activities during implementation to measure progress and identify deviations  Monitoring is the routine and systematic.

AASCB The Assurance of Learning AASCB Association to Advance Collegiate Schools of Business Marta Colón de Toro, SPHR Assessment Coordinator College of.

Barbara F. Schloman, Ph.D., TRAILS Project Director Julie A. Gedeon, Ph.D., TRAILS Assessment Coordinator Kent State University Libraries and Media Services.

VT University Libraries: Identifying, Teaching, and Assessing What Matters Most Office of Academic Assessment Ray Van Dyke,

Assessment of Student Learning in General Education AAHE/NCA 2003 Assessment Workshop Omaha, Nebraska ● June 2003.

Kaplan University Writing CenterSaturday, March 05, IX520 Needs Assessment and Evaluation in Education and Training Unit 7 Seminar September 13,

| wilmu.edu Drexel University Annual Conference on Teaching & Learning Assessment Dr. Ed Guthrie Dr. Bonnie Kirkpatrick September, 2015.

Evaluating Training The Kirkpatrick Model.

Instructional Leadership and Application of the Standards Aligned System Act 45 Program Requirements and ITQ Content Review October 14, 2010.

1 Outcomes: Outcomes: Libraries Change Lives — Libraries Change Lives — Oh yeah? Prove it. Oh yeah? Prove it. The Institute of Museum and Library Services.

A Hierarchy for Targeting Outcomes and Evaluating Their Achievement S. Kay Rockwell Professor and Evaluation Specialist Agricultural.

Teaching Strategies GOLD

Allison Nichols, Ed.D. Extension Specialist in Evaluation.

MTT Standard 5, Competency 9 Final Assessment Click to begin.

Logic Models How to Integrate Data Collection into your Everyday Work.

CHW Montana CHW Fundamentals

Evaluating the Quality and Impact of Community Benefit Programs

D2L Refresher Upload content into the Content section in a D2L course

Results Based Professional Learning Communities

Evaluation Emma King.

Training Trainers and Educators Unit 8 – How to Evaluate

Lecturette 2: Steps to Improve Data Use

The Lycurgus Group: Instructional Effectiveness Survey System

EVALUATION RESEARCH Research Methods

Chapter 15 Evaluating Dr. James Pelletier The Swain Department of Nursing.

Helping students know what they know

Program Evaluation Essentials-- Part 2

Training Trainers and Educators Unit 8 – How to Evaluate

GETTING ‘EVEN’ BETTER: FIVE LEVELS FOR PD EVALUATION

Getting to Know Yourself

Planning for Continuous Improvement: The importance of goal setting

Presented by: Skyline College SLOAC Committee Fall 2007

Lecturette 2: Steps to Improve Data Use

The Heart of Student Success

Education Theory and Practice B ETP520S

Assessments and the Kirkpatrick Model

Writing Instructional Objectives

Outcomes Based Evaluation

Welcome to Your New Position As An Instructor

Changing the Game The Logic Model

Finalization of the Action Plans and Development of Syllabus

Student Learning Outcomes Assessment

Evaluating Staff Development Initiatives

Presentation transcript:

BEST PRACTICES IN LIBRARY INSTRUCTION FORUM November 7, 2007 HOW DOES YOUR ASSESSMENT MEASURE UP? Karen Brown Dominican University

Goals: Discuss different levels of evaluation Examine the potential of outcomes-based evaluation Apply outcomes-based strategies to library user instruction

Kirkpatrick’s Levels of Evaluation LEVEL ONE: Reaction LEVEL TWO: Learning LEVEL THREE: Transfer LEVEL FOUR: Results

LEVEL 1: REACTION How did the participants react to the session?

LEVEL 2: LEARNING Have the skills, knowledge, or attitudes of the participants increased, improved, or advanced?

LEVEL 3: BEHAVIOR (or transfer) Do the participants use their newly acquired skills or knowledge in their jobs, courses, or personal endeavors?

LEVEL 4: RESULTS What impact has the instruction achieved?

OUTCOMES-BASED EVALUATION – Why has it gained so much attention? Ripple effect of “accountability culture” Influence of business models Aligns a program’s goals with the institution’s goals Integrated approach to assessment

Plan … Implement … Assess “If you don’t know where you are going, you will wind up somewhere else.” - Yogi Berra

Elements of Outcomes-Based Evaluation Documents benefits to program’s participants - What would participants recognize as the benefits? Focuses on outcomes vs. outputs Output: 51 course-related instruction sessions provided Outcome: Instructors report better use of research materials in students’ papers

Considers changes in: Skill: What someone can do Attitude: What someone feels/thinks about something Skill: What someone can do Knowledge: What someone knows Behavior: How someone acts Status: Someone’s social or professional condition Life condition: Someone’s physical condition From: IMLS, “Outcome Based Evaluation”: http://www.imls.gov/applicants/faqs.shtm

Important Questions to Ask 1. If we had an excellent and successful library user instruction program, what would be the impact or benefits? - administration - faculty - students - library staff - other stakeholders/constituent groups?

2. What would be the characteristics or indicators of success or excellence? - attitudes - skills - knowledge - behavior - status - life condition

3. How might we document this success or excellence? - Examples: interviews observation focus groups performance assessments journals or logs library use statistics

Application to Library User Instruction Students Faculty Library staff Library services and programs Administration of the institution

APPLICATION If you had a successful library instruction program, what would be the impact or benefits? - Describe how the success benefits the people served by the program What would be the characteristics or indicators of success? - Identify concrete and observable changes in attitudes, skills, knowledge, behaviors, status, and/or conditions How might you document or demonstrate the success? - What tools or methods would you use to gather data and information?