The Required Library Component: Assessing First-Year Teaching in the Small Academic Library Susan von Daum Tholl, PhD, Director Diane Zydlewski, Head of.

Slides:



Advertisements
Similar presentations
Elements of an Online Syllabus Contact: Melody Buckner Instructional Designer.
Advertisements

SLS 1503 Information Literacy Assessment Study ILIS Presentation.
Assessment of the Impact of Ubiquitous Computing on Learning Ross A. Griffith Wake Forest University Ubiquitous Computing Conference Seton Hall University.
Campus Collaboration to Build a Series of Information Competency Workshops Nancy Getty and Deborah Moore Glendale Community College LOEX 2007.
BEST PRACTICES IN INFORMATION LITERACY ASSESSMENT Yvonne Mery, Vicki Mills, Jill Newby, University of Arizona Libraries February 11, 2009.
Holyoke Public Schools Professional Development By, Judy Taylor
NWACC Library Instruction Program Teaching information literacy skills for academic success and lifelong learning.
Design of Reusable Multimedia Resources to Deepen Information Literacy North Carolina State University Libraries Kim Duckett Principal Librarian for Digital.
Why Bother? The Road To A Quality Information Literacy Assessment Study.
One Library’s Approach Presented by Bruce Kocour Carson-Newman College
Farmingdale State University of NY1 Information Management A Value-added Process Our goal is to illustrate a value-added process to assess Information.
Information Literacy Embedded in the Curriculum: A Collaborative Process or One way to spend your grant money Jennifer Groome, Reference Librarian Jack.
Ada Emmett and Judith Emde University of Kansas Libraries Assessing Chemical Information Literacy Skills using the ACRL Standards ALA 2006 Annual Meeting,
Ada Emmett and Judith Emde University of Kansas Libraries Assessing Chemical Information Literacy Skills using the ACRL Standards ALA 2006 Annual Meeting,
UNDERSTANDING, PLANNING AND PREPARING FOR THE SCHOOL-WIDE EVALUATION TOOL (SET)
May 18, Two Goals 1. Become knowledgeable about the QEP. 2. Consider your role in making the QEP a success.
Cumberland County: May 28 Oak Ridge: June 2 Roane County: June 4 Scott: June 4 Campbell: June 9 Knox: June 10 Loudon: June 11.
Library Instruction in North America Library Orientation (before 1980) –Tour of library, instruction in using card catalog, print indexes, reference works.
 8 years teaching English at SMSU  7 ½ years mentoring high school CEP teachers  Professional awareness of disconnect in high school and college standards.
Welcome to PC362: Managing Grants. Please set cell phones and pagers to silent Refrain from side discussions. We all want to hear what you have to say!
How to Use Data to Improve Student Learning Training Conducted at Campus-Based SLO Summit Spring 2014 How to Use Data to Improve Student Learning.
Developing an Online Credit-Bearing Information Fluency Course: Lessons Learned Rebecca Blakiston Yvonne Mery Leslie Sult University of Arizona Libraries.
Research Strategies Step-by-Step An Introduction to Library Research Questions about this activity? Contact Kimberley Stephenson at
Developing a programme of information literacy. Strategy Will you work at an institutional level? Will you work at a course level? Will you work at a.
Deborah Gentry, Instructional Development Center Randi Sutter, Library 14 th Annual Illinois Community College Assessment Fair.
Information Literacy Embedded in the Curriculum: A Collaborative Process or One way to spend your grant money Jenny Groome, Reference Librarian Jack Dougherty,
Plagiarism Instruction Online: Using an Interactive Information Literacy Tutorial to Assess Students’ Understanding of Academic Integrity Pamela A. Jackson.
Assessing Credit –bearing Information Literacy Class using ACRL Information Literacy Competency Standards Wenli Gao Instructional Services Librarian Morrisville.
Plagiarism: The Crime of Intellectual Kidnapping: An Interactive Information Competence Tutorial at San Jose State University Pamela A. Jackson Reference/Instruction.
Assessment cont’d tues oct 15. notes status reports [handout] instruction experience project – context description and needs assessment (due Tuesday)
Instruction & Assessment Plan, Melissa Bowles-Terry April 4, 2011.
Integrating Information Literacy Into the Classroom TLM Institute Technology & Information Literacy Mount Mary College May 30, 2002.
What IF? The University of Central Florida’s Strategy for Success Dr. Linda K. Colding University of Central Florida.
JENNIE MATHEWS ST. JOHN’S UNIVERSITY LIS 239 Can the Addition of Social Software Tools & Tags Improve the Productivity of an Academic Library OPAC? 1.
Online Information Competence Tutorials: Influencing Change in Traditional Library Classrooms Pamela Jackson and Charity Hope San José State University.
Law.monash.edu.au Law 1 Advanced legal research – incorporating research into the curriculum and the technology used to deliver this service Kathy Buxton.
Git Along Li’l Dogies Jim Kinnie University of Rhode Island Libraries Kerry Caparco Cross Mills Public Library A Collaborative Approach to Library Instruction.
We’ve set SAILS: Launching Library Assessment Across University Waters Auburn University Libraries Steering the Course Life Saving Support Thar Be Dragons.
Teaching Thermodynamics with Collaborative Learning Larry Caretto Mechanical Engineering Department June 9, 2006.
Classwork at Home Homework in Class. Dilemma: Too much Information - Not Enough Time → 1 hour 15 minutes for my presentation → Topics covered in Lecture.
LibQUAL+™ Process Management: Using the Web as a Management Tool Amy Hoseth Massachusetts LSTA Orientation Meeting Boston, MA October 21, 2005 old.libqual.org.
Replacing Old Bridges with New Kristen Motz Helen Woodman Ferris State University
Learning Stations: Actively Engaging Students in the E-Classroom Shelly Davis, Information Technology Librarian Judy Steere, Head of Technical Services.
Barbara F. Schloman, Ph.D., TRAILS Project Director Julie A. Gedeon, Ph.D., TRAILS Assessment Coordinator Kent State University Libraries and Media Services.
Learning Commons Machines Second Melody Burton & Cory Laverty People First.
An Assessment of the TA Web Certification Program: Four Years of Supporting the Use of Instructional Technology at the University of Minnesota Brad Cohen,
University of Texas Libraries Integrating Library Resources with Blackboard TBUG Conference, Fall 2006.
CAMERON UNIVERSITY LIBRARY LIBRARY SERVICES Fall 2009Program Quality Improvement Report
Online Information Competence Tutorials: Influencing Change in Traditional Library Classrooms Pamela Jackson San José State University Library MERLOT International.
Connecting Course Goals, Assignments, and Assessment Faculty Development for Student Success at Prince George’s Community College William Peirce
Information Literacy: Assessing Your Instruction Texas Library Association District 10 Fall Workshop October 15, 2005 Michelle Millet Information Literacy.
Project web site: old.libqual.org LibQUAL+™ Process Management: Using the Web as a Management Tool ALA Midwinter Conference San Diego, California January.
1 Spiraling Information Literacy Across Four Years Shawna (Smith) Egan Rivier University Nashua, NH Going Beyond the "One-Shot" 1.
Ma Lei Hsieh Instruction Librarian Rider University Patricia H. Dawson Science Librarian Rider University VALE User.
The Role of Instruction in a Contemporary Research Library Michelle Baildon November 10, 2005 Massachusetts Institute of Technology Libraries.
ESL Levels 4-6: Information Literacy and English Language Learning Websites This instructional PowerPoint was prepared by staff of Lower Columbia College.
MT ENGAGE Student Learning Outcomes and Assessment April 27, 2015.
Building an Information Literacy Requirement from the Ground Up: Embedding IL into First Year Seminar and Beyond Lisa Coats and Anne Pemberton University.
Instructional Plan | Slide 1 AET/515 Instructional Plan For Associate’s Degree in Library Skills (Donna Roy)
NOTE: To change the image on this slide, select the picture and delete it. Then click the Pictures icon in the placeholder to insert your own image. THE.
Faculty and Learning Resources Anthony Valenti Campus Director Learning Resources.
Bringing Student Affairs and Faculty Together Through StrengthsQuest™ Melissa McGuire Director of New Student and Student Success University of North Texas.
Flipping for Instruction: Using the Flipped Class Model in Library Instruction Eduardo Rivera Head of Reference Services – LIU Post SUNYLA 2015 June 5,
How do you use library instruction?. Library Instruction That Improves Self-Efficacy and Academic Achievement 2016 Innovations Conference, Chicago, Illinois.
SLA San Diego Fall Seminar Round Table Discussion
Sneakin’ it in: Finding opportunities for Information Literacy
Information literacy instruction and assessment : a collaborate design
Individualized research consultations in academic libraries: Useful or useless? Let the evidence speak for itself Karine Fournier Lindsey Sikora Health.
The Writing and Research Workshop Series: An Overview
Imperfect but Authentic and Invaluable
Presentation transcript:

The Required Library Component: Assessing First-Year Teaching in the Small Academic Library Susan von Daum Tholl, PhD, Director Diane Zydlewski, Head of Reference Anne Hancock, Collection Development Librarian

Scope of our discussion Setting the stage—gaining administration approval for a required library component Development of the library curriculum within the FYS; one- on-one faculty collaboration and attendance at FYS faculty meetings Hybrid approach and revision of our online tutorial Continual modifications of assignments and library workshop Data gathering; faculty collaboration Statistical analysis, which is ongoing Use of our results to mold the future....

Pre-2005 — Basic info lit session offered in non-credited venues Fall 2005 — First-Year Seminars required Library Component offered in both fall and spring semester 2005-Spring 2007 — Worked 1 on 1 with faculty on assignments — Piloted customized assignments and pre- and post- testing by individual seminar Fall 2008 — Applied to IRB; approval received January 2009 Fall 2009 — 3-Year Study began; all seminars offered in Fall semester Fall 2011 — Study completed Timeline of Development

Stated Goal of FYS “engage first-year students in research and learning the basic elements of conducting research specifically using the resources of the library”

Pre-2005 — Basic info lit session offered in non-credited venues Fall 2005 — First-Year Seminars required Library Component offered in both fall and spring semester 2005-Spring 2007 — Worked 1 on 1 with faculty on assignments — Piloted customized assignments and pre- and post- testing by individual seminar Fall 2008 — Applied to IRB; approval received January 2009 Fall 2009 — 3-Year Study began; all seminars offered in Fall semester Fall 2011 — Study completed Timeline of Development

Pre-Test Online Tutorial and Welcome Assignment Workshop & Workshop Assignment – Clickers (Year 3) Evaluation Assignment (Years 1 & 2) Post- Test Substance of the Library Component from fall 2009 to fall 2011

Criteria for eligibility of participants: First-Year entering students Age (over 18 years of age at the pre-test) Completion of both pre- and post-test Consent letter explaining the process for opting out Data collected for individual students: Pre- and Post-test scores Assignment grades Number of assignments completed Gender

Year Eligible Participants/ Enrollments % students showing positive change pre- to post-test for all participants % increase pre- to pos-test for all participants Average pre- test grade Average post-test grade Fall /366 (90.00%) 88.89%45.01% MIN=-50.00% MAX=300.00% MIN=2.00 MAX= MIN=1.00 MAX=18.00 Fall /542 (75.83%) 88.10%48.65% MIN=-30.00% MAX=550.00% MIN=2.00 MAX= MIN=6.00 MAX=18.00 Fall /551 (80.40%) 97.97%54.38% MIN= % MAX=500.00% MIN=2.00 MAX= MIN=5.00 MAX=18.00 Rates of Improvement during the Study

A Hybrid Approach: Combining a Hands-On Workshop and an Online Tutorial Diane Zydlewski, Head of Reference

The Evolving Role of the Tutorial Fall 2003 Online PowerPoint Presentation accompanying a live presentation. Fall 2005 Web-based Tutorial completed independently or in a workshop. Spring 2008 Web-based Tutorial completed during a required workshop. Fall 2008 Combination of the tutorial and hands- on activities in the workshop.

Pre-Test Online Tutorial and Welcome Assignment Workshop with clickers and Workshop / Evaluation Assignment Post-Test Current Role of the Tutorial within the Library Component of FYS Program

Scope of the Tutorial

Pop-up alert appears if the wrong answer is selected.

Technical and Design Aspects of the tutorial (See also the best practices handout.)

Fall 2005 Simulation of Library Web Site.

Fall 2011

Spring 2007

Fall 2011

Assignments: A Dynamic Information Literacy Tool Anne Hancock, Collection Development Librarian

Welcome Assignment Complete one week before workshop Register for Library Barcode Questions covered: basic library info creating search strings online catalog online databases Workshop Assignment Hand out during Library Workshop Identify research topic Create search string Find book, article, and website Complete outside of class, due 1 week later Evaluate resources found in Workshop for content quality Create citation Done Concept & Design : A “Stepped” Approach Evaluation & Citation Assignment

PROBLEMS Too much material Assignment questions unclear Faculty confusion about assignment Students not reading instructions The Welcome Assignment SOLUTIONS Pared down scope Conformed assignment questions to tutorial language and SIMPLIFIED. Reinforced assignment process with faculty Made instructions stand out more (increased spacing and font )

PROBLEMS Students did not have enough time!!!! Workshop sessions of different lengths (50 or 75 minutes) Number and types of resources a challenge Search String CONFUSION!!! The Workshop Assignment SOLUTIONS Pared down number of resources we asked students to find. Simplified search string portion of assignment.

PROBLEMS Questions open-ended Student answers incomplete Difficult to grade subjective questions in a standardized way Citations Faculty and Student perceptions The Evaluation & Citation Assignment SOLUTIONS Rewrote assignment Used guided evaluation questions Removed open-ended questions Removed formal citation and asked bibliographic questions instead. Eliminated assignment in 2011

Prior to IRB study Faculty First 2 years of IRB study Team of Librarians Last year of IRB study One Librarian Grading Methods

Data Gathering & Analysis Data Collected: Pre- and Post-test scores and question by question answers Assignment grades Number of assignments completed Gender Data Analysis: Created IBM SPSS database for each year Data entered into IBM SPSS Using IBM SPSS software to run statistical tests

Year Eligible Participants/ Enrollments % students showing positive change pre- to post-test for all participants % increase pre- to pos-test for all participants Average pre- test grade Average post-test grade Fall /366 (90.00%) 88.89%45.01% MIN=-50.00% MAX=300.00% MIN=2.00 MAX= MIN=1.00 MAX=18.00 Fall /542 (75.83%) 88.10%48.65% MIN=-30.00% MAX=550.00% MIN=2.00 MAX= MIN=6.00 MAX=18.00 Fall /551 (80.40%) 97.97%54.38% MIN= % MAX=500.00% MIN=2.00 MAX= MIN=5.00 MAX=18.00 Rates of Improvement during the Study

Use of Results to Mold the Future Library Component... Statistical analysis is ongoing. Analyze results of the pre- and post-test question-by- question to identify patterns of item difficulty to indicate what our teaching must address. We are looking at completion rates for the Assignments as they relate to individual student learning outcomes on the post-test.

The Future... Rework the pre- and post-tests, clarifying some language and creating distractors to develop a stronger test. Aside from the IRB Study, anonymous “clicker” data on self-efficacy and student satisfaction from the workshops needs to be compiled and analyzed.

The Study as a springboard for new initiatives.... Use statistical analysis to help to inform the various levels of our Information Literacy Program Formalize our required Library Workshop in the First- Year Writing Program, whose topic is a more advanced look at evaluation, especially online resources Apply to IRB for a follow-up study of participants in Years 2 and 3 of the FYS Study when they are Seniors Develop focus groups with the Instructional Assistants Fill a new FT position – Instructional Librarian Create a faculty development program

Thank you! Our Contact information: Susan von Daum Tholl, PhD Diane Zydlewski Anne Hancock