Department of Information & Communications Online Information Literacy Audits: a longitudinal study Bob Glass & Jill Griffiths.

Slides:

Advertisements

Similar presentations

How do I teach that? Government Publications and Information Literacy in Academic Libraries Krista Godfrey OLA Super Conference 2006.

Advertisements

Information Literacy Instruction in Libraries

Information literacy: The seven pillars model (SCONUL)

Auditing Subject Knowledge in Initial Teacher Training using Online Methods.

March 2007 ULS Information Literacy and Assessment of Learning Program.

California Assessment of Student Performance and Progress

Bridging the Sophomore Gap: A Developmental Model of Information Literacy Shawn Bethke, Head of Library Public Services George Loveland, Library Director.

Assessment of a Web-based Information Literacy Program for Industrial Engineers Beth A. Smith, Asst. Prof., Engineering Librarian & Larry Whitman, Asst.

Information Literacy Defined A set of abilities that requires individuals: recognize what information is needed have the ability to locate, evaluate,

Assessment of General Education Patricia E. Beeson Vice Provost for Graduate and Undergraduate Studies February 11, 2008 University of Pittsburgh.

Enhancing Critical Thinking Skills 2012 HBCU Library Alliance Leadership Institute Presented By: Violene Williams, MLIS Reference Librarian James Herbert.

Measuring Information Literacy from Third Grader to College Senior Carolyn Radcliff, M.L.S., SAILS Project Director Julie Gedeon, Ph.D., TRAILS Assessment.

BEST PRACTICES IN INFORMATION LITERACY ASSESSMENT Yvonne Mery, Vicki Mills, Jill Newby, University of Arizona Libraries February 11, 2009.

Alcorn State University Information L I N K J. D. Boyd Library.

One Library’s Approach Presented by Bruce Kocour Carson-Newman College

3/1/2006Mary George, Leslie Murtha, and Luisa Paster1 Information Literacy Competency Standards for Higher Education ACRL 2000.

Visual Literacy Standards Task Force Open Meeting ACRL Image Resources Interest Group Virtual meeting, ALA Midwinter 2011.

Hold the door: Crossing the threshold from ACRL Information Literacy Standards to the new Framework OCULA Spring Conference 2015 Nancy Birch & Christopher.

WASHBURNWASHBURN Friends of Mabee Library October 28, 2004 Standardized Assessment of Information Literacy Skills Presented by Judy Druse Martha Imparato.

{ Computers and Writing, May 2011 The Compass for our Shared Space: Student Knowledge and iPad Integration ~Dr. Christine Cusick, Associate Professor of.

Information Literacy: Lingo or Opportunity for Learning? Jim Stenerson and Sarah Burns Feyl May Faculty Institute, 2004 Pace University.

1 Hitting a Moving Target: Curriculum Mapping, Information Literacy and Academe Kristen A. Bullard The University of Tennessee – Knoxville Assistant Professor.

R U There? Looking for those Teaching Moments in Chat Transcripts Frances Devlin, John Stratton and Lea Currie University of Kansas ALA Annual Conference.

Developing An Online Information Literacy Course Nancy O’Hanlon Ohio State University Libraries Wuhan University, China March 2007.

USING STUDENT OUTCOMES WHEN INTEGRATING INFORMATION LITERACY SKILLS INTO COURSES Information Literacy Department Asa H. Gordon Library Savannah State University.

Joanne Muellenbach, MLS, AHIP The Commonwealth Medical College Scranton, Pennsylvania June 26, 2012.

Library Instruction in North America Library Orientation (before 1980) –Tour of library, instruction in using card catalog, print indexes, reference works.

Information Literacy Tutorial for the First Time in College Student St. Philip’s College LRC San Antonio, Texas Dr. Adele S. Dendy, Dean of Learning Resources.

Consider your target audience and possible publication venues Access the most recent copy of the appropriate style guide and editorial policy and style.

Embedding information literacy into the curriculum - How do we know how well we are doing? Katharine Reedy (Open University) Cathie Jackson (Cardiff University)

Creating Assessments with English Language Learners in Mind In this module we will examine: Who are English Language Learners (ELL) and how are they identified?

Planning and Assessing Instruction Sessions Using Learning Outcomes Texas Library Association Annual Conference Houston, TX – March 31, 2009.

Comprehensive user education to successfully navigate the Internet Part 1 - Introduction Course developed by University Library of Debrecen.

University of Louisville Louisville, Kentucky, US

Librarians Prepare for their Global Information Role in the 21 st Century Hannelore B. Rader University of Louisville Louisville, Kentucky, US January.

External Assessment HL Paper 2. Where does the P2 fit? Paper 1: Essay Question20% You will be given 4 different essay choices and are asked to pick 1.

Information Literacy Skills of Graduate Students Research conducted at the Australian National University with 107 PhD students in 2003.

Developing Faculty-Librarian Partnership : Collaborative Initiative at Al Akhawayn University in Ifrane ( AUI ) Aziz El Hassani Hanane Kakrour Multimedia.

Assessing Credit –bearing Information Literacy Class using ACRL Information Literacy Competency Standards Wenli Gao Instructional Services Librarian Morrisville.

University Library Making the connections: assessment, training, progression and performance Dr A. Harrison: Institute of Psychological Sciences A.Newton:

Visual Literacy Standards Task Force Open Meeting ACRL Image Resources Interest Group ALA Annual 2010, Washington, DC.

The Library Imperial College London Debbi Boden & Sue Holloway Information Literacy: Its not sexy but it’s clever!

Information Literacy and the University Curriculum A Workshop Sponsored by CETLA and the University Howard University June 2005.

The Role of Libraries Special Committee Robert Morris University

Mark Lawrence William Hoag Ted Intarabumrung. What is Information Literacy? Ability to recognize when information is needed Abilities to: Locate, conduct.

Information Literacy in Academic Environments June 1, 2005 AMICAL Meeting No. 2 June 1-3, 2005 Delivered by Samira Rafidi Meghdessian Information Services.

After Launching Search & Discovery, Who Is Mission Control? A Tragicomedy in 8 or 9 Acts A Staged Reading Starring Bill, a Systems Librarian (William Denton)

Information Literacy Workshop Association of Architecture School Librarians Houston, TX – April 27, 2008.

Barbara F. Schloman, Ph.D., TRAILS Project Director Julie A. Gedeon, Ph.D., TRAILS Assessment Coordinator Kent State University Libraries and Media Services.

ACRL’s Information Literacy Competency Standards for Higher Education Why, Who, What? A Brief Overview Celita DeArmond, UTSA Library

Assessment of Information Literacy Presented by Touro College Libraries Sara Tabaei, Information Literacy Director Bashe Simon, Director of Touro Libraries.

Jennifer Schwelik, MEd, TRAILS Project Manager, KSU Paula Baco, MLS, Trumbull Career and Technical Center Using TRAILS: (Tools for Real-Time Assessment.

Information Competency Also known as Information Literacy.

SDCC Senior Project Course HD 495 Learning Outcome: Write a Literature Review on a Selected Topic Your Information Literacy Journal--- Contains your prior.

TOEFL EXAM By: Alexandra Alfonso Code: TOEFL The Test of English as a Foreign Language (TOEFL) measures the ability of nonnative speakers of English.

Assessment and Information Literacy Carole Hinshaw University of Central Florida Libraries Kristy Padron University of West Florida.

Information Literacy Dr. Nancy J. Becker LIS 205 Spring 2004.

Research Assignment Design Kerri Carter – ext Diane VanderPol

MICHIGAN EXAMS Presentado por: Kelly Roa Roa

1 6/5/2016 INFORMATION LITERACY AND PEDAGOGY FROM A LIBRARIAN’S POINT OF VIEW Beth Bloom

Kenneth C. C. Yang The University of Texas at El Paso Presented at 2016 Sun Conference TEACHING INFORMATION LITERACY SKILLS IN COLLEGE CLASSROOMS: EMPIRICAL.

Health Information Competencies of Information Age Students: Results from the Interactive Online Research Readiness Self- Assessment (RRSA) Lana Ivanitskaya.

Jennifer Schwelik, MEd, TRAILS Project Manager, KSU Jennifer Flaherty, MLS, Beachwood High School Librarian Paula Baco, MLS, Trumbull County Career Center.

Engaging students in information literacy through the Internet Detective Bob Glass and Margaret Kendall (LearnHigher, MMU) Emma Place (RDN, University.

SLO Convocation 2016 Locate, Critically Evaluate, Synthesize, Communicate Information Information Literacy at the Library and Beyond April 15, 2016.

An Introduction to Information Literacy for Secondary Education

Information Literacy Standards for Freshmen Seminars

Derek Herrmann & Ryan Smith University Assessment Services

Information Literacy: What is it and Why Should I Care?

Central Library. Presented By Shakil Ahmad Deanship of Library Affairs Imam Abdulrahman Bin Faisal University.

Presentation transcript:

Department of Information & Communications Online Information Literacy Audits: a longitudinal study Bob Glass & Jill Griffiths

Department of Information & Communications The activities undertaken address the following questions: 1. Is there value in administering online information literacy audits? 2. What do the results of these audits tell us? 3. Does intervention make a difference in the results? 4. Is there a need in for a UK designed, generic, online Information Literacy Audit? A three year study of two undergraduate cohorts The testing is based around an online web based Information Literacy Test from Steven Wise & Lynn Cameron (2004). The test is hosted by The Institute for Computer Based Assessment, James Madison University (2006)

Department of Information & Communications Who are the students? Information & Communications 65 students on 5 degree routes all studying the same six first year units Economics 19 students from1 degree route all studying the same six first year units A very mixed group socio economically, ethnically and chronologically Some students were working librarians Background

Department of Information & Communications What is the test? An Online, web based, multiple choice, using radio buttons for answer selection Asks 65 questions (60 live plus 5 trial questions) Uses the “Adaptex” Assessment System (Wise, S. L. & Yang, S. 2003) to manage the responses. Measures four of the five ACRL standards Testing takes around an hour to complete, no time limit set Students receive a score on completion of the test Tutors receive detailed performance data in a range of formats Devised by library and psychology practitioners

What is the test? ACRL Objectives – designed around ACRL standards for information literacy: ACRL1 – Determines the nature and extent of the information needed ACRL2 – Accesses needed information effectively and efficiently ACRL3 – Evaluates information and its sources critically and incorporates selected information into his or her knowledge base and value system ACRL4 – Assessed differently (essay) ACRL5 – Understands many of the economic, legal and social issues surrounding the use of information and access and uses Department of Information & Communications

What is the test? Format:

Department of Information & Communications Is there value in administering online information literacy audits? can provide a cohort baseline for tutors/ practitioners can provide interaction, information & feedback for the students can highlight areas for development with students can highlight areas for development in the curriculum can highlight areas for development for library practitioners

Department of Information & Communications What do the results tell us? 1.the majority of students scored well above the score required for “Proficient” 2. the mean score for ICO students was in the “Advanced” classification the mean score for Economics was almost identical 3. Only one in every 18 of the students failed to reach the Proficient grade (4 ICO students and 1 Economics) 4. just over a quarter of students were classed as Proficient two thirds were classed as Advanced

Preliminary results Department of Information & Communications

Preliminary results Department of Information & Communications

Preliminary results Department of Information & Communications

1: can the student define and articulate the nature and extent of the information needed. 2: can the student access needed information effectively and efficiently. 3: can the student evaluate information and its sources critically and incorporate selected information into his or her knowledge base and value system. 5: can the student understand many of the ethical, legal and socio-economic issues surrounding information and information technology. What is the test? Standards assessed : Standard 4 (written work) cannot be assessed by this type of test

Preliminary results Department of Information & Communications

Preliminary results Department of Information & Communications

Preliminary results Department of Information & Communications

Preliminary results Department of Information & Communications

Preliminary results Department of Information & Communications

Preliminary results Department of Information & Communications

What do the results tell us? 1.the majority of students were able to answer questions concerning defining and articulating the nature and extent of the information needed correctly 2. around half were not able to answer questions concerning accessing needed information effectively and efficiently correctly 3. two thirds were able to answer questions concerning evaluating information and its sources critically and being able to incorporate selected information into his or her knowledge base and value system 4. a similar number were able to answer questions concerning understanding many of the ethical, legal and socio-economic issues surrounding information and information technology correctly.

Department of Information & Communications What do the results tell us? ACRL2:Students struggled with answering questions about: Selecting the most appropriate methods and strategies for accessing the needed information, for example: Did not understand about different types of database and what a library catalogue was Could not determine the provenance of the information or sources Constructing and implementing effectively designed search strategies Did not know how to expand searches or apply them to different databases Refining the search strategy if necessary Unable to use boolean operators, truncation, phrase searching Extracting records and managing the information and its sources Could not recognise different item formats from bibliographic search results presented to them from databases

Department of Information & Communications The answers to our remaining questions Q. Does intervention make a difference in the results? Q. Is there a need in for a UK designed, generic, online Information Literacy Audit? Stage two testing completed 14 th March 2008 Stage two analysis completed by the end of May 2008 Stage three testing commences November 2008 In progress

Department of Information & Communications References The Association of College and Research Libraries (2000). Information Literacy Competency Standards for Higher Education. ACRL Wise, S. L. & Yang, S. (2003). The Adaptex Assessment System (Version 1.5). U.S. Department of Education Fund for the Improvement of Postsecondary Education. Wise,S,.L. Cameron, L.,Yang, S. & Davis, S. (2005) Information Literacy Test: Test Development and Administration Manual. Harrisonburg: Institute for Computer-Based Assessment; Center for Assessment & Research Studies, James Maddison University. The Institute for Computer Based Assessment, James Madison University(2006) Information Literacy Test (ILT) [Online: accessed 21st February 2008)