1. Source Code: Assessing Cited References to Measure Student Information Literacy Skills Dale Vidmar Information Literacy and Instruction Librarian Southern Oregon University vidmar@sou.edu http://webpages.sou.edu/~vidmar/oils2014/vidmar.pptx Oregon Information Literacy Summit Linn Benton Community College Albany, Oregon May 10, 2014

2. Learning Outcomes: Participants will be able to: Differentiate scholarly and relevant high quality sources. Differentiate scholarly and relevant high quality sources. Analyze citations included in papers to determine students’ ability to find and evaluate information sources. Analyze citations included in papers to determine students’ ability to find and evaluate information sources. Synthesize information gathered from references to draw conclusions about instructional and program effectiveness. Synthesize information gathered from references to draw conclusions about instructional and program effectiveness.

3. Institutional Assessment Direct Program Effectiveness Accountability/Comparability Student Achievement Learning/Improvement Indirect Student Work/Performance Surveys Informal observation Interviews Course evaluations Self-assessment Student Perceptions Exams Papers Presentations Projects Portfolios Accreditation Program Review Effectiveness Efficiency Standardized Embedded CATs Work samples (Capstones) Artifacts – Papers, Presentations, etc. CLA NSSE LibQual SAILS

5. Institutional Assessment Direct Program Effectiveness Accountability/Comparability Student Achievement Learning/Improvement Indirect Student Work/Performance Surveys Informal observation Interviews Course evaluations Self-assessment Student Perceptions Exams Papers Presentations Projects Portfolios Accreditation Program Review Effectiveness Efficiency Standardized Embedded CATs Work samples (Capstones) Artifacts – Papers, Presentations, etc. CLA NSSE LibQual SAILS

6. Institutional Assessment Direct Program Effectiveness Accountability/Comparability Student Achievement Learning/Improvement Indirect Student Work/Performance Surveys Informal observation Interviews Course evaluations Self-assessment Student Perceptions Exams Papers Presentations Projects Portfolios Accreditation Program Review Effectiveness Efficiency Standardized Embedded CATs Work samples (Capstones) Artifacts – Papers, Presentations, etc. CLA NSSE LibQual SAILS

8. 1) Align Learning Outcomes Foundational Goals – integrated throughout the curriculum from first-year to graduation. Communication – written and oral Communication – written and oral Critical thinking Critical thinking Information literacy Information literacy

9. 1) Align Learning Outcomes Foundational Goals – integrated throughout the curriculum from first-year to graduation. Communication – written and oral Communication – written and oral Critical thinking Critical thinking Information literacy Information literacy

10. Assess What is Valued For example: Multiple choice tests are a better measurement of factual knowledge. Multiple choice tests are a better measurement of factual knowledge. Performance tasks are a more effective measurement of procedural skills and higher order thinking. Performance tasks are a more effective measurement of procedural skills and higher order thinking.

11. Keep it Simple Do not try to assess everything all the time. Do not try to assess everything all the time. Assessment done well can become an all-encompassing job for people with a full-time job already. Assessment done well can become an all-encompassing job for people with a full-time job already. Be flexible and listen to others. Be flexible and listen to others. Synchronize assessments to function at more than one level. Synchronize assessments to function at more than one level.

12. Make It Relevant Assess actual student work— embedded assessments. Assess actual student work— embedded assessments. Assess work samples in which students have a vested interest in completing to the best of their ability. Assess work samples in which students have a vested interest in completing to the best of their ability.

13. Source Code: Citation Analysis – measure students ability to access and evaluate information through an analysis of the cited references used in a research paper or project such as a capstone paper.

14. Source Code: Rubric designed to review sources without reviewing how those sources are used within the body of the paper. Reviewers will have the first page of the paper in order to see the topic, thesis statement, and purpose.

15. Let’s Give it a Try Form a group of three or four. Form a group of three or four. Individually read over the first page of the paper and the list of references. Individually read over the first page of the paper and the list of references. Use the rubric to evaluate the list of references. Use the rubric to evaluate the list of references. Mark a score from 1 to 4 on the scoring sheet for each of the six proficiencies. Mark a score from 1 to 4 on the scoring sheet for each of the six proficiencies. You will have six scores for each paper. You will have six scores for each paper. As a group, discuss your scores to achieve a concensus scores. As a group, discuss your scores to achieve a concensus scores.

16. Source Code: What do the sample references/citations say about student learning— information literacy outcomes?

17. Source Code: What conclusions could we draw about the library instruction program as well as the institutional and departmental outcomes based on the student work samples?

18. Questions/Comments?

19. Source Code: Assessing Cited References to Measure Student Information Literacy Skills Dale Vidmar Information Literacy and Instruction Librarian Southern Oregon University vidmar@sou.edu http://webpages.sou.edu/~vidmar/oils2014/vidmar.pptx Oregon Information Literacy Summit Linn Benton Community College Albany, Oregon May 10, 2014