1. Information Literacy: Assessing Your Instruction Texas Library Association District 10 Fall Workshop October 15, 2005 Michelle Millet Information Literacy Coordinator Trinity University, San Antonio, TX

2. Overview  History of Assessment and Information Literacy  Best Practices  Assessment at Trinity  Programmatic assessment  Other opportunities

3. Assessment of IL: a brief history  1. Higher education assessment movement  2. Strategic planning and TQM adoption  3. Evolution of information literacy

4. Activity 1  What does assessment mean to you?

5. Best practices documents  ACRL Best Practices Initiative: Characteristics of Programs of Information Literacy that Illustrate Best Practices, 2003  Standards for Libraries in Higher Education

6. 9 Principles of Good Practice for Assessing Student Learning 9 Principles of Good Practice for Assessing Student Learning  From American Association of Higher Education  Overarching principles to guide assessment  6. Assessment fosters wider improvement when representatives from across the educational community are involved.  8. Assessment is most likely to lead to improvement when it is part of a larger set of conditions that promote change.

7. What to assess?  Student learning outcomes Refers to the measurement of what a student actually learned in the course. Pre-tests and post-tests Annotated bibliographies Classroom assessment techniques (Angelo and Cross) Assignments!

8. What to assess? continued  Student perceptions M easures the perceptions that students have about the course content, the instructor’s knowledge and teaching ability, and what the students feel they learned from the course. Student evaluation forms Surveys Focus groups

9. What to assess? continued  Progress towards goals and objectives Refers to what some know as ‘inputs and outputs.’ Statistics on number/duration of courses, instruction sessions Number of hits to a web site Student follow-up appointments, drop in visits, emails

10. Small steps can take you far  Consult your library’s mission/values/goals documents. Is IL articulated in library documents? Is IL articulated in library documents?  Do you already keep basic statistics on students reached? Time spent preparing classes? This can be valuable evidence. This can be valuable evidence.  What kind of in-class activities do you already do? Collecting student work can be assessment. Collecting student work can be assessment.

11. Activity 2.  Name one “small step” that you would like to take next.

12. Research chart: measuring student learning

13. Student evaluation forms: measuring student perception Question Category Strong DisagreeDisagreeNeutralAgree Strong AgreeTOTALMean score cat 1 Respect for students 118241065126614.66 cat 2 Facilitated learning 145341135407064.64 cat 3 Appropriate to Assignment/ class 13526755606794.71 cat 4 Affective/ attitudinal changes 1211651674026574.42

14. Assessment or Evaluation?  What do we mean by assessment anyway? Assessment focuses on the end result Assessment focuses on the end result Evaluation focuses on the overall process Evaluation focuses on the overall process

15. Students Instruction/ Pedagogy Instruction Program Learning Outcomes Assessment Student-centered Learning

16. Assessment and Collaboration  Teaching faculty want to know…  Assessment in the classroom Use it as outreach to the teaching faculty Use it as outreach to the teaching faculty Share results and use as dialog for assignment design Share results and use as dialog for assignment design Build an integrated information literacy program within a distinct discipline Build an integrated information literacy program within a distinct discipline Build tailored first-year experience programs Build tailored first-year experience programs

17. Activity 3.  Who are your allies? Name two prospective collaborators.

18. Trinity University and IL  Information Literacy is relatively new  Challenges to change  2400 FTE, primarily liberal arts campus

19. Trinity’s Answer  Build an IL program and assess along the way What is an IL program? What is an IL program? Assessment was internally and externally focused Assessment was internally and externally focused  The end result is a program, fully integrated into the curriculum

20. Where do I begin?  How do you know what you are doing/building is effective?  What is most important to administrators?  How can you help those who may be working against you? Example: FYS and Lunches at Trinity Example: FYS and Lunches at Trinity

21. First Step  Where are you now? State of Information Literacy and Instruction State of Information Literacy and Instruction  What do you want to do next? Short term and long term goals. Know the difference. Short term and long term goals. Know the difference.  Go for the most impact!

22. Activity 4.  What is your goal? What do you want to achieve next?

23. Low Effort/High Impact  Creating programmatic assessment takes time and work Begin with low effort/high impact items Begin with low effort/high impact items Start tracking hours spent preparing for classStart tracking hours spent preparing for class Start tracking NEW classes coming in for instructionStart tracking NEW classes coming in for instruction

25. Best Practices as a Guideline for Assessment  Great tool to use as a guideline Collaboration/Integration Goal of Document Collaboration/Integration Goal of Document Check off what you’ve done Check off what you’ve done Check what you can do now (short term) Check what you can do now (short term) Which characteristics will be your guide for the future? Which characteristics will be your guide for the future?

26. Activity 5.  Is your “small step” LE/HI?  If not, do you have an alternative idea?

27. Creating a Plan  From your long term and short term goals Internal focus Internal focus (teaching, hours, # of classes)(teaching, hours, # of classes) External focus External focus (who are the active faculty, creating outcomes and standards, long-term studies)(who are the active faculty, creating outcomes and standards, long-term studies)  Focus on pieces: It WILL come together!

28. Activity 6.  One short term goal:  One long term goal:

29. Outcomes for your Plan  Example: Assessing Program Effectiveness (External) Outcome: Encourage broad faculty participation in instruction in order to ensure information literacy reaches across the curriculum. Outcome: Encourage broad faculty participation in instruction in order to ensure information literacy reaches across the curriculum. Assessment: Collect data concerning overall number of classes and departments using instruction, looking for increases in numbers of classes or departmental participation. Assessment: Collect data concerning overall number of classes and departments using instruction, looking for increases in numbers of classes or departmental participation.

30. Outcomes Continued  Assessing Program Effectiveness (Internal) Outcome: Hold workshop for librarians about integrating outcomes assessment in classes in order to help them be more effective in their teaching. Outcome: Hold workshop for librarians about integrating outcomes assessment in classes in order to help them be more effective in their teaching. Assessment: Have each librarian create three outcomes for every instruction session…Collect data from their assessments. Assessment: Have each librarian create three outcomes for every instruction session…Collect data from their assessments.

31. Activity 7.  Write one outcome using either your long term or short term goal. What do you want to know? Why? What do you want to know? Why? Don’t forget “in order to”Don’t forget “in order to”

32. Program Assessment Can:  Improve Teaching  Improve Student Learning  Provide Validation  Provide Validation

33. Five Questions  What do you want the instruction program to be able to do?  What factors does the program demonstrate or exhibit if they are meeting the outcomes?  How will you gather your data or evidence?  How will you determine if you have achieved your outcomes?  How will the discussion or evaluation of the data occur? Who will be involved?

34. Questions Translate Into…  Outcome What does an effective program do? What does an effective program do?  Indicator What will be happening? What will be happening?  Assessment How will the data be collected? How will the data be collected?  Criteria How will you know? How will you know? Immersion 2004

35. An Ongoing Culture of Assessment “Assessment is an ongoing process aimed at understanding and improving student learning.” Tom Angelo, AAHE Bulletin, 1996 ACRL Immersion 2004

36. Assessment Plans: Individual or Group Work

37. Questions? Thank You!