Are we on the right track? Using Outcomes Based Assessment LINDSAY HANSON, DATA ANALYSIS LIBRARIAN

A Little About Me… Hobby Farmer Been with Sno-Isle since 2011 Background in Biology Role as Data Analysis Librarian And now onto Outcomes Based Assessment!

“Tiger” by Bud Blake

What is “Outcomes Based Assessment”? A. A good way to frustrate people? B. The next new meaningless trend? C. A new way to talk about something we’ve done for a long time? D. A way to ensure that we’re “on the right track”

What is “Outcomes Based Assessment”? A framework for knowing whether our efforts and resources are achieving the intended results.

A framework for knowing whether our efforts and resources are achieving the intended results. There are two parts to this: Are we achieving our goals? AND – are we doing so because of our efforts and resources

Why do we care? We only have a limited amount of resources We want to have a positive impact in our community And – we want to be able to demonstrate our positive impact to our community

What are we trying to achieve? Strategic and effective use of public funds Provision of library services that have an impact on the needs of our community

How is this any different from what we’ve done in the past? Profound shift in the way we think about what we do Necessitates defining clear parameters for success before a project or service begins Requires us to evaluate differently

What does it look like? This is from the intranet! intranet

What does it look like? This is from the intranet!intranet

What does it look like? Example Project: Cultivate an organic fruit orchard at my home.

Cultivate an organic fruit orchard at my home. We need some definitions to help us plan our project and determine the outcomes we hope to see: What needs to happen with the fruit trees? What is the timeline of the project? How will we know when the project is over and whether it was a success? What are the specific (measureable) goals?

Cultivate an organic fruit orchard at my home. Our project goal should be: Grow 20lbs of organic apples, pears, plums and figs annually within the next four years on my property.

Inputs (resource perspective): Cost of trees Cost of fertilizer Water Labor estimates

Grow 20lbs of organic apples, pears, plums and figs annually within the next four years on my property. Outputs (operational perspective): Number of trees planted #s of fruit harvested after 4 years Resources used

Outcomes (user perspective): Fresh fruit is available to me Enjoyment of working in the orchard Grow 20lbs of organic apples, pears, plums and figs annually within the next four years on my property.

Impact (stakeholder/community perspective): My family has a healthier lifestyle Knowledge of organic cultivation methods can be taught to my child and shared with my community My purchases will support local businesses who support organic agriculture Grow 20lbs of organic apples, pears, plums and figs annually within the next four years on my property.

Research Evaluation Pyramid Systematic Reviews Randomized Control Trials Cohort Studies Case-Controlled Studies Program Evaluation, Opinion Surveys Case Studies, Expert Opinion Least reliable Most reliable

My role in the project process An idea can be submitted to a Manager or directly to the Data Analysis Librarian Do you know your outcomes? Concept

My role in the project process Manager Manager provides feedback and suggestions if needed, then gives the OK to submit proposal. Or Manager suggests consulting with the Data Analysis Librarian before proposal is submitted.

My role in the project process Data Analysis Librarian Data Analysis Librarian helps define needed data and sources to assess project Data Analysis Librarian coordinates and assists with data collection efforts Data Analysis Librarian provides interpretation (analysis!) of results

Now for some practice! Determine the following: Inputs (resource perspective) Outputs (operational perspective) Outcomes (user perspective) Impact (stakeholder/community perspective)

Further Resources Our own Intranet! Just search for “outcomes” How libraries and librarians help: a guide to identifying user-centered outcomesHow libraries and librarians help: a guide to identifying user-centered outcomes Evaluating the impact of your library Me – please feel free to ask me questions anytime!

Questions?