Using the Best Evidence to Find Solutions that Make a Difference Robert Pacheco Director of Research, Development and Planning Barstow College

CSI: Barstow Last year, we had some fun… Looking at creating a culture of inquiry… We used the metaphor of solving a crime… using direct and circumstantial evidence….

Outcomes from a Year Ago… Develop a sense of “inquiry” (that asking questions without immediately knowing the answers is good); Evaluate decisions based on the evidence (reliable and valid) not intuition; Recognize issues of equity and fairness in outcomes and decisions on your campus.

College StudentSupportsARCCInstruction Factors That Impact Student Success and Improvement in Basic Skills cccbsi.org

But we have to go deeper… You are faculty researchers now… Outcomes for Today Understand the levels of data/evidence and the conclusions that can be drawn and not drawn at each level; and Appreciate the movement from a macro (wide angle) look at hurdles to student learning and a micro (highly focused) look at learning.

Utilization Focus Evaluation, Michael Quinn Patton

Magnification and View of the Problem From the Surface… Macroscopic At 20 x At 40 x At 1000 x At >Millions x Hat tip to Janet Fulks

At 20 X Nuclei visible with dye Some organelles perceptible Cell walls noticeable

At 40 X Greater detail… Cell material takes shape Inner parts of Nuclei visible

At 1000 x Light as a method to view reaching its limits Cells may need to be in another medium for clarity Organelles clear

At >Millions X Electron Microscope Clarity, but field of scope has been narrowed DNA visible

Magnification and View of the Problem From the Surface… Macroscopic At 20 x At 40 x At 1000 x At >Millions x

Let’s take the Metaphor to our Students

At the Surface Issues of Equity and Opportunity Different Skill Sets Varied Educational Experiences

Let’s Look at a Situation at an Institution at 20x Magnification ARCC DATA

What Information Do you Need to Make Looking at This Level of Magnification Meaningful? Definitions of the ARCC Variables

Let’s Look at a Situation at an Institution at 20x Magnification ARCC DATA

What Conclusions Can You Make at this Level of Magnification? Which Conclusions are Eluding Us at this Level?

Let’s Look at a Situation at an Institution at 40x Magnification Look at Your Lab Manual for Clearer Image of the Slide and Much More Detailed Information…

What Conclusions Can You Make at this Level of Magnification? Which Conclusions are Eluding Us at this Level?

Let’s Look at a Situation at an Institution at 1000x Magnification Program Outcome Perform mathematical processes well enough to complete freshman college mathematics requirements. BSI Math Program Outcomes 2a. Seventy percent of the completers will score 75% or higher on a locally devised test of pre-college math competencies. 2b. Seventy percent of completers will score 75% or higher on each sub score area of the locally devised test. Means of Assessment & Criteria for Success 2a. Sixty-one percent of completers scored 75% or better. 2b. Linear equations- 68%; Inequalities- 74% Quadratic equations- 58%; Graphing- 62% Powers & roots- 86%; Proportions- 67% Results of Assessment Look at Your Lab Manual for Clearer Image of the Slide and Much More Detailed Information…

What Conclusions Can You Make at this Level of Magnification? Which Conclusions are Eluding Us at this Level?

Let’s Look at a Situation at an Institution at Millionsx Magnification Look at Your Lab Manual for Clearer Image of the Slide…

Magnification and View of the Problem From the Surface… Macroscopic At 20x At 40x At 1000x At >2000x Let’s Review!

Let’s Look at Inteventions We Know You Would Study the Algebra Problem Much More Deeply than What We Just Did, but to Help the Discussion Along… Suppose You Had 2 Interventions to Pick From to Remedy This Problem: 1) Tutorial/SI or 2) Establishing a Learning Community. Which Intervention Would you Pick and Why?

Now You Are Ready to Go Talk With Your Researcher Have Fun….