Diane Ebert-May Department of Plant Biology Michigan State University Pathways to Scientific Teaching

The trouble with our times is that the future is not what it used to be. -Paul Valery, The Art of Poetry

Engage

Question 1 Active learning strategies engage students in the process of science. Please respond on a scale of 1-5: 1=strongly agree; 2=agree; 3=neutral; 4= disagree; 5=strongly disagree

Question 2 Students learn science best by “doing” science. Please respond on a scale of 1-5: 1=strongly agree; 2=agree; 3=neutral; 4= disagree; 5=strongly disagree

Question 3 How important is it to use multiple kinds of assessments to determine student learning? Please respond on a scale of in increments of 10:

Question 4 The proportion of assessments I use in my course that demonstrate students’ critical thinking abilities is.... Please respond on a scale of (%) in increments of 10:

Question 5 In my department, excellence in teaching is rewarded at a level comparable to excellence in research. Please respond on a scale of 1-5: 1=strongly agree; 2=agree; 3=neutral; 4= disagree; 5=strongly disagree

Question 1 Active learning strategies engage students in the process of science. Please respond on a scale of 1-5: 1=strongly agree; 2=agree; 3=neutral; 4= disagree; 5=strongly disagree

Question 2 Students learn science best by “doing” science. Please respond on a scale of 1-5: 1=strongly agree; 2=agree; 3=neutral; 4= disagree; 5=strongly disagree

Large Class Meeting

Question 3 How important is it to use multiple kinds of assessments to determine student learning? Please respond on a scale of in increments of 10:

Question 4 The proportion of assessments I use in my course that demonstrate students’ critical thinking abilities is.... Please respond on a scale of (%) in increments of 10:

Connections Organization Visual Reasoning Models

Question 5 In my department, excellence in teaching is rewarded at a level comparable to excellence in research. Please respond on a scale of 1-5: 1=strongly agree; 2=agree; 3=neutral; 4= disagree; 5=strongly disagree

Articles derived from journal papers

Explore

How People Learn Bransford et al 1999, 2004

Explore...more

What’s up with Termites? 1. On a sheet of paper, draw two circles near each other on the center of the page. 2. Release termites onto paper. 3. Keep creatures safe. I shall collect them in their original habitat. 4. What do you observe about termite behavior? 5. Develop a question your group could explore if you had more time. (15 minutes - select a timekeeper)

1. Develop one possible objective for this ‘inquiry’. Team Written response. Reporter - Recorder - Timekeeper - (10 minutes) Checker - 2. Develop an assessment appropriate for the objective.

Learning objectives Once you have a learning objective(s)…. assign a Bloom-level to each. Statement that indicates level of expectation of performance.

What level of learning do we ask of our students? Bloom (1956) Cognitive Domain of Educational Objectives 6 categories - Knowledge Comprehension Application Analysis Synthesis Evaluation

Department of Plant Biology Course Level Mean Bloom Level

Department of Plant Biology % Total Qs Course Level *N items Bloom Level

What is going on? Teaching without Learning! Brainstorm: Diagnose situation - the learning challenge Where is the missing link?..misconception?

In your groups: What do you want your students to be able to DO? Design learning objectives that address the photosynthesis learning challenges. Get to know your students and their prior knowledge. May use pretest or diagnostic (clicker) question

At the end of this unit, students should be able to…. Criteria #1: Generate a statement of measurable performance.

Learning objectives Once you have a set of learning goals…. assign a Bloom-level to each goal. Criteria #2: Statement that indicates level of expectation of performance

What is assessment? Data collection with the purpose of answering questions about… students’ understanding students’ attitudes students’ skills instructional design and implementation curricular reform (at multiple grainsizes)

Why do assessment? 1. Improve student learning and development. 2. Provide students and faculty substantive feedback about student understanding. 3. Challenge to use disciplinary research strategies to assess learning.

Multiple Choice … … Concept Maps … … Essay … … Interview high Ease of Assessment low low Potential for Assessment of Learning high Theoretical Framework Ausubel 1968; meaningful learning Novak 1998; visual representations King and Kitchner 1994; reflective judgment National Research Council 1999; theoretical frameworks for assessment Assessment Gradient

Identify desired goals/objectives Determine acceptable evidence Design learning experiences and instruction Wiggins and McTighe 1998 Backwards Design

Objective (outcome) Students will demonstrate understanding of evolution by natural selection.

Changes in a population occur through a gradual change in individual members of a population. New traits in species are developed in response to need. All members of a population are genetically equivalent, variation and fitness are not considered. Traits acquired during an individual’s lifetime will be inherited by offspring. Alternative Conceptions: Natural Selection

Pre-test: Explain the changes that occurred in the tree and animal. Use your current understanding of evolution by natural selection.

How do we develop rubrics? Describe the goal/objective for the activity, problem, task... Select the assessment tasks aligned with goals Develop performance standards Differentiate levels of responses based on clearly described criteria Rate (assign value) the categories

Scoring Rubric for Quizzes and Homework

Advantages of Scoring Rubrics Improve the reliability of scoring written assignments and oral presentations Convey goals and performance expectations of students in an unambiguous way Convey “grading standards” or “point values” and relate them to performance goals Engage students in critical evaluation of their own performance Save time but spend it well

Limitations of Scoring Rubrics Problem of criteria Problem of practice and regular use Scoring Rubric website Sample Rubrics for Environmental Science

Explain

Students will demonstrate understanding of evolution by natural selection. Objective (outcome)

Changes in a population occur through a gradual change in individual members of a population. New traits in species are developed in response to need. All members of a population are genetically equivalent, variation and fitness are not considered. Traits acquired during an individual’s lifetime will be inherited by offspring. Alternative Conceptions: Natural Selection

Instructional Design Enable students to gain meaningful understanding of evolution and natural selection through active learning.

multiple choice extended response concept maps other models How do we classify students responses for comprehension and critical thinking?

Pre-test: extended response. Explain the changes that occurred in the tree and animal. Use your current understanding of evolution by natural selection. Hauser F AAAS

Rubric: Code Responses MisconceptionsCorrect P = Change in the individualChange in the population C = Need to Change/ Must Change/ Choice Change due to genes V = All members of a population are equally fit Individuals within a population have varying fitness levels G = Traits acquired during a lifetime are passed on Genetic traits help the individual to survive and reproduce I = Incorrect C =Correct P = Partially correct P __ C __ V __ G__ ND = No data

Identify patterns of critical thinking among students... Connect each of the categories in the rubric with student understanding. Explore research questions about why students do not understand particular concepts. Next steps for analysis

Design classroom research Faculty research goal: Use both observational and empirical approaches to answer a question about student learning. Student goals: Use effective and repeatable processes to address ill-structured problems. Demonstrate critical thinking.

Systematic observation Design an ill-structured problem. Students use guiding questions in groups. Instructor uses systematic observations to identify elements of the problem that are difficult for students.

Comparison Studies What is the effectiveness of guiding questions on problem-solving approaches to address ill- structured problems?

Guiding questions 1. What things do you know or think you know about this problem? 2. What thinks do you not know? 3. What things are not known in the scientific community studying similar problems? 4. What things can you find out, given review papers, primary scientific literature, and data?

Study designs Challenge: determining the internal and external validity of the study design. Multiple-group comparison Multiple sections one semester Single course - multiple years Intervention: iii. Homework with guiding questions iv. Homework without guiding questions Split-group comparison

Pretest In-class active learning Concept MapMultiple Reps Pretest In-class active learning Concept MapMultiple Reps Concept 1 Day 1 Concept 2 Day 2 Essay and MC Assessment (midterm and final exams) Class of 120 students randomly assigned to 2 treatment groups (n=60) Students alternate between multiple representations (MRs) and concept maps

How would you alter this design for your course? Objective: assess students’ higher-level thinking. What is the question? How would you change the problem? Would students do the problem in class, homework, lab, discussion section? Schemes to evaluate work. Classroom research design.

How many of you are familiar with concept maps? How many of you used concept maps for teaching tools and/or assessment tools? If a concept mapping tool was easily accessible on the web, would that influence your decision to use them? Questions

Fold Paper in Half On top half, draw a bicycle On bottom half, describe the bicycle in a paragraph

cycle Text What is the power of visual models?

Concepts are... Prototypical Knowledge-based Lexical

Hierarchy has Structure has Concept Maps Visual Diagrams Or Models are represent Knowledge or Understanding Concepts display connected with Linking Words Used for AssessmentOrganization Reflection & Learning promotes Context is constructed with New Information Prior Knowledge

Robo Grader in Action

Student’s Concept Map

1. Select a concept that is critical for your students to understand. 2. Identify 4 or 5 subconcepts that are important to understanding that concept e.g., DNA - Gene- Chromosome - Enzyme For a course you teach Arrange them by rank order - top most general, bottom most specific 4. Add linking lines to make connections between two concepts 5. Add linking words that describe the relationship between two concepts

Evolution and Natural Selection How does active learning affect students’ understanding of evolution and natural selection over time?

Changes in a population occur through a gradual change in individual members of a population. New traits in species are developed in response to need. All members of a population are genetically equivalent, variation and fitness are not considered. Traits acquired during an individual’s lifetime will be inherited by offspring. Alternative Conceptions: Natural Selection

Objective (outcome) Students will demonstrate understanding of evolution by natural selection.

(AAAS 1999) Pre-test: Essay Explain the changes that occurred in the tree and animal. Use your current understanding of evolution by natural selection.

Modified problem: populations of trees and animals

In guppy populations, what are the primary changes that occur gradually over time? a. The traits of each individual guppy within a population gradually change. b. The proportions of guppies having different traits within a population change. c. Successful behaviors learned by certain guppies are passed on to offspring. d. Mutations occur to meet the needs of the guppies as the environment changes. CINS Multiple Choice

Day 13 in class: Pretest: CINS multiple choice and dino essay Artificial selection in dogs Groups discuss and record: Why are dogs only one species? Groups discuss and record: Breed a larger dog. Assign concept map 4 - homework Active Learning

Individual Assignment Make a new concept map demonstrating your understanding of natural selection using the following concepts. genetic variation evolution species population natural selection artificial selection selective agent Concept Map 4

Day 14 in class Artificial selection in plants Group discuss and record: What traits were selected and why? Clicker Q: Plant fitness Natural selection Clicker Q: Selection on beak size Group discuss and record: What traits were naturally selected in Hawaiian finches? Minute paper: Natural and artificial selection Assign homework: Guppy sexual selection Active Learning

Day 15 In class: groups Determine fitness of wild tobacco Sexual selection review guppy homework Assign homework: concept map 5 Active Learning

2nd midterm exam CINS multiple choice on natural selection Final exam CINS multiple choice on natural selection Dinosaur post test Assessments

Homework: Guppy Sexual Selection

Team at MSU Rett Weber - Plant Biology (postdoctoral researcher) Deb Linton - Plant Biology (postdoctoral researcher) Duncan Sibley - Geology Doug Luckie - Physiology Scott Harrison - Microbiology (graduate student) Tammy Long - Plant Biology Heejun Lim - Chemistry Education Rob Pennock - Philosophy Charles Ofria - Engineering Rich Lenski - Microbiolgy Janet Batzli - Plant Biology [U of Wisconsin]

“...we note that successful people are the ones who take advantage of those around them to ulimately benefit students.” Ebert-May D, Weber R, Hodder J, Batzli J (2006) Finally...

Jigsaw New groups: 5 groups of 4 Count off -- 1, 2, 3, 4, 5 All 1s work on same paper....2s, 3s, 4s, 5s Return to ‘home’ groups and share what you found in each of the papers. Report out

Paper Assignments Group 1: Climate change.... Group 2: Novel asssessments... Group 3: Practicing scientific inquiry... Group 4: Unleashing problem solvers... Group 5: Active homework...

In your groups: Read the paper, discuss, record What are the student learning goals? 2. What is the Bloom-level of each goal? 3. Do the assessments align with the goals? 4. What are the active learning strategies?