1. What qualifies as evidence of student learning?
Day 2 Discussion

2. Education Research is a Rigorous Scientific Undertaking

3. Defining a few terms (adapted from J. Sexton)
Research: empirical endeavor to add to body of knowledge by collecting and analyzing data according to a set of principles accepted by the community of researchers
Assessment: Gathering evidence of student knowledge and understanding
Evaluation: Evaluating effectiveness of a program, project, etc. in meeting goals
Theory: Body of knowledge that explains empirical phenomena, generally less formalized and rigorously developed than natural sciences. Includes philosophical perspectives.
Intervention or Treatment: Independent variable given to or presented to participants

4. Definitions (continued)
Independent Variable - active: Variable manipulated by researcher and “given to participant. Often a treatment or intervention.
Independent Variable - attribute: Variable that can’t be manipulated by a researcher or given to a participant. (e.g. gender, ethnicity, age)
Dependent Variable: Variable that is expected to change as a result of intervention, but not directly manipulatable by researcher.

5. Quantitative vs. Qualitative vs. Mixed Methods
There is a place for qualitative and quantitative data in social science research. In general:
Qualitative Methods are good for investigating how or what questions, for deep understanding, or for detailed views
Quantitative Methods are good for why questions, hypothesis testing, group comparisons, causality, and generalizability; but often require large samples
Mixed Methods often use one type of data to guide collection of other types of data.
Have examples for this -TE

6. So What Constitutes Good Design for Educational Research?
Let’s take an example research idea, and see if we can’t brainstorm some elements of a research question and a design for answering it:
I just got a new portable radiosonde system, and I want to show that using it in class will improve student learning. How do I do that?
What would I expect to change as a result? (could be quantitative or qualitative)
How do I measure them?
How do I control for other other factors?