Cooperative Learning Statistical Significance and Effect Size By: Jake Eichten and Shorena Dolaberidze.

Slides:



Advertisements
Similar presentations
Analyzing Student Work
Advertisements

Statistical Issues in Research Planning and Evaluation
1-Teacher competence does affect student learning. Outsiders can bring fresh ideas and enthusiasm to tired systems. And principals do have a role in reform.
D.A Public School (O & A Levels)
Drawing Samples in “Observational Studies” Sample vs. the Population How to Draw a Random Sample What Determines the “Margin of Error” of a Poll?
By: Shorena Dolaberidze and Gulshan Huseynli DROPOUT PROBLEM AT TECHNICAL LYCEUM.
Chapter 28 Design of Experiments (DOE). Objectives Define basic design of experiments (DOE) terminology. Apply DOE principles. Plan, organize, and evaluate.
Understanding Research Results. Effect Size Effect Size – strength of relationship & magnitude of effect Effect size r = √ (t2/(t2+df))
Overview of Cognitively Guided Instruction Research.
UNDERSTANDING RESEARCH RESULTS: STATISTICAL INFERENCE © 2012 The McGraw-Hill Companies, Inc.
Today Concepts underlying inferential statistics
What does the Research Say About... POP QUIZ!!!. The Rules You will be asked to put different educational practices in order from most effective to least.
Chapter 9 Experimental Research Gay, Mills, and Airasian
Chapter 2 – Experimental Design and Data Collection Math 22 Introductory Statistics.
Chapter 2 Research Methods. The Scientific Approach: A Search for Laws Empiricism: testing hypothesis Basic assumption: events are governed by some lawful.
Inferential Statistics
Understanding the Two-Way Analysis of Variance
Chapter 12 Inferential Statistics Gay, Mills, and Airasian
2012 The Use of Math Sprint in a Tutorial Program for Seventh Grade Students to Improve End of Grade Test Scores.
Chapter 2: The Research Enterprise in Psychology
DISTRICT IMPROVEMENT PLAN Student Achievement Annual Progress Report Lakewood School District # 306.
Aim: What types of data and studies exist?
Chapter 2: The Research Enterprise in Psychology
Chapter 2 Research Methods. The Scientific Approach: A Search for Laws Empiricism: testing hypothesis Basic assumption: events are governed by some lawful.
UNIT PLAN PROBABILITY AND STATISTICS FOR 9 th AND 10 th GRADE By EVANS ASUBONTENG.
© 2009 Pearson Education, Inc. All rights reserved Essentials of Educational Psychology, Second Edition Jeanne Ellis Ormrod CHAPTER ONE Introduction to.
Chapter 2 The Research Enterprise in Psychology. n Basic assumption: events are governed by some lawful order  Goals: Measurement and description Understanding.
Chapter 1: Introduction to Statistics
The Pershing/Rice University Math Partnership: PUMPing Up Math Achievement Caren Grant Pershing MS, Houston ISD
Chapter 24 Comparing Means.
Welcome to Common Core High School Mathematics Leadership
Chapter 1: The Research Enterprise in Psychology.
The Research Enterprise in Psychology. The Scientific Method: Terminology Operational definitions are used to clarify precisely what is meant by each.
Measures of Variability Variability: describes the spread or dispersion of scores for a set of data.
Review for Unit One Test AP Psychology. 1. A teacher wants to determine the role of teaching style on quiz scores. To do this, she divides a class into.
Research & Statistics Looking for Conclusions. Statistics Mathematics is used to organize, summarize, and interpret mathematical data 2 types of statistics.
Chapter 2 The Research Enterprise in Psychology. Table of Contents The Scientific Approach: A Search for Laws Basic assumption: events are governed by.
THE RELATIONSHIP BETWEEN PRE-SERVICE TEACHERS’ PERCEPTIONS TOWARD ACTIVE LEARNING IN STATISTIC 2 COURSE AND THEIR ACADEMIC ACHIEVEMENT Vanny Septia Efendi.
Copyright © 2009 Pearson Education, Inc LEARNING GOAL Interpret and carry out hypothesis tests for independence of variables with data organized.
Research Questions & Research Hypotheses Nearly all research proposal-regardless of the research methodology employed in the study- include at least one.
Using Common Core State Standards of Seventh Grade Mathematics in the Application of NXT LEGO® Robotics for CReSIS Middle School Students.
Educational Research Chapter 13 Inferential Statistics Gay, Mills, and Airasian 10 th Edition.
Making sense of data We got to deal with some Math here folks.
Chapter 10 Experimental Research Gay, Mills, and Airasian 10th Edition
Research Design ED 592A Fall Research Concepts 1. Quantitative vs. Qualitative & Mixed Methods 2. Sampling 3. Instrumentation 4. Validity and Reliability.
Three Broad Purposes of Quantitative Research 1. Description 2. Theory Testing 3. Theory Generation.
2 Kinds of Statistics: 1.Descriptive: listing and summarizing data in a practical and efficient way 2.Inferential: methods used to determine whether data.
Chapter 2 The Research Enterprise in Psychology. Table of Contents The Scientific Approach: A Search for Laws Basic assumption: events are governed by.
Exercises. Exercise 1. A researcher uses his morning and afternoon history classes to test a new instructional strategy. In the morning class the students.
Chapter 7: Hypothesis Testing. Learning Objectives Describe the process of hypothesis testing Correctly state hypotheses Distinguish between one-tailed.
STAT MINI- PROJECT NKU Executive Doctoral Co-hort August, 2012 Dot Perkins.
Definition Slides Unit 2: Scientific Research Methods.
Definition Slides Unit 1.2 Research Methods Terms.
Copyright © 2009 Pearson Education, Inc LEARNING GOAL Interpret and carry out hypothesis tests for independence of variables with data organized.
Collecting Samples Chapter 2.3 – In Search of Good Data Mathematics of Data Management (Nelson) MDM 4U.
What does the Research Say About . . .
Chapter 2 Research Methods.
Experimental Research
Statistical Analysis: Chi Square
Statistics Use of mathematics to ORGANIZE, SUMMARIZE and INTERPRET numerical data. Needed to help psychologists draw conclusions.
Experiments, Simulations Confidence Intervals
What does the Research Say About . . .
Generating and Testing Hypotheses
Group Comparisons What is the probability that group mean differences occurred by chance? With Excel (or any statistics program) we computed p values to.
Module 8 Statistical Reasoning in Everyday Life
Comparing Populations
Research Strategies: How Psychologists Ask and Answer Questions
THE RELATIONSHIP BETWEEN PRE-SERVICE TEACHERS’ PERCEPTIONS TOWARD ACTIVE LEARNING IN STATISTIC 2 COURSE AND THEIR ACADEMIC ACHIEVEMENT Vanny Septia Efendi.
Thinking critically with psychological science
Research Questions & Research Hypotheses
Presentation transcript:

Cooperative Learning Statistical Significance and Effect Size By: Jake Eichten and Shorena Dolaberidze

This Chapter Examines: The problem of declining math achievement scores in an elementary school where Beth Miller is a first year principal The problem of declining math achievement scores in an elementary school where Beth Miller is a first year principal The effectiveness of cooperative learning strategies in mathematics The effectiveness of cooperative learning strategies in mathematics

This chapter is not meant to make you an expert in cooperative learning, but rather observe principal Beth Miller as she undertakes an examination of the problem and develops good questions to facilitate a review which will help her seek out possible solutions. This chapter is not meant to make you an expert in cooperative learning, but rather observe principal Beth Miller as she undertakes an examination of the problem and develops good questions to facilitate a review which will help her seek out possible solutions. This chapter also demonstrates the importance of statistical significance and effect size when using research as a tool for making important decisions. This chapter also demonstrates the importance of statistical significance and effect size when using research as a tool for making important decisions.

Who, Where, What, and Why? Beth Miller-First year principal at Pleasant Valley Elementary School Beth Miller-First year principal at Pleasant Valley Elementary School She and staff recognized math deficiencies in grades 3-5 She and staff recognized math deficiencies in grades 3-5 Staff members suggested cooperative learning as a possible solution Staff members suggested cooperative learning as a possible solution Miller put together a research team to develop a plan of action Miller put together a research team to develop a plan of action

Two Questions to Guide the Teams Action 1) What kind of cooperative learning strategies are available? 1) What kind of cooperative learning strategies are available? 2) What cooperative learning strategies have been found to enhance achievement in mathematics generally and in problem solving skills specifically with 4th and 5th grade students with widely varying levels of ability? 2) What cooperative learning strategies have been found to enhance achievement in mathematics generally and in problem solving skills specifically with 4th and 5th grade students with widely varying levels of ability?

Action for Question 1 The group researched cooperative learning methods that are specifically appropriate for mathematics instruction. They discovered 6 different strategies that were possibilities. The group researched cooperative learning methods that are specifically appropriate for mathematics instruction. They discovered 6 different strategies that were possibilities.

Action for Question 2 The team researched 4 studies of cooperative learning techniques that met the following criteria: The team researched 4 studies of cooperative learning techniques that met the following criteria: -Focus on mathematics education -Sample included elementary or middle school children -Experimental and control conditions imposed on the subjects

The 4 Studies The four studies that were chosen for review met the previously mentioned criteria and were all found to be statistically significant and had an acceptable effect size. The four studies that were chosen for review met the previously mentioned criteria and were all found to be statistically significant and had an acceptable effect size.

Statistical Significance Statistical significance shows the strength of the relationship between 2 variables Statistical significance shows the strength of the relationship between 2 variables Statistical significance gives the researchers confidence that the difference between 2 variables didn’t occur simply because of chance Statistical significance gives the researchers confidence that the difference between 2 variables didn’t occur simply because of chance

Statistical Significance Statistical significance is represented as a p value (p=probability) Statistical significance is represented as a p value (p=probability) -An example would be: p <.05, meaning that the probability of an event occurring by chance is less that 5% -The statistical significance of a coin flip would be represented as p =.5, meaning that 50% of the time the result could be due to chance

Statistical Significance Example A computer interactive reading program was compared with a traditional reading program using 50 5th graders who were randomly assigned to treatment and control groups A computer interactive reading program was compared with a traditional reading program using 50 5th graders who were randomly assigned to treatment and control groups The researchers reported a difference of 4 points on a reading achievement test in favor of the computer interactive program. The researchers reported a difference of 4 points on a reading achievement test in favor of the computer interactive program.

Example Continued How do we know that if we do this study again, the results won’t favor the traditional reading group? How do we know that if we do this study again, the results won’t favor the traditional reading group? Statisticians developed techniques to test for the possibility that a difference in observed scores might have been due to chance Statisticians developed techniques to test for the possibility that a difference in observed scores might have been due to chance

Example Continued The researchers found that the statistical significance in this example would be The researchers found that the statistical significance in this example would be p <.01, meaning the results occurring by chance are less than 1%.

Why is Statistical Significance Important? When a statistic is significant, it simply means that the statistic is reliable. When a statistic is significant, it simply means that the statistic is reliable. When using research to assist in making important educational decisions, it is important that the data used is reliable. When using research to assist in making important educational decisions, it is important that the data used is reliable.

Effect Size Effect size is important for answering the question “How much of a difference did it make?” (Cooperative learning strategies) Effect size is important for answering the question “How much of a difference did it make?” (Cooperative learning strategies) Effect size allows us to compare the magnitude of experimental treatments from one experiment to another Effect size allows us to compare the magnitude of experimental treatments from one experiment to another Effect size is calculated by the mean difference between the treatment and control groups and dividing it by the average standard deviation of the two groups (ES=M1-M2/Av.SD) Effect size is calculated by the mean difference between the treatment and control groups and dividing it by the average standard deviation of the two groups (ES=M1-M2/Av.SD)

Effect Size Example Consider a math study with a treatment group mean score of 10 and a control group mean score of 5, and the average standard deviation of the two groups is 10 Consider a math study with a treatment group mean score of 10 and a control group mean score of 5, and the average standard deviation of the two groups is 10 ES=M1(10)-M2(5)/Av.SD(10) ES=M1(10)-M2(5)/Av.SD(10) -The effect size would be.5 The treatment group averaged 1/2 of a SD higher than the control group The treatment group averaged 1/2 of a SD higher than the control group

Example Continued Consider another math study that used a different measure of math achievement with the mean difference being 10 and the average standard deviation being 50 Consider another math study that used a different measure of math achievement with the mean difference being 10 and the average standard deviation being 50 The effect size would be.2 The effect size would be.2 The effect sizes would be a common denominator of the two, which will allow for a comparison between the two studies The effect sizes would be a common denominator of the two, which will allow for a comparison between the two studies Study 1’s ES (.5) would indicate that the treatment effect was was greater than than that of study 2’s (.2) Study 1’s ES (.5) would indicate that the treatment effect was was greater than than that of study 2’s (.2)

Desired Effect Size

Why is Effect Size Important? It answers the question “How much of a difference did the treatment make?” It answers the question “How much of a difference did the treatment make?” When researching materials to assist is making important educational decisions, it is important to understand how well a treatment worked before deciding to implement it into your own setting. When researching materials to assist is making important educational decisions, it is important to understand how well a treatment worked before deciding to implement it into your own setting.

Chapter Conclusions As a result of the research Miller and her team conducted, they found: As a result of the research Miller and her team conducted, they found: Two types of cooperative learning that were proven successful for teaching math computation and math problem solving Two types of cooperative learning that were proven successful for teaching math computation and math problem solving Developed an action memo, which they shared with the full staff explaining their findings and their next steps. Developed an action memo, which they shared with the full staff explaining their findings and their next steps.

References Haller, E. J., & Kleine, P. F. (2001). Using educational research: A school educational research: A school Administrator's guide (1st ed.). New York, Administrator's guide (1st ed.). New York, NY: Addison Wesley Longman, Inc. NY: Addison Wesley Longman, Inc.