Get Ready to Play Publish or Perish! Please select a team. 1.Reeses 2.KitKat 3.Milky Way 4.Snickers 5. 3 Musketeers.

Slides:



Advertisements
Similar presentations
Chapter 7 Flashcards. overall plan that describes all of the elements of a research or evaluation study, and ideally the plan allows the researcher or.
Advertisements

Evaluation Procedures
Experimental and Quasi-Experimental Research
Increasing your confidence that you really found what you think you found. Reliability and Validity.
Reliability and Validity of Dependent Measures
Copyright © Allyn & Bacon (2007) Hypothesis Testing, Validity, and Threats to Validity Graziano and Raulin Research Methods: Chapter 8 This multimedia.
Defining Characteristics
Inadequate Designs and Design Criteria
Experimental Research Designs
HDFS 361—Research Methods Experimental and Quasi- Experimental Design.
Internal Threats to Validity
Chapter 9. Internal Validity Threats to Internal Validity Alternative explanations Alternative hypotheses The DV is NOT dependent upon the IV but instead.
Correlation AND EXPERIMENTAL DESIGN
Research Problems.
Who are the participants? Creating a Quality Sample 47:269: Research Methods I Dr. Leonard March 22, 2010.
MSc Applied Psychology PYM403 Research Methods Validity and Reliability in Research.
Lecture 10 Psyc 300A. Types of Experiments Between-Subjects (or Between- Participants) Design –Different subjects are assigned to each level of the IV.
Chapter 7 Conducting & Reading Research Baumgartner et al Chapter 8 Experimental Research.
Hypotheses & Research Design
Chapter 9 Experimental Research Gay, Mills, and Airasian
Experimental Research
McGraw-Hill © 2006 The McGraw-Hill Companies, Inc. All rights reserved. Experimental Research Chapter Thirteen.
Experimental Research
EVALUATING YOUR RESEARCH DESIGN EDRS 5305 EDUCATIONAL RESEARCH & STATISTICS.
Chapter 8 Experimental Research
Experimental Design The Gold Standard?.
McGraw-Hill/Irwin Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. Choosing a Research Design.
I want to test a wound treatment or educational program in my clinical setting with patient groups that are convenient or that already exist, How do I.
Group Discussion Explain the difference between assignment bias and selection bias. Which one is a threat to internal validity and which is a threat to.
Consumer Preference Test Level 1- “h” potato chip vs Level 2 - “g” potato chip 1. How would you rate chip “h” from 1 - 7? Don’t Delicious like.
ECON ECON Health Economic Policy Lab Kem P. Krueger, Pharm.D., Ph.D. Anne Alexander, M.S., Ph.D. University of Wyoming.
Research Strategies Chapter 6. Research steps Literature Review identify a new idea for research, form a hypothesis and a prediction, Methodology define.
Copyright ©2008 by Pearson Education, Inc. Pearson Prentice Hall Upper Saddle River, NJ Foundations of Nursing Research, 5e By Rose Marie Nieswiadomy.
Independent vs Dependent Variables PRESUMED CAUSE REFERRED TO AS INDEPENDENT VARIABLE (SMOKING). PRESUMED EFFECT IS DEPENDENT VARIABLE (LUNG CANCER). SEEK.
1 Experimental Research Cause + Effect Manipulation Control.
CDIS 5400 Dr Brenda Louw 2010 Validity Issues in Research Design.
Research methods and statistics.  Internal validity is concerned about the causal-effect relationship in a study ◦ Can observed changes be attributed.
Research in Communicative Disorders1 Research Design & Measurement Considerations (chap 3) Group Research Design Single Subject Design External Validity.
Introduction section of article
Experimental Research
Research Design ED 592A Fall Research Concepts 1. Quantitative vs. Qualitative & Mixed Methods 2. Sampling 3. Instrumentation 4. Validity and Reliability.
Reliability and Validity Threats to Internal Validity Da Lee Caryl, Fall 2006.
Experimental Research Methods in Language Learning Chapter 5 Validity in Experimental Research.
Ch 9 Internal and External Validity. Validity  The quality of the instruments used in the research study  Will the reader believe what they are readying.
Name: Michelle Wildman Instructor: Dr. Sharon O’Connor –Petruso Course: CBSE 7201 T Fall 2012/Spring2013.
1 Module 3 Designs. 2 Family Health Project: Exercise Review Discuss the Family Health Case and these questions. Consider how gender issues influence.
Experimental & Quasi-Experimental Designs Dr. Guerette.
Chapter 8 Experiments Topics Appropriate to Experiments The Classical Experiment Selecting Subjects Variations on Experimental Designs An Illustration.
 The basic components of experiments are: 1) taking action 2) observing the consequence of that action  Experimental model is most closely linked to.
Handbook for Health Care Research, Second Edition Chapter 7 © 2010 Jones and Bartlett Publishers, LLC CHAPTER 7 Designing the Experiment.
Journalism 614: Experimental Methods Experimental Research  Take some action and observe its effects –Extension of natural science to social science.
CHAPTER 8 EXPERIMENTS.
Chapter Nine Primary Data Collection: Experimentation and
CJ490: Research Methods in Criminal Justice UNIT #4 SEMINAR Professor Jeffrey Hauck.
Can you hear me now? Keeping threats to validity from muffling assessment messages Maureen Donohue-Smith, Ph.D., RN Elmira College.
Research designs Research designs Quantitative Research Designs.
Educational Research Experimental Research Chapter 9 (8 th Edition) Chapter 13 (7 th Edition) Gay and Airasian.
EXPERIMENTAL RESEARCH
Experiments Why would a double-blind experiment be used?
Hypothesis Testing, Validity, and Threats to Validity
Experiments: Part 3.
Experiments and Quasi-Experiments
Experiments and Quasi-Experiments
External Validity.
Experiments: Part 3.
Experiments: Part 3.
Chapter 18: Experimental and Quasi-Experimental Research
Experimental Research
Types of Designs: R: Random Assignment of subjects to groups
Reminder for next week CUELT Conference.
Presentation transcript:

Get Ready to Play Publish or Perish!

Please select a team. 1.Reeses 2.KitKat 3.Milky Way 4.Snickers 5. 3 Musketeers

Participant Scores

Team Scores

Publish or Perish! Defining Moments External Excellence $100 $200 $300 $400 $500 $500$500 Internally IdealValid SaladBe a Gremlin Team Scores IndividualIndividual Scores Fastest Responder

Defining Moments $100 The effects on scores due to differences in the conditions of testing. 1.Teacher effects 2.Testing effects 3.School effects 4. Instrumentation effects

Defining Moments $200 A characteristic of a distribution of scores in which many scores are near the minimum 1.Testing effects 2.Floor effect 3.Ceiling effects 4.Statistical regression

Defining Moments $ The loss of subjects over the course of a study, due to dropping out, absenteeism on the day of the test, and so on. 1.Maturation 2.History 3.Mortality 4.Regression

Defining Moments $ The condition that study findings are from a setting or population unlike the one to which a researcher wishes to generalize. 1.Artificiality 2.Nonrepresentativeness 3.Selection bias 4.External Validity

Defining Moments $ The tendency of observation or experimentation to change the phenomenon being studied. 1.Phenomenology 2.Reactivity 3.Maturation 4.Artificiality

Be A Gremlin $ A researcher is concerned that the results which he observes after an experiment might have occurred because of the composition of the group rather than from the experimental treatment, which is the most obvious threat to validity that has him concerned? 1.Selection 2.Pretesting 3.History 4.Maturation

Be A Gremlin $200 Mrs. Brown has administered a test to her students to find out how well they have mastered the basic skills they will need to study her math unit. She has discovered that they are weak in some areas, and therefore she decides to provide a remedial unit to bring them up to par. She provides her remedial unit and afterwards measures the students' performance again to see if they have improved. She finds a substantial degree of improvement and therefore she concludes that her remedial unit was effective. Which of the following appears to be a threat to the internal validity of her conclusion that the remedial unit was effective? 10 1.Pretesting 2.History 3.Maturation 4.Statistical regression

Be A Gremlin $300 Mrs. Smith finds that her first graders are having trouble with their basic arithmetic concepts. She therefore tries a new program and plans to evaluate them at the end of the year to see if they have made improvements. She will consider her program to be successful if the children have mastered a large number of skills at the end of the year which they had not mastered at the beginning of the year. Which of the following is the most obvious threat to Mrs. Smith's evaluation of this program? 10 1.Pretesting 2.Maturation 3.Statistical regression 4.Ceiling effect

Be A Gremlin $400 Mrs. Jones is a remedial reading specialist. She has given reading screening tests to all 60 first graders at Warren Harding Elementary School. She has identified the 10 weakest readers, and now she plans to provide them with her new program of Reading Skills Development. Nine months later, at the end of the school year, Mrs. Jones plans to evaluate her Reading Skills Development Program by retesting all 60 children and seeing if her 10 remedial children improve more than the other 50. Which of the following is most obviously a threat to the internal validity of Mrs. Jones attempt to evaluate her program? Maturation 2.Pretesting 3.Statistical regression 4.Experimental mortality

Be A Gremlin $500 Each year Mr. Brown provides a unit in his physical education class on "The Rules of International Athletic Competition." Since the present year will be an Olympics year, he decides to revise and upgrade this unit. He initiates his program to coincide with the start of the televised portions of the Winter Olympics. On the final exam, he asks his usual ten questions about International Athletic Competition. He finds that the students this year score substantially higher than the students the previous two years on the same questions. He concludes that his new program has been effective and resolves to continue it the next year. Which of the following is the most obvious threat to the internal validity of Mr. Brown's study? 10 1.Instrumentation 2.Maturation 3.History 4.Statistical regression

External Excellence $100 What effect occurs when an untreated control group is determined to beat the technique evaluated in the experimental group? 1.John Henry Effect 2.Hawthorne Effect 3.Hathaway Effect 4.Hank Williams Effect

External Excellence $200 A study that has internal validity and can be generalized is considered to have 10 1.The Hawthorne effect 2.External validity 3.Accountability 4. Large sampling

External Excellence $ A study done on history in a average high school would have less problems with _____________than one done in a magnet school for performing arts. 1.Nonrepresentativeness 2.Mortality 3.Reactivity 4.Maturation

External Excellence $400 In research in education, ____________is a problem because teachers may have a strong stake in one or another outcomes of a research project. 1.Artificiality 2. Nonrepresentativeness 3.Mortality 4.Reactivity

External Excellence $500 A study can be high in internal and external validity and still be wrong or useless. 1.True 2.False

Internally Ideal $100 Which of the following is the best description of internal validity? 1.It deals with the question of how consistently the test measures whatever it is that it claims to be measuring during an experiment. 2.It deals with the question of how worthwhile and how practical the results of an experiment are. 3.It deals with the question of whether the observed outcomes of an experiment are the result of the experiment itself rather than the result of some extraneous factor. 4.It deals with the question of whether the same results would occur if the experiment were replicated in a different setting

Internally Ideal $200 If a researcher is concerned that it might have been some extraneous event that occurred while the experiment was going on rather than the experimental treatment itself which caused an observed outcome, with which of the following threats to internal validity is he most obviously concerned? 1.Pretesting 2.Selection 3.Maturation 4.History

Internally Ideal $300 For a study to have internal validity, it must have external validity. 1.True 2.False

Internally Ideal $400 The use of control groups can help researchers eliminate threats to internal validity. 1.True 2.False

Internally Ideal $500 Whenever test scores are being compared they should be the same and given under the same conditions to avoid instrumentation effects. 1.True 2.False

Valid Salad $100 When the participants in group grow older, smart, taller, etc, problematic factors due to ___________________ can occur Mortality 2.Maturation 3.History 4.Adolescence

Valid Salad $200 Unmeasured nuisance variables that are not the subject of the study are called ______________ Mistakes 2.Nonsense variables 3.Extraneous factors

Valid Salad $300 Pretesting always helps internal validity 10 1.True 2.False

Valid Salad $400 The tendency of individuals with extremely high scores on one variable to have extremely high score on other similar variables or individuals with extremely low scores to have somewhat lower scores on related variables is know as statistical regression True. 2.False

Valid Salad $ When group differences are substantial, selection bias can never be ruled out as an alternative explanation for findings. 1.True 2.False

Congratulations! Your research has been accepted by an outstanding peer-reviewed journal! You are Published!

Fastest Responders (in seconds) 0Participant 1 0Participant 2 0Participant 3 0Participant 4 0Participant 5