2. Get Ready to Play Publish or Perish!

3. Please select a team. 1.Reeses 2.KitKat 3.Milky Way 4.Snickers 5. 3 Musketeers

4. Participant Scores

5. Team Scores

6. Publish or Perish! Defining Moments External Excellence $100 $200 $300 $400 $500 $500$500 Internally IdealValid SaladBe a Gremlin Team Scores IndividualIndividual Scores Fastest Responder

7. Defining Moments $100 The effects on scores due to differences in the conditions of testing. 1.Teacher effects 2.Testing effects 3.School effects 4. Instrumentation effects

8. Defining Moments $200 A characteristic of a distribution of scores in which many scores are near the minimum 1.Testing effects 2.Floor effect 3.Ceiling effects 4.Statistical regression 10 123456789 11121314151617181920 2122232425

9. Defining Moments $300 10 The loss of subjects over the course of a study, due to dropping out, absenteeism on the day of the test, and so on. 1.Maturation 2.History 3.Mortality 4.Regression 1234567891011121314151617181920 2122232425

10. Defining Moments $400 10 The condition that study findings are from a setting or population unlike the one to which a researcher wishes to generalize. 1.Artificiality 2.Nonrepresentativeness 3.Selection bias 4.External Validity 1234567891011121314151617181920 2122232425

11. Defining Moments $500 10 The tendency of observation or experimentation to change the phenomenon being studied. 1.Phenomenology 2.Reactivity 3.Maturation 4.Artificiality 1234567891011121314151617181920 2122232425

12. Be A Gremlin $100 10 A researcher is concerned that the results which he observes after an experiment might have occurred because of the composition of the group rather than from the experimental treatment, which is the most obvious threat to validity that has him concerned? 1.Selection 2.Pretesting 3.History 4.Maturation 1234567891011121314151617181920 2122232425

13. Be A Gremlin $200 Mrs. Brown has administered a test to her students to find out how well they have mastered the basic skills they will need to study her math unit. She has discovered that they are weak in some areas, and therefore she decides to provide a remedial unit to bring them up to par. She provides her remedial unit and afterwards measures the students' performance again to see if they have improved. She finds a substantial degree of improvement and therefore she concludes that her remedial unit was effective. Which of the following appears to be a threat to the internal validity of her conclusion that the remedial unit was effective? 10 1.Pretesting 2.History 3.Maturation 4.Statistical regression 1234567891011121314151617181920 2122232425

14. Be A Gremlin $300 Mrs. Smith finds that her first graders are having trouble with their basic arithmetic concepts. She therefore tries a new program and plans to evaluate them at the end of the year to see if they have made improvements. She will consider her program to be successful if the children have mastered a large number of skills at the end of the year which they had not mastered at the beginning of the year. Which of the following is the most obvious threat to Mrs. Smith's evaluation of this program? 10 1.Pretesting 2.Maturation 3.Statistical regression 4.Ceiling effect 1234567891011121314151617181920 2122232425

15. Be A Gremlin $400 Mrs. Jones is a remedial reading specialist. She has given reading screening tests to all 60 first graders at Warren Harding Elementary School. She has identified the 10 weakest readers, and now she plans to provide them with her new program of Reading Skills Development. Nine months later, at the end of the school year, Mrs. Jones plans to evaluate her Reading Skills Development Program by retesting all 60 children and seeing if her 10 remedial children improve more than the other 50. Which of the following is most obviously a threat to the internal validity of Mrs. Jones attempt to evaluate her program? 10. 1.Maturation 2.Pretesting 3.Statistical regression 4.Experimental mortality 1234567891011121314151617181920 2122232425

16. Be A Gremlin $500 Each year Mr. Brown provides a unit in his physical education class on "The Rules of International Athletic Competition." Since the present year will be an Olympics year, he decides to revise and upgrade this unit. He initiates his program to coincide with the start of the televised portions of the Winter Olympics. On the final exam, he asks his usual ten questions about International Athletic Competition. He finds that the students this year score substantially higher than the students the previous two years on the same questions. He concludes that his new program has been effective and resolves to continue it the next year. Which of the following is the most obvious threat to the internal validity of Mr. Brown's study? 10 1.Instrumentation 2.Maturation 3.History 4.Statistical regression 1234567891011121314151617181920 2122232425

17. External Excellence $100 What effect occurs when an untreated control group is determined to beat the technique evaluated in the experimental group? 1.John Henry Effect 2.Hawthorne Effect 3.Hathaway Effect 4.Hank Williams Effect 1234567891011121314151617181920 2122232425 10

18. External Excellence $200 A study that has internal validity and can be generalized is considered to have 10 1.The Hawthorne effect 2.External validity 3.Accountability 4. Large sampling 1234567891011121314151617181920 2122232425

19. External Excellence $300 10 A study done on history in a average high school would have less problems with _____________than one done in a magnet school for performing arts. 1.Nonrepresentativeness 2.Mortality 3.Reactivity 4.Maturation 1234567891011121314151617181920 2122232425

20. External Excellence $400 In research in education, ____________is a problem because teachers may have a strong stake in one or another outcomes of a research project. 1.Artificiality 2. Nonrepresentativeness 3.Mortality 4.Reactivity

21. External Excellence $500 A study can be high in internal and external validity and still be wrong or useless. 1.True 2.False

22. Internally Ideal $100 Which of the following is the best description of internal validity? 1.It deals with the question of how consistently the test measures whatever it is that it claims to be measuring during an experiment. 2.It deals with the question of how worthwhile and how practical the results of an experiment are. 3.It deals with the question of whether the observed outcomes of an experiment are the result of the experiment itself rather than the result of some extraneous factor. 4.It deals with the question of whether the same results would occur if the experiment were replicated in a different setting. 10 123456789 11121314151617181920 2122232425

23. Internally Ideal $200 If a researcher is concerned that it might have been some extraneous event that occurred while the experiment was going on rather than the experimental treatment itself which caused an observed outcome, with which of the following threats to internal validity is he most obviously concerned? 1.Pretesting 2.Selection 3.Maturation 4.History 10 123456789 11121314151617181920 2122232425

24. Internally Ideal $300 For a study to have internal validity, it must have external validity. 1.True 2.False 1234567891011121314151617181920 2122232425

25. Internally Ideal $400 The use of control groups can help researchers eliminate threats to internal validity. 1.True 2.False 1234567891011121314151617181920 2122232425

26. Internally Ideal $500 Whenever test scores are being compared they should be the same and given under the same conditions to avoid instrumentation effects. 1.True 2.False 1234567891011121314151617181920 2122232425

27. Valid Salad $100 When the participants in group grow older, smart, taller, etc, problematic factors due to ___________________ can occur. 10 1.Mortality 2.Maturation 3.History 4.Adolescence 1234567891011121314151617181920 2122232425

28. Valid Salad $200 Unmeasured nuisance variables that are not the subject of the study are called ______________. 10 1.Mistakes 2.Nonsense variables 3.Extraneous factors 1234567891011121314151617181920 2122232425

29. Valid Salad $300 Pretesting always helps internal validity 10 1.True 2.False 1234567891011121314151617181920 2122232425

30. Valid Salad $400 The tendency of individuals with extremely high scores on one variable to have extremely high score on other similar variables or individuals with extremely low scores to have somewhat lower scores on related variables is know as statistical regression. 10 1.True. 2.False 1234567891011121314151617181920 2122232425

31. Valid Salad $500 10 When group differences are substantial, selection bias can never be ruled out as an alternative explanation for findings. 1.True 2.False 1234567891011121314151617181920 2122232425

32. Congratulations! Your research has been accepted by an outstanding peer-reviewed journal! You are Published!

33. Fastest Responders (in seconds) 0Participant 1 0Participant 2 0Participant 3 0Participant 4 0Participant 5