Effect of Paper Color on Students’ Physics Exam Performances David R. Schmidt, Todd G. Ruskell, and Patrick B. Kohl Objectives Examine the manifestation.

Slides:



Advertisements
Similar presentations
1 Analyzing and Synthesizing Findings Prof. Dr. Khalid Mahmood Department of Library & Information Science University of the Punjab.
Advertisements

Auditing Subject Knowledge in Initial Teacher Training using Online Methods.
PD Plan Agenda August 26, 2008 PBTE Indicators Track
DATA TRACKING AND EVALUATION 1. Goal of the STEP program: To increase the number of STEM graduates within the five-year period of the grant. You have.
In Today’s Society Education = Testing Scores = Accountability Obviously, Students are held accountable, But also!  Teachers  School districts  States.
Evaluating two feedback mechanisms for MCQ exams David Hope, Kyle Gibson & Helen Cameron August 2013.
Introduction Relative weights can be estimated by fitting a linear model using responses from individual trials: where g is the linking function. Relative.
“Highly Annoyed: One mark multiple meanings” Eveline Maris Leiden University The Netherlands.
Developing a Statistics Teaching and Beliefs Survey Jiyoon Park Audbjorg Bjornsdottir Department of Educational Psychology The National Statistics Teaching.
Abstract Existing Survey Instrument Items Graphs Jasmine Olson  Dr. Bingen Mathematics  University of Wisconsin-Eau Claire  The purpose of this study.
Effects of sex and gender role identification on male face evaluation Kathryn R. Macapagal, M.Ed. 1,2, Heather A. Rupp, Ph.D. 2, & Julia R. Heiman, Ph.D.
Educational Outcomes: The Role of Competencies and The Importance of Assessment.
Educational Action Research Todd Twyman Summer 2011 Week 1.
MSc Applied Psychology PYM403 Research Methods Validity and Reliability in Research.
Maria Cristina Matteucci, Dina Guglielmi
Chapter Three Research Design.
Cluster Analysis on Perceived Effects of Scholarships on STEM Majors’ Commitment to Becoming Teachers versus Teaching in High Needs Schools Pey-Yan Liou.
TAYLOR HOWARD The Employment Interview: A Review of Current Studies and Directions for Future Research.
Students worked through two to four representations of each quiz. In many cases, student solution strategies varied strongly from representation to representation.
Statistics Education Research Journal Publishing in the Statistics Education Research Journal Robert C. delMas University of Minnesota Co-Editor Statistics.
Project Background Results Amanda Krueger & Tiffany Huynh  Dr. Robert J. Eierman  ORSP  University of Wisconsin-Eau Claire prioritieschallenges The.
PART-TIME JOB AMONG UMP’S STUDENTS DURING STUDY TIME Presented By: NURUL AIN FARIDAH HANUM NURUL NAJWA.
Elizabeth C. Rodriguez Jessica Pettyjohn Chapter 11 Week 10.
Abstract evaluation Another example…. The abstract The purposes of this study were to examine athletes' mental skill use in practice and competition,
Chapter 4 Research Methods
Introducing small-group workshops as formative assessment in large first year psychology modules Suzanne Guerin School of Psychology, University College.
Variation, Validity, & Variables Lesson 3. Research Methods & Statistics n Integral relationship l Must consider both during planning n Research Methods.
Classroom Assessment and Grading
Chris Evans, University of Winchester Dr Paul Redford, UWE Chris Evans, University of Winchester Dr Paul Redford, UWE Self-Efficacy and Academic Performance:
Student Centered Teaching Through Universal Instructional Design Part II.
Program Evaluation. Program evaluation Methodological techniques of the social sciences social policy public welfare administration.
ONLINE VS. FACE-TO-FACE: EDUCATOR OPINIONS ON PROFESSIONAL DEVELOPMENT DELIVERY METHODS BY TERESA SCRUGGS THOMAS Tamar AvineriEMS 792x.
Evaluating the Vermont Mathematics Initiative (VMI) in a Value Added Context H. ‘Bud’ Meyers, Ph.D. College of Education and Social Services University.
A review of research on English-for- academic-purposes instruction: What learning transfers, and how far? Mark Andrew James Arizona State University
University of Arkansas Faculty Senate Task Force on Grades Preliminary Report April 19, 2005.
Background: As students complete their clerkships throughout their M3 year they gain in clinical experience and confidence, which may translate into improved.
Ensuring that Professional Development Leads to Improved Mathematics Teaching & Learning Kristen Malzahn Horizon Research, Inc. TDG Leadership Seminar.
THE RELATIONSHIP BETWEEN PRE-SERVICE TEACHERS’ PERCEPTIONS TOWARD ACTIVE LEARNING IN STATISTIC 2 COURSE AND THEIR ACADEMIC ACHIEVEMENT Vanny Septia Efendi.
Chapter 1 Introduction to Statistics. Statistical Methods Were developed to serve a purpose Were developed to serve a purpose The purpose for each statistical.
A review of peer assessment tools. The benefits of peer assessment Peer assessment is a powerful teaching technique that provides benefits to learners,
Methodology Matters: Doing Research in the Behavioral and Social Sciences ICS 205 Ha Nguyen Chad Ata.
The Watson Institute Research has demonstrated that psychosocial factors influence the behavioral development and rehabilitation course of children with.
Teaching Assistants Facilitating Conceptual Understanding in an Introductory Chemistry Laboratory Course Using the Science Writing Heuristic: Quantitative.
A Comparison of General v. Specific Measures of Achievement Goal Orientation Lisa Baranik, Kenneth Barron, Sara Finney, and Donna Sundre Motivation Research.
Changes in Professional licensure Teacher evaluation system Training at Coastal Carolina University.
Online students’ perceived self-efficacy: Does it change? Presenter: Jenny Tseng Professor: Ming-Puu Chen Date: July 11, 2007 C. Y. Lee & E. L. Witta (2001).
3-1 Copyright © 2010 Pearson Education, Inc. Chapter Three Research Design.
Teaching the Control of Variables Strategy in Fourth Grade Classrooms Robert F. Lorch, Jr., William J. Calderhead, Emily E. Dunlap, Emily C. Hodell, Benjamin.
Assessment Design and its relationship to NARS and ILOs Arthur Brown Advisor to the Quality Assurance and Accreditation Project Republic of Egypt.
PSY 219 – Academic Writing in Psychology Fall Çağ University Faculty of Arts and Sciences Department of Psychology Inst. Nilay Avcı Week 9.
The research process Psych 231: Research Methods in Psychology.
[School Name]’s Student Perception Survey Results This presentation is a template and should be customized to reflect the needs and context of your school.
Overview of Results and Demographics Amanda Krueger  Dr. Robert J. Eierman  ORSP  University of Wisconsin-Eau Claire prioritieschallenges The Mindful.
Some Terminology experiment vs. correlational study IV vs. DV descriptive vs. inferential statistics sample vs. population statistic vs. parameter H 0.
NCATE Unit Standards 1 and 2
INTERNATIONAL ASSESSMENTS IN QATAR TIMSS
The Document Based Question
PSYCH 640 Education for Service/snaptutorial.com.
Social Change Implications
Section 12.2: Tests about a Population Proportion
Your Poster Title Goes Here
Your Poster Title Goes Here
I Your Poster Title Here Author with credentials (use ANA format)
INSERT YOUR POSTER TITLE Author with credentials (use ANA format)
THE RELATIONSHIP BETWEEN PRE-SERVICE TEACHERS’ PERCEPTIONS TOWARD ACTIVE LEARNING IN STATISTIC 2 COURSE AND THEIR ACADEMIC ACHIEVEMENT Vanny Septia Efendi.
McREL TEACHER EVALUATION SYSTEM
Your Poster Title Goes Here
Exam technique.
An Introduction to Evaluating Federal Title Funding
McREL TEACHER EVALUATION SYSTEM
Presentation transcript:

Effect of Paper Color on Students’ Physics Exam Performances David R. Schmidt, Todd G. Ruskell, and Patrick B. Kohl Objectives Examine the manifestation of a color-performance relationship in an introductory E&M course. Discuss findings in the context of prior studies’ arguments and claims. Address the implications of results for current institutional practices. Background Prior work has 1.Established the existence of a color-performance relationship in achievement contexts 1,2. 2.Demonstrated the presence of such a relationship in some undergraduate course examinations. Results, however, have been inconsistent 3,4,5. Since papers of various colors can be used to distinguish exam versions (as is done at CSM), the possibility that different colors may lead to measurable differences in performance raises an issue of basic fairness in educational practice. Discussion & Conclusion All results were null. As such, we conclude that use of the colors tested here in similar exam settings will most likely not yield differential performances. As no concrete claims regarding causality can be made concerning this null result, this conclusion may or may not be generalizable to all possible colors and shades thereof. We speculate on mechanisms for this null result (as compared to the results observed elsewhere) in the associated proceedings article. Results from ANOVA testing on the time students’ required in completing their exams, their initial levels of confidence, their self-perceptions of performance, and their confidence gains for Exams I, II, and III. “Initial Confidence” and “Perceived Performance” were measured by questions placed at the beginning and end of each exam asking students to self-evaluate on a 1-5 scale. For Exam II, only time was measured. All tests yielded null results, and we did not observe any trends consistent across all three exams. Results from ANOVA testing on students’ total, multiple choice, free response, conceptual, and mathematical performances on Exams I, II, and III. For the purposes of this study, a question was categorized as “Conceptual” if it did not require any manipulation or numerical evaluation. All other questions were categorized as “Mathematical.” All tests yielded null results, and we did not observe any trends consistent across all three exams. Students’ total exam scores differentiated by exam and paper color. Error bars represent 95% confidence intervals based on standard errors of the means. For each exam, performances associated with each color were within error of one another. Performance Other Experiment & Data For three regular examinations in an introductory E&M course (Spring 2012, N~400), we printed each exam version on a different color of paper. We conducted analysis involving measures of performance and other data. Analysis of performance included students’ total exam scores, scores on different types of question (conceptual vs. mathematical), and different question formats (free response vs. multiple choice). Analysis of other, non-performance, measures included students’ completion times, confidences, and perceptions of performance. Acknowledgements Thanks to the NSF TUES grant which funded this study and to the rest of the Physics II teaching staff. 1.A.S. Soldat, R.C. Sinclair, and M.M. Mark, “Color as an environmental processing cue: External affective cues can directly affect processing strategy without affecting mood,” Soc. Cognition 15(1), 55-71, A.J. Elliot, M.A. Maier, A.C. Moller, R. Friedman, and J. Meinhardt, “Color and psychological functioning: The effect of red on performance attainment,” J. Exp. Psychol. Gen. 136(1), 154–168, R.C. Sinclair, A.S. Soldat, and M.M. Mark, “Affective cues and processing strategy: Color-coded examination forms influence performance,” Teach. Psychol. 25(2), , N.F. Skinner, “Differential test performance from differently colored paper: White paper works best,” Teach. Psychol., 31(2), 111–112, I.R. Tal, K.G. Akers, and G.K. Hodge, “Effect of paper color and question order on exam performance,” Teach. Psychol. 35(1), 26-28, Exam IExam IIExam III F Ratiop-valueF Ratiop-valueF Ratiop-value Total ScoreF(3,314)=0.86p=0.454F(3,409)=0.47p=0.702F(3,395)=0.80p=0.497 Multiple ChoiceF(3,314)=1.21p=0.306F(3,409)=0.48p=0.698F(3,395)=0.73p=0.536 Free ResponseF(3,314)=0.27p=0.265F(3,409)=0.19p=0.902F(3,395)=1.53p=0.206 ConceptualF(3,314)=0.84p=0.836F(3,409)=0.33p=0.327F(3,395)=0.85p=0.849 MathematicalF(3,314)=0.18p=0.178F(3,409)=0.64p=0.592F(3,395)=0.43p=0.731 Exam IExam IIExam III F Ratiop-valueF Ratiop-valueF Ratiop-value TimeF(3,212)=2.68p=0.048F(3,405)=2.24p=0.083F(3,317)=0.41p=0.745 Initial ConfidenceF(3,314)=0.63p=0.597XXF(3,393)=2.68p=0.047 Perceived PerformanceF(3,303)=1.57p=0.197XXF(3,382)=1.77p=0.153 Confidence GainF(3,303)=1.13p=0.339XXF(3,382)=0.56p=0.640