Thank you!. To Grade or not to Grade, that is the question. Julie Collamer California State University, Bakersfield.

Slides:



Advertisements
Similar presentations
The National Center on Addiction and Substance Abuse at Columbia University ®
Advertisements

So what can I expect when I serve on a NEASC/CPSS Visiting Committee? A Primer for New Visiting Committee Members.
Experimental Design I. Definition of Experimental Design
Independent and Dependent Variables
Increasing your confidence that you really found what you think you found. Reliability and Validity.
Copyright © Allyn & Bacon (2007) Hypothesis Testing, Validity, and Threats to Validity Graziano and Raulin Research Methods: Chapter 8 This multimedia.
Copyright © Allyn & Bacon (2007) Final Preparations Before Data Collection Graziano and Raulin Research Methods: Chapter 14 This multimedia product and.
HS 98/99 Skills Lab Orientation Welcome to HS 98/99 We are very happy that you will be participating in Skills Lab this semester. Manuel Abroguena coordinates.
Chapter 9. Internal Validity Threats to Internal Validity Alternative explanations Alternative hypotheses The DV is NOT dependent upon the IV but instead.
Educational Action Research Todd Twyman Summer 2011 Week 1.
By Kelly Bauer, Lindsay Marsh, and Jackie Martin.
EXPERIMENTAL DESIGNS Criteria for Experiments
Reliability and Validity in Experimental Research ♣
Chapter 13 Data Collection ♣ ♣ Introduction   Research Participants   Sample Size   Apparatus and/or Instruments   Instructions   Scheduling.
Chapter 41 Training for Organizations Research Skills.
EXPERIMENTAL DESIGNS What Is Required for a True Experiment? What Are the Independent and Dependent Variables? What Is a Confounding Variable? What Are.
Research Ethics Levels of Measurement. Ethical Issues Include: Anonymity – researcher does not know who participated or is not able to match the response.
Lecture 10 Psyc 300A. Types of Experiments Between-Subjects (or Between- Participants) Design –Different subjects are assigned to each level of the IV.
Chapter 2 Research Process Part 2: Jan. 26, 2012.
Design and Control in Experimental Research Lawrence R. Gordon Psychology Research Methods I.
Ch12(1)1 Chapter 9 Procedure for Conducting an Experiment.
Chapter 2 Research Process Part 3: Sept. 2, 2011.
Curriculum Development Center (CDC) Curriculum Development Process Continue.
Chapter 9 Experimental Research Gay, Mills, and Airasian
Experimental Design The Gold Standard?.
PhD Research Seminar Series: Writing the Method Section Dr. K. A. Korb University of Jos.
The Learning Behaviors Scale
Group Discussion Explain the difference between assignment bias and selection bias. Which one is a threat to internal validity and which is a threat to.
Consumer Preference Test Level 1- “h” potato chip vs Level 2 - “g” potato chip 1. How would you rate chip “h” from 1 - 7? Don’t Delicious like.
Do jobs identified as high and low preference in a video assessment correspond with high levels of performance on the jobs identified?
Research Strategies Making Sense of Research Methods.
PYGMALION EFFECT: TEACHERS’ EXPECTATIONS AND HOW THEY IMPACT STUDENT ACHIEVEMENT Glen Gochal Professor O’Connor-Petruso Seminar in Applied Theory and Research.
Group Quantitative Designs First, let us consider how one chooses a design. There is no easy formula for choice of design. The choice of a design should.
Evaluating HRD Programs
Experimental Design Chapter 1 Research Strategies and the Control of Nuisance Variables.
Copyright © Allyn & Bacon (2010) Research Checklist Graziano and Raulin Research Methods: Appendix E This multimedia product and its contents are protected.
Research in Communicative Disorders1 Research Design & Measurement Considerations (chap 3) Group Research Design Single Subject Design External Validity.
How can giving ELL students access to learning games on a computer help them learn in the classroom? By: Lisa Cruz.
Introduction section of article
USING MUSIC TO SUPPORT LEARNING How Can the Use of Music as a Teaching Tool Support and Enhance Learning and Improve Learning Outcomes ? Millicent Howard.
Chapter 10 Experimental Research Gay, Mills, and Airasian 10th Edition
Chapter 8 – Lecture 6. Hypothesis Question Initial Idea (0ften Vague) Initial ObservationsSearch Existing Lit. Statement of the problem Operational definition.
Chapter 11.  The general plan for carrying out a study where the independent variable is changed  Determines the internal validity  Should provide.
An Action Research Project Chevonne Byas EDUC 7021 T Fall 2010 Overeating and Underachieving: The Effects of Physical Fitness on the Academic Achievement.
Study Skills Find your new seats. Review rules: 1.Be in your seat when the tardy bell rings. 2.Respect everyone. 3.Raise your hand if you want to talk.
How to Develop Balanced Biliteracy in Language Minority Children Education Fall 2010 Romina G. Ladner.
Qatar Comprehensive Educational Assessment (QCEA) 2008: Discussion Session For QCEA Support.
Introduction to Validity True Experiment – searching for causality What effect does the I.V. have on the D.V. Correlation Design – searching for an association.
Chapter 9 – Lecture 8. Some ways to control threats 1.General control procedures 2.Control over subject and experimenter effects 3.Control through participant.
Introduction to Statistics for the Social Sciences SBS200, COMM200, GEOG200, PA200, POL200, or SOC200 Lecture Section 001, Spring 2016 Room 150 Harvill.
Welcome Family and Community
Issues in Evaluating Educational Research
The effects of physical activity on third grade math scores
EXPERIMENTAL RESEARCH
Experiments Why would a double-blind experiment be used?
Between-Subjects, within-subjects, and factorial Experimental Designs
Hypothesis Testing, Validity, and Threats to Validity
Web-Based Virtual Learning Environments:
The Effects of Intensive Sand Writing on Phonemic Awareness in Kindergarten By Coby Long.
Research Methods.
Effect of Misinformation on Memory Recall
Chapter Eight: Quantitative Methods
Designing an Experiment
Social Research Methods Experimental Research
Indiana University School of Social Work
Procedure for Conducting an Experiment
The Experimental Method in Psychology
Experiments: Part 2.
I. Introduction and Data Collection C. Conducting a Study
Reminder for next week CUELT Conference.
Presentation transcript:

Thank you!

To Grade or not to Grade, that is the question. Julie Collamer California State University, Bakersfield

HYPOTHESIS The elimination of traditional grading (A,B,C,D or F) in the assessment of assignments completed by junior high students will reduce student nonverbal cues. The elimination of traditional grading (A,B,C,D or F) in the assessment of assignments completed by junior high students will reduce student nonverbal cues. Females show more nonverbal cues than males. 7 th graders show more nonverbal cues than 8 th graders.

Why... Why... Junior High Students? Grades? Nonverbal Stress Cues?

Procedure Teachers/Students will believe that they are teaching/attending a writing workshop. (double blind) The study will actually be looking at the students’ nonverbal reactions when assignments are returned with a letter grade or without a letter grade.

Writing Workshop 50 minute sessions, held Monday through Friday for two weeks. Four weeks at each school site. School #1 7 th - Graded School #2 7 th - No-grade School #1 7 th - Graded School #2 7 th - No-grade 8 th - No-grade 8 th - Graded 8 th - No-grade 8 th - Graded Teacher Students Brief on the writing assignments/topics Supervise students Correct assignments for grammar, content, and style Grade/No-Grade final drafts Complete four in-class writing assignments. Write/revise 4 (5pe)stories/essays Receive Grades or No Grades on assignments. Sessions will be video taped for future observation. Workshop procedure/instructions will be piloted

Independent Variables Grades – The traditional assignment of letter grades (A,B,C,D,orF) and corrections for grammar, content, and style will be indicated on student work. No-Grades – Assignment Complete and corrections for grammar, content, and style will be indicated on student work. Preexisting Variables: Gender (male/female) and Grade Level (7 th /8 th grade) Grades – Two levels

D.V. -Nonverbal Cues The measurements using the Nonverbal Cues scale will be piloted to assure they are appropriate, reliable, and valid. Observers will watch the video tapes and rate the students on the Nonverbal Cues scale. Ratings will occur pre/event/post return of the assignments Reaction Scale 0 = none 1 = mild 2 = moderate 3 = severe

Statistical Analysis Two-way between groups ANOVAs Two-way between groups ANOVAs Graded Non-graded Males Females Graded Non-graded 7 th Grade 8 th Grade  Level of Measurement: Ratio  No Post Hoc Testing n = 20  Assumptions met n > 15

Participants 7 th and 8 th Grade Students 7 th and 8 th Grade Students a. Selection Process d. Have basic writing skills a. Selection Process d. Have basic writing skills b. Random Assignment e. Certificate/Party b. Random Assignment e. Certificate/Party c. No behavior problems c. No behavior problems Demographics – ethnicity, age, gender, SES, Demographics – ethnicity, age, gender, SES, N = 80 7 th Grade (n=40 ) 8 th Grade (n=40) N = 80 7 th Grade (n=40 ) 8 th Grade (n=40) Males (20) Females (20)

Apparatus/Materials School Computer Lab Classroom, Microsoft Word, printers School Computer Lab Classroom, Microsoft Word, printers Curriculum materials Curriculum materials Video Equipment Video Equipment Nonverbal Cues Scale Nonverbal Cues Scale Refreshments Refreshments

Classroom Preparation Video equipment installed/hidden Video equipment installed/hidden Materials organized Materials organized Temperature of room comfortable Temperature of room comfortable Equipment check – computers/printers Equipment check – computers/printers

Research Staff Research Staff 2 – Credentialed Teachers* (retired) properly trained in the curriculum/workshop procedures 2 – Credentialed Teachers* (retired) properly trained in the curriculum/workshop procedures Observers* properly trained in the use of the nonverbal scale Observers* properly trained in the use of the nonverbal scale 2 - Assistants**, good listeners 2 - Assistants**, good listeners *Compensated **Volunteer

Research Ethics Obtain approval from Human Subjects Institutional Review Board, CSUB Obtain approval from Human Subjects Institutional Review Board, CSUB Obtain Informed Consent Obtain Informed Consent School Boards, Principals, School Boards, Principals, Teachers, Parents, Students Teachers, Parents, Students (English/Spanish) (English/Spanish) Debriefing – Yes! Debriefing – Yes!

Threats to Validity Maturation History Testing Instrumentation Regression to the Mean Selection Attrition Diffusion of TX Sequence Effects Sequence Effects No ThreatPossible ThreatProblematic

The End