Alternate-Form Reliability Quintin Molina AED 615 – October 23, 2006.

Slides:



Advertisements
Similar presentations
CORRELATIONAL RESEARCH o What are the Uses of Correlational Research?What are the Uses of Correlational Research? o What are the Requirements for Correlational.
Advertisements

Action Research Not traditional educational research often research tests theory not practical Teacher research in classrooms and/or schools/districts.
Reliability Presentation Test-Retest James Blackwood – AED 615 Fall Semester 2006.
Survey Methodology Reliability and Validity EPID 626 Lecture 12.
The Research Consumer Evaluates Measurement Reliability and Validity
Chapter 5 Reliability Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006.
VALIDITY AND RELIABILITY
1Reliability Introduction to Communication Research School of Communication Studies James Madison University Dr. Michael Smilowitz.
Survey Methodology Reliability & Validity
Reliability for Teachers Kansas State Department of Education ASSESSMENT LITERACY PROJECT1 Reliability = Consistency.
Small Group Exercise: Measurement Roberto Castano, Monica Floricel, Susie Lau, Zubin Punthakee October 6, 2003.
Reliability: Internal Consistency By Lynn Woolever AED 615 October 23, 2006.
Part II Knowing How to Assess Chapter 5 Minimizing Error p115 Review of Appl 644 – Measurement Theory – Reliability – Validity Assessment is broader term.
Introduction  Bayesian methods are becoming very important in the cognitive sciences  Bayesian statistics is a framework for doing inference, in a principled.
Dissemination and Critical Evaluation of Published Research Peg Bottjen, MPA, MT(ASCP)SC.
BASIC TERMINOLOGY n Test n Measurement n Evaluation.
CONCEPT OF SELECTION The next step after requirement is the selection of candidates for the vacant position from among the applicants. This is the most.
Reliability of Selection Measures. Reliability Defined The degree of dependability, consistency, or stability of scores on measures used in selection.
Rosnow, Beginning Behavioral Research, 5/e. Copyright 2005 by Prentice Hall Ch. 6: Reliability and Validity in Measurement and Research.
Classical Test Theory By ____________________. What is CCT?
Classroom Assessment Reliability. Classroom Assessment Reliability Reliability = Assessment Consistency. –Consistency within teachers across students.
Selecting a topic Make sure that the topic you pick: addresses your instructor's assignment. is manageable and narrowly defined, one that can be effectively.
Technical Issues Two concerns Validity Reliability
Seminar in Applied Theory and Research II By: Peta-Gaye Grey
Reliability Presented By: Mary Markowski, Stu Ziaks, Jules Morozova.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Validity & Reliability Trustworthiness
Seminar on Research and Article Writing Presented by Dr. Chan Chang Tik.
OJJDP Performance Measurement Training 1 Presented by: Dr. Kimberly Kempf-Leonard School of Social Sciences University of Texas at Dallas
Using Picture Books to Teach Literary Terms in the High School English Classroom Bridget Robinson Bridget Robinson Department of Education University of.
Lesson 2: Planning Research Topics Results of Good Research Planning Elements of a Research Plan.
Nature of Science Language Dr. Frank Jenkins Centre for Research in Youth Science Teaching and Learning.
Reliability Chapter 3. Classical Test Theory Every observed score is a combination of true score plus error. Obs. = T + E.
Reliability Chapter 3.  Every observed score is a combination of true score and error Obs. = T + E  Reliability = Classical Test Theory.
+ Psychology Introduction & Research. + Scientific Method Orderly, systematic procedures researchers follow identify a research problem, design a study.
Student assessment AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences.
EDU 8603 Day 6. What do the following numbers mean?
Reliability vs. Validity.  Reliability  the consistency of your measurement, or the degree to which an instrument measures the same way each time it.
CDIS 5400 Dr Brenda Louw 2010 Validity Issues in Research Design.
Data Collection and Reliability All this data, but can I really count on it??
RELIABILITY AND VALIDITY OF ASSESSMENT
Chronbach’s Alpha Ginnie Bushong. Chronbach Alpha Also known as Alpha Coefficient An internal consistency or reliability coefficient for an instrument.
MEASUREMENT. MeasurementThe assignment of numbers to observed phenomena according to certain rules. Rules of CorrespondenceDefines measurement in a given.
McGraw-Hill/Irwin © 2012 The McGraw-Hill Companies, Inc. All rights reserved. Obtaining Valid and Reliable Classroom Evidence Chapter 4:
Criteria for selection of a data collection instrument. 1.Practicality of the instrument: -Concerns its cost and appropriateness for the study population.
Nurhayati, M.Pd Indraprasta University Jakarta.  Validity : Does it measure what it is supposed to measure?  Reliability: How the representative is.
Criterion Validity Kyle Sharp A ED 615 Fall 2006.
Reliability performance on language tests is also affected by factors other than communicative language ability. (1) test method facets They are systematic.
Reliability: Introduction. Reliability Session Definitions & Basic Concepts of Reliability Theoretical Approaches Empirical Assessments of Reliability.
VALIDITY, RELIABILITY & PRACTICALITY Prof. Rosynella Cardozo Prof. Jonathan Magdalena.
Role of Social Desirability in Personality Testing of Personnel Selection: The Red Herring Jeanette Cano Lucie-Ann Chen Corinna Morales Chanté Parsons.
2. Main Test Theories: The Classical Test Theory (CTT) Psychometrics. 2011/12. Group A (English)
Case Study Research Method How To Design and Evaluate Research in Education 5th Edition Chapter 18 Pages By: Davida Molina.
Lesson 2 Main Test Theories: The Classical Test Theory (CTT)
This multimedia product and its contents are protected under copyright law. The following are prohibited by law: any public performance or display including.
Inter-Rater or Inter- Observer Reliability. Description Is the extent to which two or more individuals (coders or raters) agree. Inter- Rater reliability.
Quality instrument* Questions are determined by objectives Resist the temptation to ask questions that are interesting but not relevant to your hypothesis.
Survey Methodology Reliability and Validity
MGMT 588 Research Methods for Business Studies
PSY 4550 Enthusiastic Studysnaptutorial.com
TESOL 505 Enthusiastic Studysnaptutorial.com
PSY 614 Instructor: Emily Bullock, Ph.D.
יום רביעי כ"ב בסיוון, 25 ביוני 2008, 20:00 – 21:30
מדיניות "האופק הפדגוגי" של מערכת החינוך ודרכים ליישומה
Competency 007: E.
By ____________________
How can one measure intelligence?
Methodology Week 5.
Measurement Concepts and scale evaluation
- '1:- bs? a ' I.
Presentation transcript:

Alternate-Form Reliability Quintin Molina AED 615 – October 23, 2006

Alternate Form Reliability The degree to which two or more versions of the same test correlate with one another. Process – a given function is tested more than once over time and it is important to have more than one version of a given instrument and to show that these different versions are reasonably equivalent. (

Example of Alternate-Form Reliability If memory is tested through the learning of a list of words, follow-up testing should use a different list of words of equivalent difficulty. If the same list of words were used on the second testing, scores would be inflated due to the subject’s prior knowledge of the words. (

AFR - Value to Survey Research The correlation of scores on pairs of alternate forms for the same examinees provides another measure of consistency or reliability.

Qualitative Usefulness Heavily favored in the qualitative based studies due to the fact that it lends itself neatly to the measure of consistency.

JAE Article Journal of Agricultural Education Article Journal of Agricultural Education Article

Bibliography VanLeeuwen, D.M., Dormody, T.J., Seevers, B.S.(1999). Assessing the reliability of student evaluation of teaching (sets) with generalizability theory. Journal of Agricultural Education, 40(4), 1-9.