MENCARI KEBOLEHPERCAYAAN INSTRUMEN YANG DIGUNAKAN  Sejauh manakah instrumen yang digunakan boleh menghasilkan skor yang hampir sama sekirannya ditadbir.

Slides:



Advertisements
Similar presentations
Consistency in testing
Advertisements

Types of Reliability.
Reliability Definition: The stability or consistency of a test. Assumption: True score = obtained score +/- error Domain Sampling Model Item Domain Test.
© McGraw-Hill Higher Education. All rights reserved. Chapter 3 Reliability and Objectivity.
Chapter 5 Reliability Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006.
The Department of Psychology
© 2006 The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Validity and Reliability Chapter Eight.
Assessment Procedures for Counselors and Helping Professionals, 7e © 2010 Pearson Education, Inc. All rights reserved. Chapter 5 Reliability.
 A description of the ways a research will observe and measure a variable, so called because it specifies the operations that will be taken into account.
Reliability Analysis. Overview of Reliability What is Reliability? Ways to Measure Reliability Interpreting Test-Retest and Parallel Forms Measuring and.
Part II Sigma Freud & Descriptive Statistics
Methods for Estimating Reliability
CORRELATIONAL ANALYSES EDRS 5305 EDUCATIONAL RESEARCH & STATISTICS.
Measurement. Scales of Measurement Stanley S. Stevens’ Five Criteria for Four Scales Nominal Scales –1. numbers are assigned to objects according to rules.
Reliability and Validity of Research Instruments
Part II Knowing How to Assess Chapter 5 Minimizing Error p115 Review of Appl 644 – Measurement Theory – Reliability – Validity Assessment is broader term.
Reliability n Consistent n Dependable n Replicable n Stable.
Reliability Analysis. Overview of Reliability What is Reliability? Ways to Measure Reliability Interpreting Test-Retest and Parallel Forms Measuring and.
Reliability n Consistent n Dependable n Replicable n Stable.
Conny’s Office Hours will now be by APPOINTMENT ONLY. Please her at if you would like to meet with.
Education 795 Class Notes Factor Analysis II Note set 7.
Research Methods in MIS
Validity and Reliability EAF 410 July 9, Validity b Degree to which evidence supports inferences made b Appropriate b Meaningful b Useful.
Classroom Assessment A Practical Guide for Educators by Craig A
Reliability of Selection Measures. Reliability Defined The degree of dependability, consistency, or stability of scores on measures used in selection.
Classical Test Theory By ____________________. What is CCT?
MGTO 324 Workshop 4: Reliability. Activity 1 Use the data management concepts discussed in the last lesson to input all the data provided on the given.
Instrumentation.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Data Analysis. Quantitative data: Reliability & Validity Reliability: the degree of consistency with which it measures the attribute it is supposed to.
CRT Dependability Consistency for criterion- referenced decisions.
Reliability Chapter 3. Classical Test Theory Every observed score is a combination of true score plus error. Obs. = T + E.
Reliability Chapter 3.  Every observed score is a combination of true score and error Obs. = T + E  Reliability = Classical Test Theory.
Tests and Measurements Intersession 2006.
Chapter 8 Validity and Reliability. Validity How well can you defend the measure? –Face V –Content V –Criterion-related V –Construct V.
Class 9 Dependent Variables, Instructions/Literature Review
Designs and Reliability Assessing Student Learning Section 4.2.
Chronbach’s Alpha Ginnie Bushong. Chronbach Alpha Also known as Alpha Coefficient An internal consistency or reliability coefficient for an instrument.
Free Space Optics(FSO) Free Space Photonics(FSP) atau Wireless optic Merujuk kepada pemindahan gelombang infrared melalui atmosfera untuk mendapatkan komunikasi.
Reliability n Consistent n Dependable n Replicable n Stable.
©2011 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Reliability: Introduction. Reliability Session Definitions & Basic Concepts of Reliability Theoretical Approaches Empirical Assessments of Reliability.
Classroom Assessment Chapters 4 and 5 ELED 4050 Summer 2007.
Reliability When a Measurement Procedure yields consistent scores when the phenomenon being measured is not changing. Degree to which scores are free of.
TEST SCORES INTERPRETATION - is a process of assigning meaning and usefulness to the scores obtained from classroom test. - This is necessary because.
Slides to accompany Weathington, Cunningham & Pittenger (2010), Chapter 10: Correlational Research 1.
Language Assessment Lecture 7 Validity & Reliability Instructor: Dr. Tung-hsien He
Measuring Research Variables
5. Evaluation of measuring tools: reliability Psychometrics. 2011/12. Group A (English)
Chapter 2 Norms and Reliability. The essential objective of test standardization is to determine the distribution of raw scores in the norm group so that.
Class 9 Dependent Variables, Instructions/Literature Review Class 9 Dependent Variables, Instructions/Literature Review Chapters 13 Spring 2016.
MODEL REGRESI VARIABEL DUMMY A.Sifat Alamiah Variabel-Variabel Dummy Variabel yang diasumsikan nilai 0 dan 1 suatu perangkat untuk menggolongkan data ke.
assessing scale reliability
DCE 3105: PENILAIAN LATIHAN Semester Pertama 11/12
NEUROCITE 2.0: Simulator Peramalan Rangkaian Neural Buatan
Konsep Pengukuran dalam Penyelidikan
PEMARKAHAN LAPORAN AKNC Anugerah Kualiti Naib Canselor 2014
STATISTIK INFERENSI Populasi Sampel Dapatan.
koc3203 ASAS PERIKLANAN Perancangan Media
KORELASI.
BAB 8 TATASUSUNAN.
Pengenalan.
Penyelesaian Rangkaian Multimedia
PSY 614 Instructor: Emily Bullock, Ph.D.
OPEN UNIVERSITY MALAYSIA
06.09 : PREPARE INSTALLATION CHECKLIST
Reliability.
MENGGUNAKAN OBJEK VISUAL BASIC 6.0
The first test of validity
Penerbitan Persembahan
Presentation transcript:

MENCARI KEBOLEHPERCAYAAN INSTRUMEN YANG DIGUNAKAN  Sejauh manakah instrumen yang digunakan boleh menghasilkan skor yang hampir sama sekirannya ditadbir berulang kali  Perlu dilakukan pada peringkat ujian rintis dan semasa kajian sebenar  Lazimnya menggunakan Kaedah Cronbach Alpha (data skala) dan KR-20 (data dikotomi)

KEBOLEHPERCAYAAN INSTRUMEN Ketekalan Dalaman (Internal consistency) Split-half Reliablity Scorer/Rater Reliability Kuder-Richardson 20 (KR-20) Cronbach’s Alpha ( α ) Data Dikotomi : KR-20 Data Skala : Cronbach α

KONSEP KEBOLEHPERCAYAAN Researchers must demonstrate instruments are reliable since without reliability, research results using the instrument are not replicable, and replicability is fundamental to the scientific method. Reliability is the correlation of an item, scale, or instrument with a hypothetical one which truly measures what it is supposed to. Since the true instrument is not available, reliability is estimated in one of four ways: Internal consistency: Estimation based on the correlation among the variables comprising the set (typically, Cronbach's alpha, KR-20) Split-half reliability: Estimation based on the correlation of two equivalent forms of the scale (typically, the Spearman-Brown coefficient) Test-retest reliability: Estimation based on the correlation between two (or more) administrations of the same item, scale, or instrument for different times, locations, or populations, when the two administrations do not differ on other relevant variables (typically, the Spearman Brown coefficient) Inter-rater reliability: Estimation based on the correlation of scores between/among two or more raters who rate the same item, scale, or instrument

Nunnally and Bernstein (1994) provided guidance in the interpretation of the reliability coefficient by stating that a value of.70 is sufficient for early stages of research, but that basic research should require test scores to have a reliability coefficient of.80 or higher. When important decisions are to be made with test scores, a reliability coefficient of.90 is the minimum with.95 or higher a desirable standard. (Nunnally, J.C. & Bernstein, I.H. (1994). Psychometric Theory (3 rd Edition)). George, D., & Mallery, P. (2003). SPSS for Windows step by step: A simple guide and reference update (4th ed.). Boston: Allyn & Bacon. Nilai Koefisien α Interpretasi > 0.9 Excellent > 0.8 Good > 0.7 Acceptable > 0.6 Questionable > 0.5 Poor < 0.5 Unacceptable Nilai Koefisien αInterpretasi.90 and upExcellent Good Adequate below.70 May have limited applicability U.S. Department of Labor Employment and Training Administration 1999

Mencari Cronbach α

1 2 1

1 1

1

Kesan item kepada nilai koefisien Cronbach α **Pengguguran item bukan hanya bergantung kepada nilai Cronbach alfa

Melapor Kebolehpercayaan Instrumen Secara keseluruhan instrumen kajian mempunyai nilai kebolehpercayaan (Cronbach alfa) yang tinggi (α = 0.86). Ini menunjukkan instrumen yang digunakan sesuai bagi menilai penilaian guru terhadap buku teks. Menurut Nunally dan Bernstein (1994), nilai.80 dan ke atas adalah mencukupi bagi instrumen yang baru dibina atau pertama kali digunakan manakal George & Mallery (2003) menyatakan nilai koefisiens kebolehpercayaan α > 0.7 menunjukkan kebolehpercyaan instrumen pada tahap baik. Di samping itu, anda juga perlu melaporkan nilai kebolehpercayaan bagi setiap aspek (sub-konstruk)