GENERAL MEASUREMENT CONCEPTS ELEMENTS OF SCORE ANALYSIS TYPES OF SCORES COMMON UNIT OF MEASURE THREE STEPS OF ANALYZING A SET OF SCORES CALCULATORS AND.

Slides:



Advertisements
Similar presentations
© McGraw-Hill Higher Education. All rights reserved. Chapter 3 Reliability and Objectivity.
Advertisements

Statistics Versus Parameters
Introduction to Statistics & Measurement
Measurement  The process whereby individual instances within a defined population are scored on an attribute according to rules Usually given a numeric.
Introduction to Statistics and Research
Measurement in Survey Research Developing Questionnaire Items with Respect to Content and Analysis.
QUANTITATIVE DATA ANALYSIS
Concept of Measurement
Beginning the Research Design
Research Methods in MIS
Chapter 9 Audit Sampling: An Application to Substantive Tests of Account Balances McGraw-Hill/Irwin ©2008 The McGraw-Hill Companies, All Rights Reserved.
Chi-square Test of Independence
1 1 Slide © 2006 Thomson/South-Western Chapter 1 Data and Statistics I need help! Applications in Business and Economics Data Data Sources Descriptive.
Sources of Data Levin and Fox Ch. 1: The Experiment The Survey Content Analysis Participant Observation Secondary Analysis 1.
FOUNDATIONS OF NURSING RESEARCH Sixth Edition CHAPTER Copyright ©2012 by Pearson Education, Inc. All rights reserved. Foundations of Nursing Research,
Measuring Social Life Ch. 5, pp
1 Psych 5500/6500 Statistics and Parameters Fall, 2008.
The Practice of Social Research
Measurement and Data Quality
Descriptive and Causal Research Designs
Chapter 1: Introduction to Statistics
Chapter 1: Introduction to Statistics
Can't Type. press F11 or F5. Can’t Hear
Instrumentation.
Foundations of Educational Measurement
McGraw-Hill/Irwin Business Research Methods, 10eCopyright © 2008 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 11 Measurement.
McMillan Educational Research: Fundamentals for the Consumer, 6e © 2012 Pearson Education, Inc. All rights reserved. Educational Research: Fundamentals.
McGraw-Hill/Irwin Business Research Methods, 10eCopyright © 2008 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 11 Measurement.
Statistics: Basic Concepts. Overview Survey objective: – Collect data from a smaller part of a larger group to learn something about the larger group.
Basic Statistic in Technology and Assessment Mary L. Putman.
Statistical Tools in Evaluation Part I. Statistical Tools in Evaluation What are statistics? –Organization and analysis of numerical data –Methods used.
© 2006 McGraw-Hill Higher Education. All rights reserved. Numbers Numbers mean different things in different situations. Consider three answers that appear.
An Introduction to Measurement and Evaluation Emily H. Wughalter, Ed.D. Summer 2008 Department of Kinesiology.
Types of Data in FCS Survey Nominal Scale – Labels and categories (branch, farming operation) Ordinal Scale – Order and rank (expectations, future plans,
An Introduction to Measurement and Evaluation Emily H. Wughalter, Ed.D. Summer 2010 Department of Kinesiology.
1 Concepts of Variables Greg C Elvers, Ph.D.. 2 Levels of Measurement When we observe and record a variable, it has characteristics that influence the.
COURSE: JUST 3900 INTRODUCTORY STATISTICS FOR CRIMINAL JUSTICE Instructor: Dr. John J. Kerbs, Associate Professor Joint Ph.D. in Social Work and Sociology.
Chapter 4: Test administration. z scores Standard score expressed in terms of standard deviation units which indicates distance raw score is from mean.
Chapter 1 Introduction to Statistics. Statistical Methods Were developed to serve a purpose Were developed to serve a purpose The purpose for each statistical.
Chapter 1 Measurement, Statistics, and Research. What is Measurement? Measurement is the process of comparing a value to a standard Measurement is the.
An Introduction to Statistics and Research Design
Basic Statistic in Technology and Assessment Mary L. Putman.
Selecting a Sample. Sampling Select participants for study Select participants for study Must represent a larger group Must represent a larger group Picked.
Chapter 13 Descriptive Data Analysis. Statistics  Science is empirical in that knowledge is acquired by observation  Data collection requires that we.
Chapter 2: Behavioral Variability and Research Variability and Research 1. Behavioral science involves the study of variability in behavior how and why.
METHODS IN BEHAVIORAL RESEARCH NINTH EDITION PAUL C. COZBY Copyright © 2007 The McGraw-Hill Companies, Inc.
MM207 Statistics Welcome to the Unit 2 Seminar name.
S519: Evaluation of Information Systems Social Statistics Inferential Statistics Chapter 16: reliability and validity.
Central Tendency A statistical measure that serves as a descriptive statistic Determines a single value –summarize or condense a large set of data –accurately.
Chapter 3: Central Tendency. Central Tendency In general terms, central tendency is a statistical measure that determines a single value that accurately.
Psychometrics. Goals of statistics Describe what is happening now –DESCRIPTIVE STATISTICS Determine what is probably happening or what might happen in.
IMPORTANCE OF STATISTICS MR.CHITHRAVEL.V ASST.PROFESSOR ACN.
Chapter 7 Measuring of data Reliability of measuring instruments The reliability* of instrument is the consistency with which it measures the target attribute.
12-1 Chapter 12 Measurement Learning Objectives Understand... distinction between measuring objects, properties, and indicants of properties similarities.
McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. MEASUREMENT Chapter 11.
Introduction To Statistics
Chapter 6 - Standardized Measurement and Assessment
1.  The practice or science of collecting and analyzing numerical data in large quantities, especially for the purpose of inferring* proportions in a.
Chapter 13 Understanding research results: statistical inference.
Measurement Chapter 6. Measuring Variables Measurement Classifying units of analysis by categories to represent variable concepts.
Copyright © 2014 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 11 Measurement and Data Quality.
An Introduction to Measurement and Evaluation
in Technology and Assessment Mary L. Putman
Computing Reliability
Introduction to Statistics and Research
1 Chapter 1: Introduction to Statistics. 2 Variables A variable is a characteristic or condition that can change or take on different values. Most research.
Statistics Chapter 1 Sections
Ms. Saint-Paul A.P. Psychology
Creating a Codebook.
Presentation transcript:

GENERAL MEASUREMENT CONCEPTS

ELEMENTS OF SCORE ANALYSIS TYPES OF SCORES COMMON UNIT OF MEASURE THREE STEPS OF ANALYZING A SET OF SCORES CALCULATORS AND COMPUTERS

WHY ANALYSIS TEST SCORES? “FOR A LARGE GROUP A SIMPLE LIST OF SCORES HAS NO MEANING” “OVERALL GROUP PERFORMANCE AND/OR IMPROVEMENT CAN ONLY BE INTERPRETED BY CONDENSING THE INFORMATION AND APPLYING DESCRIPTIVE STATISTICS TO IT”

WHY ANALYSIS TEST SCORES? “ONCE THE OVERALL GROUP PERFORMANCE IS DETERMINED, INDIVIDUAL PERFORMANCE CAN THEN BE EVALUATED IN RELATION IN RELATION TO THE OVERALL GROUP PERFORMANCE”

TYPES OF SCORES CONTINUOUS SCORES DISCRETE SCORES

CONTINUOUS SCORES HAVE POTENTIALLY AN INFINITE NUMBER OF VALUES AS THEY CAN BE MEASURED WITH VARYING DEGREES OF ACCURACY BETWEEN ANY TWO VALUES EXIST COUNTLESS VALUES THAT CAN BE EXPRESSRED AS FRACTIONS EXAMPLES: TIME, WEIGHT, & LENGTH

CONTINUOUS SCORES MOST CONTINUOUS SCORES ARE ROUNDED OFF TO THE NEAREST UNIT OF MEASUREMENT WHEN RECORDED 5 OR MORE IS ROUNDED UP AND 4 OR LESS IS ROUNDED DOWN EXAMPLE ROUNDING TO A WHOLE NUMBER: 1.6 = 2; 1.4 = 1

DISCRETE SCORES LIMETED TO A SPECIFIC NUMBER OF VALUES ARE NOT EXPRESSED IN FRACTIONS EXAMPLES - FREE THROWS MADE IN BASKETBALL OR SUCCESSFUL THROWS AT A TARGET

OTHER CLASSIFICATION OF SCORES RATIO INTERVAL ORDINAL NOMINAL

RATIO SCORES COMMON UNIT OF MEASUREMENT BETWEEN EACH SCORE TRUE ZERO POINT STATEMENTS ABOUT EQUALITY OF RATIOS CAN BE MADE: 1 SCORE CAN BE REFERRED TO AS 2 TIMES GREATER THAN ANOTHER SCORE EXAMPLES INCLUDE DISTANCE, TIME, WEIGHT, AND LENGTH

INTERVAL SCORES COMMON UNIT OF MEASUREMENT BETWEEN EACH SCORE NO TRUE ZERO (A SCORE OF ZERO ON A KNOWLEDGE TEST DOES NOT INDICATE TOTAL LACK OF KNOWLEDGE) AND HENCE STATEMENTS ABOUT EQUALITY OF RATIOS CAN NOT BE MADE

“MOST PHYSICAL PEFORMANCE SCORES ARE EITHER RATIO OR INTERVAL SCORES”

ORDINAL SCORES DO NOT HAVE A COMMON UNIT OF MEASUREMENT BETWEEN SCORES AND DO NOT HAVE A TRUE ZERO THERE IS AN ORDER IN THE SCORES THAT MAKES IT POSSIBLE TO DESCRIBE OR LIST ONE SCORE HIGHER THAN THE OTHER SCORE EXAMPLE: CLASS RANK ON A PUSH-UP TEST

NOMINAL SCORES CANNOT BE RANKED ORDER MUTUALLY EXCLUSIVE SCORES CANNOT SAY THAT ONE SCORE IS BETTER THAN ANOTHER SCORE EXAMPLES: SPORT PREFERENCE, GENDER, AND ETHNICITY

COMMON UNITS OF MEASURE SCORES MUST BE RECORDED IN A SINGLE UNIT OF MEASUREMENT SUCH AS CENTIMETERS RATHER THAN METERS AND CENTIMETERS USUALLY RECORDED IN THE SMALLER ONE SUCH AS CENTIMETERS RECORDING SCORES IN THE SMALLER UNIT OF MEASURE AS THEY ARE COLLECTED IS LESS TIME-CONSUMING THAN CONVERTING THEM INTO THAT FORM LATER

SELECTING A CRITERION SCORE

MEAN SCORE VERSUS BEST SCORE CRITERION SCORE IS THE MEASURE USED TO INDICATE A PERSON’S ABILITY GENERALLY A BETTER INDICATOR WHEN DEVELOPED FROM MORE THAN 1 TRIAL (I.E., MEAN SCORE FROM MORE THAN 1 TRIAL) RELIABILITY INCREASES AS THE NUMBER OF MEASURES INCREASES

MEAN SCORE VERSUS BEST SCORE GENERALLY THE MOST RELIABILE CRITERION SCORE AND THE BEST INDICATOR OF TRUE ABILITY (TYPICAL PERFORMANCE) MAY BE THE MEAN SCORE OF MULTIPLE TRIALS AS THE SUM OF THE ERRORS OF MEASURMENT IS ZERO NOTE: OBSERVED SCORE EQUALS TRUE SCORE PLUS ERROR SCORE

MEAN SCORE VERSUS BEST SCORE FOR MULTIPLE-TRIAL PHYSICAL PERFORMANCE TESTS WHERE MAXIMAL ABILITY RATHER THAN TYPICAL ABILITY IS DESIRED, AND THE EQUIPMENT AND SCORING PROCEDURE ARE HIGHLY ACCURATE, THE BEST SCORE IS THE BEST INDICATOR OF A PERSON’S TRUE ABILITY AS A PERSON CANNOT SCORE BETTER THAN HER OR HIS PHYSIOLOGICAL CAPACITY TYPICAL OF MANY PHYSIOLOGICAL MEASUREMENTS TAKEN IN A LABORATORY SETTING)

MEAN SCORE VERSUS BEST SCORE IF THE BEST SCORE IS USED AS THE CRITERION SCORE: -IT SHOULD BE BASED ON MULTIPLE TRIALS -IT IS NOT THE SAME TRIAL FOR EACH PERSON

MEAN SCORE VERSUS BEST SCORE DEPEDNING ON THE SITUATION AND WHAT THE TEST ADMINISTRATOR BELIEVES IS MOST APPROPRIATE, AN INDIVIDUAL’S CRITERION SCORE FROM MULTIPLE TRIAL TESTS MAY BE DETERMINED IN ANY OF THE FOLLOWING WAYS: -MEAN OF ALL TRIAL SCORES -BEST SCORE OF ALL TRIAL SCORES -MEAN OF THE SELECTED TRIAL SCORES BASED ON THE TRIALS ON WHICH THE GROUP SCORED BEST -MEAN OF THE SELECTED TRIAL SCORES BASED ON THE TRIALS ON WHICH THE INDIVIDUAL SCORED BEST

THREE STEPS OF ANALYZING A SET OF TEST SCORES SELECT THE APPROPRIATE ANALYSIS TECHNIQUE COMPLETE CALCULATIONS WITH THE ANALSYS TECHNIQUE INTERPRET THE RESULTS OF THE ANALYSIS TECHNIQUE

CALCULATORS AND COMPUTERS SCORE ANALYSIS SHOULD BE ACCURATE AND QUICK CALCULATORS WORK WELL WITH SMALL DATA SETS; BUT WITH LARGER DATA SETS THE USE OF CALCULATORS BECOME MORE TIME-CONSUMING AND MORE MISTAKES TEND TO BE MADE COMPUTERS WITH DATA ANALYSIS SOFTWARE SUCH AS SPSS ARE VERY FAST AND ACCURATE

QUESTIONS OR COMMENTS??