SHOWTIME! NATURE AND ADMINISTRATION OF TESTS TEST CHARACTERISTICS RELIABILITY, OBJECTIVITY, AND VALIDITY CONTENT-RELATED ATTRIBUTES STUDENT AND PARTICIPANT.

Slides:



Advertisements
Similar presentations
Measurement Concepts Operational Definition: is the definition of a variable in terms of the actual procedures used by the researcher to measure and/or.
Advertisements

1 COMM 301: Empirical Research in Communication Kwan M Lee Lect4_1.
© McGraw-Hill Higher Education. All rights reserved. Chapter 3 Reliability and Objectivity.
What is a Good Test Validity: Does test measure what it is supposed to measure? Reliability: Are the results consistent? Objectivity: Can two or more.
General Information --- What is the purpose of the test? For what population is the designed? Is this population relevant to the people who will take your.
Social Learning / Imitation
Mary Jo Sariscsany Assessing Health- Related Fitness and Physical Activity 13 chapter.
Designing Scoring Rubrics. What is a Rubric? Guidelines by which a product is judged Guidelines by which a product is judged Explain the standards for.
Job Analysis Background Research 1)Organizational charts (e.g., how the job is connected to other positions and where it is located in the overall company)
Grading. Why do we grade? To communicate To tell students how they are doing To tell parents how students are doing To make students uneasy To wield power.
Assessment: Reliability, Validity, and Absence of bias
Chapter 6: Muscular Strength & Endurance. Muscular Strength and Endurance Defined  Muscular strength The ability of a muscle or muscle groups to exert.
Chapter 4 Validity.
Use of Children as Research Subjects What information should be provided for an FP7 ethical review?
Physical Fitness and Wellness for Children
Research Methods in MIS
Introduction to Measurement and Evaluation
INJURY PREVENTION AND FITNESS TRAINING. Injury Prevention  A conditioned athlete decreases his/her risk of injury.  The lack of physical fitness is.
Experimental Group Designs
Quantitative Research
Basic Principles of Research Design
Understanding Fitness Principles
Now that you know what assessment is, you know that it begins with a test. Ch 4.
Chapter 8 Experimental Research
Unit 6: Training and Supervision # Warm Up Questions: Instructions  Take five minutes now to try the Unit 6 warm up questions in your manual. 
Near East University Department of English Language Teaching Advanced Research Techniques Correlational Studies Abdalmonam H. Elkorbow.
Exercise for Health and Fitness. 2 Why Exercise? Ten Determinants of aging 1. Muscle mass- age lose 6-7 lbs./decade after age Muscle Strength.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 14 Measurement and Data Quality.
Induction to assessing student learning Mr. Howard Sou Session 2 August 2014 Federation for Self-financing Tertiary Education 1.
Dr. Afaf A Shaheen Lecture 10 RHS 322  The Ability of the body to adapt to the demands of physical effort in relation to both general health and specific.
Standardization and Test Development Nisrin Alqatarneh MSc. Occupational therapy.
Helping Learners. 1. Helping Learners Improve their Cognitive Understanding. 2. Help Learners Improve their Physical and Motor Fitness. 3. Help Learners.
Michelle Koford Summer Topics Discussed Background Purpose Research Questions Methods Participants Procedures Instrumentation Analysis.
Chapter 8 Experimental Design: Dependent Groups and Mixed Groups Designs.
Review: Cognitive Assessments II Ambiguity (extrinsic/intrinsic) Item difficulty/discrimination relationship Questionnaires assess opinions/attitudes Open-/Close-ended.
Chapter 4: Test administration. z scores Standard score expressed in terms of standard deviation units which indicates distance raw score is from mean.
Purposes of Health Professional  Educate Benefits of physical activity Do’s and don’ts of exercise  screen and evaluate  testing  design programs 
Fitness Testing. Why fitness test? Testing is an important evaluation tool for the athlete as it gives them insight into their current physical condition.
Chapter 6: Muscular Strength & Endurance. Muscular Strength and Endurance Defined  Muscular strength The ability of a muscle or muscle groups to exert.
Dr. Engr. Sami ur Rahman Assistant Professor Department of Computer Science University of Malakand Research Methods in Computer Science Lecture: Data Generation.
Why do we need fitness tests?. Task Fitness testing for Year 10 What equipment will you use? What are the pre-test procedures? What are the instructions?
GENERAL MEASUREMENT CONCEPTS ELEMENTS OF SCORE ANALYSIS TYPES OF SCORES COMMON UNIT OF MEASURE THREE STEPS OF ANALYZING A SET OF SCORES CALCULATORS AND.
Research Strategies. Why is Research Important? Answer in complete sentences in your bell work spiral. Discuss the consequences of good or poor research.
IMPROVING PERFORMANCE WHAT YOU NEED TO KNOW FOR TRIALS.
McGraw-Hill/Irwin © 2012 The McGraw-Hill Companies, Inc. All rights reserved. Obtaining Valid and Reliable Classroom Evidence Chapter 4:
Chapter 13 Assessment of Sport Skills and Motor Abilities.
Chapter 7 Measuring of data Reliability of measuring instruments The reliability* of instrument is the consistency with which it measures the target attribute.
Reliability Ability to produce similar results when repeated measurements are made under identical conditions. Consistency of the results Can you get.
9-1 Copyright © 2016 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education.
Muscular Strength and Endurance
Personal Fitness and Training. Personal training and the design of exercise is about helping people adopt, enjoy, and maintain an active lifestyle Personal.
Principles of Assessment and Outcome Measurement for Physical Therapists ksu. edu. sa Dr. taher _ yahoo. com Mohammed TA, Omar,
Review: Cognitive Assessments II Ambiguity (extrinsic/intrinsic) Item difficulty/discrimination relationship Questionnaires assess opinions/attitudes Open-/Close-ended.
CIV Fitness/S&C Steven Tikkanen – F129 1 Sutherland College Health & Recreation Semester Version 1.
Assessment of Sport Skills and Motor Abilities
©2013, The McGraw-Hill Companies, Inc. All Rights Reserved Chapter 5 What is a Good Test?
© 2008 McGraw-Hill Higher Education. All rights reserved. 1 Exercise for Health and Fitness Chapter 13.
©2013, The McGraw-Hill Companies, Inc. All Rights Reserved Chapter 8 Construction and Administration of Psychomotor Tests.
Ethics and the future of psychological testing. Almost any test can be useful in the right circumstances, but even the best test, when used inappropriately,
Fitness Assessment. Aims of fitness testing Identify strengths and weaknesses Set a benchmark Motivation and Goal Setting.
Safety and Risk-Management Planning Module A: Lesson 2 Grade 12: Active, Healthy Lifestyles.
Sampling and Sampling Distribution
9 Procedure for Conducting an Experiment.
National Standards for Athletic Coaches
Concept of Test Validity
Fitness Assessment #3.
Assessment of Sport Skills and Motor Abilities
PLANNING TO AVOID OVERTRAINING
Being a Coach Practical Lesson 1.
Chapter 8 VALIDITY AND RELIABILITY
Presentation transcript:

SHOWTIME!

NATURE AND ADMINISTRATION OF TESTS

TEST CHARACTERISTICS RELIABILITY, OBJECTIVITY, AND VALIDITY CONTENT-RELATED ATTRIBUTES STUDENT AND PARTICIPANT CONCERNS ADMINISTRATIVE CONCERNS

RELIABILITY, OBJECTIVITY, AND VALIDITY THE THREE MOST IMPORTANT CHARACTERISTICS FOR A TEST ACCEPTABLE LEVELS DETERMINED BY BOTH THE TESTING SITUATION ITSELF AND THE VALUES OTHERS HAVE PREVIOUSLY OBTAINED A MINIMAL COEFFICIENT IS.70

CONTENT-RELATED ATTRIBUTES IMPORTANT ATTRIBUTES DISCRIMINATION RESEMBLANCE SPECIFICITY UNRELATED MEASURES

IMPORTANT ATTRIBUTES NO MORE THAN 10% OF THE TIME SHOULD INVOLVE TESTING ONLY IMPORTANT SKILLS AND ABILITIES SHOULD BE MEASURED

DISCRIMINATION TEST SHOULD DISCRIMINATE AMONG DIFFERENCE ABILITY GROUPS THROUGHOUT THE TOTAL RANGE OF ABILITY SHOULD BE MANY DIFFERENT SCORES NORMALLY DISTRIBUTED TEST DIFFICULTY: HARD ENOUGH THAT NO ONE GETS A PERFECT SCORE AND EASY ENOUGH THAT NO ONE GETS A ZERO

RESEMBLANCE TO THE ACTIVITY IN ORDER TO INSURE RELEVANCY AND VALIDITY WHEN TAKING A TEST, INDIVIDUALS MUST BE REQUIRED TO USE GOOD FORM, FOLLOW THE RULES OF THE ACTIVITY, AND PERFORM ACTS CHARACTERISTIC OF THE ACTIVITY

SPECIFICITY THE TEST SHOULD BE AS SPECIFIC AS POSSIBLE FOR WHATEVER IS BEING MEASURED CONFOUNDING VARIABLES OR FACTORS SHOULD BE MINIMIZED EX.: PERFORMING STABILITY BALL PUSH- UPS AS MEASURE OF UPPER BODY MUSCULAR STRENGTH AND ENDURANCE IS CONFOUNDED OR AFFECTED BY BALANCE

UNRELATED MEASURES OFTEN AN ATTRIBUTE (E.G., HEALTH-RELATED FITNESS) HAS SEVERAL COMPONENTS (E.G., CARDIORESPIRATORY ENDURANCE, STRENGTH, MUSCLE ENDURANCE, FLEXIBILITY, AND BODY COMPOSITION) TESTS IN A BATTERY SHOULD BE UNRELATED TO EACH OTHER BUT HIGHLY RELATED TO THE ATTRIBUTE IF TWO TESTS IN THE BATTERY ARE HIGHLY RELATED TO EACH OTHER, THEY ARE MEASURING THE SAME ABILITY OR FACTOR KEEP THE TEST THAT IS MOST HIGHLY RELATED TO THE ATTRIBUTE BECAUSE IT HAS MORE VALIDITY AND DROP THE OTHER TEST

STUDENT PARTICIPATION CONCERNS APPROPRIATENESS TO STUDENT AND PARTICIPANTS -PERFORMANCE IS INFLUENCED BY THE PERSON’S MATURITY, GENDER, AND EXPERIENCE -FITNESS TEST SCORE STANDARDS SHOULD BE BASED ON AGE AND GENDER -SKILL TEST STANDARDS SHOULD BE BASED ON AGE, GENDER, SKILL LEVEL, STRENGTH, AND OTHER CAPACITIES -PERFORMANCE IS AFFECTED BY DISABILITIES AND THEREFORE, TESTS FOR INDIVIDUALS WITHOUT DISABILITIES ARE USUALLY NOT ACCEPTABLE FOR INDIVIDUALS WITH DISABILITIES

STUDENT PARTICIPATION CONCERNS INDIVIDUAL SCORES -PERSON’S TEST SCORES SHOULD NOT BE AFFECTED BY ANOTHER PERSON’S PERFORMANCE -BALL SHOULD COME FROM A MACHINE RATHER THAN A TENNIS SERVE BY A PERSON WHEN SKILL TESTING THE ABILITY TO RETURN A SERVE ENJOYABLE -INCREASES MOTIVATION TO DO WELL ON THE TEST, PARTICULARLY WHEN THE TEST IS WELL UNDERSTOOD -MAKE TEST INTERESTING, CHALLENGING, AND COMFORTABLE TO TAKE

STUDENT PARTICIPATION CONCERNS SAFETY -EXAMINE ALL ASPECTS OF THE TEST FOR SAFETY AND POSSIBLE RISKS OF INJURY CONFIDENTIALITY AND PRIVACY OF TESTING SHOULD BE PROTECTED -BE SENSITIVE TO THE ISSUE WHICH MAY REQUIRE TESTING PEOPLE ONE AT A TIME RATHER THAN IN A GROUP MOTIVATION TO SCORE AT MAXIMUM POTENTIALLY INCREASES THE RELIABILITY AND VALIDITY OF THE TESTS

ADMINISTRATIVE CONCERNS MASS TESTABILITY -REQUIRED FOR LARGER GROUPS -DECREASES TEST ADMINISTRATION TIME -SPLITTING GROUP IN HALF AND HAVING ONE HALF HELP TEST THE OTHER HALF AND VICE-VERSA MINIMAL PRACTICE -FAMILIARITY, EITHER FROM PREVIOUS TESTING, FROM THE PROGRAM OR CLASS, OR FROM PRACTICE SESSIONS PRIOR TO THE TESTING DAY WILL DECREASE BOTH EXPLANATION AND PRACTICE TIME

ADMINISTRATIVE CONCERNS MINIMAL EQUIPMENT AND PERSONNEL -TESTS THAT REQUIRE A LOT OF EQUIPMENT AND/OR ADMINISTRATIVE PERSONNEL ARE OFTEN IMPRACTICAL -INSUFFICIENT TRAINING OF ALL TEST ADMINISTRATORS CONTRIBUTES TO LACK OF TEST SCORE OBJECTIVITY EASE OF PREPARATION -SELECT TESTS THAT ARE EASY TO SET UP OVER ONES THAT TAKE MORE TIME

ADMINISTRATIVE CONCERNS ADEQUATE DIRECTIONS -SHOULD SPECIFY HOW THE TEST IS SET UP, THE PREPARATION OF INDIVIDUALS TO BE TESTED, AND ADMINISTRATION AND SCORING PROCEDURES NORMS -RECENT AND APPROPRIATE NORMS THAT ARE PROVIDED WITH OR FOR A TEST CAN SAVE THE TIME NECESSARY TO DEVELOP LOCAL NORMS; OR, AT LEAST SERVE AS TEMPORARY STANDARDS UNTIL LOCAL NORMS CAN BE DEVELOPED USEFUL SCORES -TEST SHOULD YIELD A USEFUL SCORE EXPRESSED IN A SINGLE UNIT OF MEASUREMENT THAT CAN BE INSERTED INTO A FORMULA WITH LITTLE EFFORT

ADMINISTRATION PRETEST PROCEDURES GIVING THE TEST POSTTEST PROCEDURES

PRETEST PROCEDURES KNOW THE TEST -CAREFULLY READ THE DIRECTIONS OR TEST MANUAL SEVERAL TIMES, THINKING ABOUT THE TEST AS YOU READ -AVOID OVERLOOKING SMALL DETAILS ABOUT PROCEDURES AS IT WILL LEAD TO MISTAKES DEVELOP TEST PROCEDURES -SELECT THE MOST EFFICIENT METHOD OF TESTING: GROUP VS. INDIVIDUAL TESTING; ONE PERSON TESTING, MULTIPLE TESTERS, OR TESTING INDIVIDUALS IN PAIRS -IDENTIFY EXACT SCORING REQUIREMENTS AND UNITS OF MEASUREMENT (PREFERABLY A SINGLE UNIT OF MEASUREMENT) -ANTICIPATE MISTAKES AND PLAN WHAT YOU WILL DO WHEN MISTAKES ARE MADE -CONSIDER ALL ASPECTS OF SAFETY -PRACTICE ADMINISTRATION OF THE TEST

PRETEST PROCEDURES DEVELOP DIRECTIONS -ADMINISTRATIVE PROCEDURES -INSTRUCTIONS ON PERFORMANCE -SCORING PROCEDURE AND THE POLICY ON INCORRECT PERFORMANCE -HINTS ON TECHNIQUES TO IMPROVE SCORES PREPARE THE STUDENTS OR PROGRAM PARTICIPANTS PSYCHOLOGICALLY AND PHYSIOLOGICALLY FOR TESTING -NOTIFY INDIVIDAULS ABOUT THE TESTING IN ADVANCE, WHAT THE TEST IS, AND WHAT THE TEST INVOLVES

PRETEST PROCEDURES PLAN THE WARM-UP AND TEST TRIALS -WARM-UP IMPROVES RELIABILITY -SHOULD BE PLANNED AND SPECIFIC TO THE SKILL BEING TESTED -SUPERVISED WARM-UP BY TESTER IS MOST EFFECTIVE -FIRST FEW TRAILS OF A MULTIPLE TRIAL TEST MAY SERVE AS A WARM-UP SECURE THE EQUIPMENT AND PREPARE THE TESTING FACILITY -ALL EQUIPMENT SHOULD BE ON HAND AND THE FACILITY PREPARED BEFORE THE DAY OF THE TEST -THIS SAVES TIME AND AVOIDS LAST MINUTE PROBLEMS

PRETEST PROCEDURES MAKE SCORING SHEETS -PREPARE GROUP OR INDIVIDUAL SCORECARDS -INDIVIDUAL SCORECARDS ARE BETTER WHEN A PERSON ROTATES AMONG TESTING STATIONS OR WHEN INDIVIDUALS ARE TESTING EACH OTHER ESTIMATE THE TIME NEEDED -MINIMIZES CONFUSION AND MAXIMIZES THE USE OF AVAILABLE TIME

GIVING THE TEST PREPARATION -WARM-UP OR PRACTICE -EXPLAIN THE TEST INSTRUCTIONS AND PROCEDURES -DEMONSTRATE THE TEST -LET THE PERSON COMPLETE A PRACTICE TRIAL OF THE TEST MOTIVATION -GIVE ALL PARTICIPANTS THE SAME DEGREE OF MOTIVATION AND ENCOURAGEMENT SAFETY -WATCH CLOSELY FOR ANY SAFETY PROBLEMS OR POTENTIAL INJURIES

POSTTEST PROCEDURES ANALYZE THE TEST SCORES -BUILD A DATA BASE -ENTER DATA INTO COMPUTER -COMPLETE STATISTICAL ANALYSIS -INTEPRET STATISTICAL ANALYSIS -REPORT TEST RESULTS TO THE PEOPLE TESTED IN A CONFIDENTIAL AND MOTIVATING MANNER RECORD KEEPING -KEEP SCORING SHEETS AND DATA ANALYSIS DOCUMENTS IN A SECURE AND CONFIDENTIAL FILE CABINET

CHALLENGES IN MEASURING INDIVIDUALS WITH DISABILITIES FINDING OR DEVELOPING A TEST OR BATTERY OF TESTS FOR EACH POSSIBLE COMBINATION OF DISABLING CONDITIONS FINDING NORM-REFERENCED AND/OR CRITERION- REFERENCED STANDARDS SHORTER ATTENTION SPAN AND PROBLEMS WITH COMPLICATED DIRECTIONS; BOTH OVER AND UNDER VERBALIZING CAN HINDER PERFORMANCE AND REDUCE RELIABILITY OFTEN DIFFICULT TO HAVE INDIVIDUALS TEST EACH OTHER IN PAIRS VAST HETEROGENEITY IN NEEDS AND PERFORMANCE LEVELS WIDE DIFFERENCES IN ABILITY FROM INDIVIDUALS WITHOUT DISABILITIES, MAKING THE RELIABILITY AND VALIDITY FOR COMMON TESTS QUESTIONABLE LACK OF EXPERIENCE WITH TEST PERFORMANCES THUS DECREASING THE RELIABILITY AND VALIDITY OF COMMON TESTS DIFFICULTY IN STAYING ON TASK AND GIVING MAXIMUM EXERTION BECAUSE THEY DO NOT UNDERSTAND WHY OR HOW TO GIVE IT, OR DO NOT UNDERSTAND THE TEST PROTOCOL

MEASURING INDIVIDUALS FROM DIFFERENT POPULATIONS ALL PEOPLE DO NOT RESPOND THE SAME WAY TO TESTING THE SAME TEST, TEST PROTOCOL, AND PERFORMANCE SCORE EXPECTATIONS CANNOT BE APPLIED TO ALL PEOPLE UNDERSTANDING THE CHARACTERISTCS OF THE PEOPLE IN THE POPULATION TESTED AND EXPERIENCE IN TESTING PEOPLE IN THE POPULATION IS VITAL TO OBTAINING TEST SCORES UPON WHICH YOU CAN BASE VALID INTERPRETATIONS

THAT ABOUT WINDS IT UP FOR LECTURE THIS WEEK FROM SAN JOSE STATE UNIVERSITY WHERE THE WOMEN ARE STRONG THE MEN ARE GOOD LOOKING ALL THE STUDENTS ARE ABOVE AVERAGE THE PROFESSORS ARE LONG WINDED

COMMENTS OR QUESTIONS?? THANK YOU!!