Measurement Characteristics of Client Assessment

Slides:



Advertisements
Similar presentations
Standardized Scales.
Advertisements

Measurement Concepts Operational Definition: is the definition of a variable in terms of the actual procedures used by the researcher to measure and/or.
L2 program design Content, structure, evaluation.
Topics: Quality of Measurements
Assessment Procedures for Counselors and Helping Professionals, 7e © 2010 Pearson Education, Inc. All rights reserved. Chapter 5 Reliability.
VALIDITY AND RELIABILITY
Psychological Testing Principle Types of Psychological Tests  Mental ability tests Intelligence – general Aptitude – specific  Personality scales Measure.
Reliability - The extent to which a test or instrument gives consistent measurement - The strength of the relation between observed scores and true scores.
Part II Sigma Freud & Descriptive Statistics
What is a Good Test Validity: Does test measure what it is supposed to measure? Reliability: Are the results consistent? Objectivity: Can two or more.
MGT-491 QUANTITATIVE ANALYSIS AND RESEARCH FOR MANAGEMENT
Chapter 4A Validity and Test Development. Basic Concepts of Validity Validity must be built into the test from the outset rather than being limited to.
RESEARCH METHODS Lecture 18
Reliability and Validity
FOUNDATIONS OF NURSING RESEARCH Sixth Edition CHAPTER Copyright ©2012 by Pearson Education, Inc. All rights reserved. Foundations of Nursing Research,
Reliability & Validity the Bada & Bing of YOUR tailored survey design.
Chapter 9 Flashcards. measurement method that uses uniform procedures to collect, score, interpret, and report numerical results; usually has norms and.
INTELLIGENCE AND PSYCHOLOGICAL TESTING. KEY CONCEPTS IN PSYCHOLOGICAL TESTING Psychological test: a standardized measure of a sample of a person’s behavior.
Classroom Assessment A Practical Guide for Educators by Craig A
Collecting Quantitative Data
Collecting Quantitative Data Creswell Chapter 6. Who Will You Study? Identify unit of analysis Specify population Describe sampling approach  Class =
Reliability and Validity what is measured and how well.
MEASUREMENT CHARACTERISTICS Error & Confidence Reliability, Validity, & Usability.
Induction to assessing student learning Mr. Howard Sou Session 2 August 2014 Federation for Self-financing Tertiary Education 1.
Standardization and Test Development Nisrin Alqatarneh MSc. Occupational therapy.
Reliability & Validity
Validity Is the Test Appropriate, Useful, and Meaningful?
Assessing Learners with Special Needs: An Applied Approach, 6e © 2009 Pearson Education, Inc. All rights reserved. Chapter 4:Reliability and Validity.
Chapter 7 Instrumentation. Empirical Data We need DATA We can’t rely solely upon our senses We develop INSTRUMENTS to compensate for the limitations of.
Measurement Validity.
Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.
Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Assessing Measurement Quality in Quantitative Studies.
MEASUREMENT. MeasurementThe assignment of numbers to observed phenomena according to certain rules. Rules of CorrespondenceDefines measurement in a given.
Validity Validity is an overall evaluation that supports the intended interpretations, use, in consequences of the obtained scores. (McMillan 17)
Measurement MANA 4328 Dr. Jeanne Michalski
1 Announcement Movie topics up a couple of days –Discuss Chapter 4 on Feb. 4 th –[ch.3 is on central tendency: mean, median, mode]
Classroom Assessment Chapters 4 and 5 ELED 4050 Summer 2007.
Educational Research Chapter 8. Tools of Research Scales and instruments – measure complex characteristics such as intelligence and achievement Scales.
©2013, The McGraw-Hill Companies, Inc. All Rights Reserved Chapter 5 What is a Good Test?
5. Evaluation of measuring tools: reliability Psychometrics. 2011/12. Group A (English)
Copyright © Springer Publishing Company, LLC. All Rights Reserved. DEVELOPING AND USING TESTS – Chapter 11 –
Measurement and Scaling Concepts
ESTABLISHING RELIABILITY AND VALIDITY OF RESEARCH TOOLS Prof. HCL Rawat Principal UCON,BFUHS Faridkot.
Survey Methodology Reliability and Validity
Lecture 5 Validity and Reliability
Ch. 15 S. 1 What Are Psychological Tests?
Assessment and Evaluation
Questions What are the sources of error in measurement?
Assessment Theory and Models Part II
Assessment Theory and Models Part I
Tests and Measurements: Reliability
Critique and Evaluation
Reliability & Validity
Introduction to Client Assessment
Week 3 Class Discussion.
پرسشنامه کارگاه.
Competencies and Outcomes in Therapeutic Recreation Chapter 1
Concepts in Tests and Measurements
Therapeutic Recreation Program Considerations
Analyzing Reliability and Validity in Outcomes Assessment Part 1
Principles of Assessment & Criteria of good assessment
PSY 614 Instructor: Emily Bullock, Ph.D.
RESEARCH METHODS Lecture 18
Chapter 4 Characteristics of a Good Test
The first test of validity
Methodology Week 5.
Measurement Concepts and scale evaluation
TESTING AND EVALUATION IN EDUCATION GA 3113 lecture 1
EDUC 2130 Quiz #10 W. Huitt.
Chapter 3: How Standardized Test….
Presentation transcript:

Measurement Characteristics of Client Assessment HPR 451 Chapter 2

Measurement??? Error and confidence are at the heart of assessment They underlie the concepts of Validity Reliability Fairness Usability All measurements have error. Object is to reduce the error….

Error Scores should change roughly the same amount as the client’s attitude or skill. If not, there is variance caused by unintentional or random error. Lots of things can cause variance – any condition irrelevant to the purpose of the assessment CTRS should make every effort to reduce error to obtain true score – Be confident in tool and follow protocol

Measurement Terminology Assessment instruments are measurement tools Measures attitudes, skills, abilities, knowledge, interests Norm-referenced - Compared with scores in a group Criterion-referenced–Compared with preset standard Validity – The extent to which it meets its intended purpose Content validity – How well does it measure subject matter? (i.e. Knowledge of leisure resources) Criterion-related validity – the extent to which test performance relates to another valued measure of performance (i.e. ACT, SAT)

Measurement Terminology cont’d Construct validity – measuring unobservable traits (i.e. self-esteem, anxiety, locus of control, depression, extroversion, intelligence) Most TR assessments measure behaviors and not constructs Reliability – Estimate of the consistency of measurement Stability - How stable is the instrument over time? Equivalency - How closely related are two or more forms of the same assessment? Internal consistency - How closely are items on the assessment related?

Practicality and Usability Is it doable? (time, expertise, cost) Does it serve the purpose for which it was intended better than other assessments?

Determine the Purpose Define the Domain Client info (baseline, formative, summative) Research Communication Administrative Define the Domain Leisure Ability Model – Functional Intervention, Leisure Education, Recreation Participation – See Social Skills General Outcome example on pg 60