BASIC TERMINOLOGY n Test n Measurement n Evaluation.

Slides:



Advertisements
Similar presentations
Critical Reading Strategies: Overview of Research Process
Advertisements

L2 program design Content, structure, evaluation.
Psychlotron.org.uk Why is it important that psychological research be valid and reliable?
Start your learning and revising now J Griffiths for NGfL Cymru.
Psychometrics William P. Wattles, Ph.D. Francis Marion University.
MEQ Analysis. Outline Validity Validity Reliability Reliability Difficulty Index Difficulty Index Power of Discrimination Power of Discrimination.
General Information --- What is the purpose of the test? For what population is the designed? Is this population relevant to the people who will take your.
Issues of Technical Adequacy in Measuring Student Growth for Educator Effectiveness Stanley Rabinowitz, Ph.D. Director, Assessment & Standards Development.
Introduction to Measurement and Evaluation
RELIABILITY & VALIDITY
Definition & Measurement “measurement is the beginning of science, … until you can measure something, your knowledge is meager and unsatisfactory” Lord.
Reliability n Consistent n Dependable n Replicable n Stable.
Lesson Eight Standardized Test. Contents Components of a Standardized test Reasons for the Name “Standardized” Reasons for Using a Standardized Test Scaling.
Introduction to Assessment Basic Terms and Concepts.
Lecture 7 Psyc 300A. Measurement Operational definitions should accurately reflect underlying variables and constructs When scores are influenced by other.
Measurement: Reliability and Validity For a measure to be useful, it must be both reliable and valid Reliable = consistent in producing the same results.
CHE 315 – Lecture 1 8/29/05 Introduction. Syllabus highlights.
Lesson Thirteen Standardized Test. Yuan 2 Contents Components of a Standardized test Reasons for the Name “Standardized” Reasons for Using a Standardized.
Introduction to Measurement and Evaluation
Using statistics in small-scale language education research Jean Turner © Taylor & Francis 2014.
Measurement Concepts & Interpretation. Scores on tests can be interpreted: By comparing a client to a peer in the norm group to determine how different.
Research Methods for Computer Science CSCI 6620 Spring 2014 Dr. Pettey CSCI 6620 Spring 2014 Dr. Pettey.
Collecting Quantitative Data Creswell Chapter 6. Who Will You Study? Identify unit of analysis Specify population Describe sampling approach  Class =
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Emily H. Wughalter, Ed.D. Measurement & Evaluation Spring 2010.
SELECTION OF MEASUREMENT INSTRUMENTS Ê Administer a standardized instrument Ë Administer a self developed instrument Ì Record naturally available data.
Unanswered Questions in Typical Literature Review 1. Thoroughness – How thorough was the literature search? – Did it include a computer search and a hand.
LECTURE 06B BEGINS HERE THIS IS WHERE MATERIAL FOR EXAM 3 BEGINS.
I Can Distinguish the types of validity Distinguish the types of reliability Identify if an example is objective or subjective Copyright © Allyn & Bacon.
Final Study Guide Research Design. Experimental Research.
WELNS 670: Wellness Research Design Chapter 5: Planning Your Research Design.
Instrumentation (cont.) February 28 Note: Measurement Plan Due Next Week.
Psychology 290 Lab #2 Sept. 26 – 28 Types & Parts of Articles Operational Definition Variables Reliability & Validity.
General Information Iowa Writing Assessment The Riverside Publishing Company, 1994 $39.00: 25 test booklets, 25 response sheets 40 minutes to plan, write.
Chapter 4: Test administration. z scores Standard score expressed in terms of standard deviation units which indicates distance raw score is from mean.
Chapter Five Measurement Concepts. Terms Reliability True Score Measurement Error.
EDU 8603 Day 6. What do the following numbers mean?
Reliability vs. Validity.  Reliability  the consistency of your measurement, or the degree to which an instrument measures the same way each time it.
Introduction Gathering Information Observation Interviewing Norm Referenced Tools Authentic Assessment Characteristics of Authentic Assessment – 7M’s Validity.
Research in Communicative Disorders1 Research Design & Measurement Considerations (chap 3) Group Research Design Single Subject Design External Validity.
Advanced Research Methods Unit 3 Reliability and Validity.
Psychometrics & Validation Psychometrics & Measurement Validity Properties of a “good measure” –Standardization –Reliability –Validity A Taxonomy of Item.
A ssessment & E valuation. Assessment Answers questions related to individuals, “What did the student learn?” Uses tests and other activities to determine.
Designs and Reliability Assessing Student Learning Section 4.2.
Copyright © Allyn & Bacon 2008 Intelligent Consumer Chapter 14 This multimedia product and its contents are protected under copyright law. The following.
Reliability: The degree to which a measurement can be successfully repeated.
Reliability and Validity Themes in Psychology. Reliability Reliability of measurement instrument: the extent to which it gives consistent measurements.
Reliability and Validity in Testing. What is Reliability? Consistency Accuracy There is a value related to reliability that ranges from -1 to 1.
Validity & Reliability. OBJECTIVES Define validity and reliability Understand the purpose for needing valid and reliable measures Know the most utilized.
RELIABILITY BY DONNA MARGARET. WHAT IS RELIABILITY?  Does this test consistently measure what it’s supposed to measure?  The more similar the scores,
Michigan Assessment Consortium Common Assessment Development Series Module 16 – Validity.
Literacy Assessments Pamela Chapin. Items to be Covered Introductions Need and purpose of assessments Assessment types Validity and Reliability Testing.
Dr. Jeffrey Oescher 27 January 2014 Technical Issues  Two technical issues  Validity  Reliability.
WHS AP Psychology Unit 7: Intelligence (Cognition) Essential Task 7-3:Explain how psychologists design tests, including standardization strategies and.
Lesson Thirteen Standardized Test. Contents Components of a Standardized test Reasons for the Name “Standardized” Reasons for Using a Standardized Test.
ESTABLISHING RELIABILITY AND VALIDITY OF RESEARCH TOOLS Prof. HCL Rawat Principal UCON,BFUHS Faridkot.
HCS 465 Week 3 Individual Applying the Results and Conclusion of the Research Process to Problems in Health Care To purchase this material click below.
Principles of Language Assessment
Take-Home Message: Principles Unique to Alternate Assessments
Research Methods for Computer Science
Lecture 5 Validity and Reliability
CHAPTER 3: Practical Measurement Concepts
Test Design & Construction
Tests and Measurements: Reliability
Principles of Assessment & Criteria of good assessment
Lesson 1 Foundations of measurement in Psychology
Reliability.
Understanding and Using Standardized Tests
Measurement Concepts and scale evaluation
Reliability and validity
Presentation transcript:

BASIC TERMINOLOGY n Test n Measurement n Evaluation

TEST n Laboratory Test n Field Test

MEASUREMENT n Objective Measurement n Subjective Measurement n Quantitative Measurement n Qualitative Measurement

EVALUATION n Formative Evaluation n Summative Evaluation STANDARDS OF EVALUATION n Criteria Referenced Standard n Norm Referenced Standard

PSYCHOMETRIC QUALITIES OF TESTS n Validity *Does it measure what it is supposed to measure n Reliability *Repeatable, consistent result n Objectivity *Reliability of test administrator

VALIDITY n Face Validity n Content Validity n Construct Validity n Concurrent Validity n Predictive Validity

RELIABILITY n Test-Retest Reliability n Alternate Form Reliability n Split Half (Odd-Even) Reliability

OBJECTIVITY n Interjudge n Intrajudge

TEST ADMINISTRATION n Material/Equipment n Type Of Testing Area n Arranging Testing Area n Knowledge Of Test n Recording Of Scores (group list vs. individual card)

Test Administration (cont.) n Practicing Test n Warm-Up Before Test n Consistent Instructions n Evaluating Results

FINAL RESEARCH PROJECT n Introduction and Research Problem n Review of Literature n Testing Procedures and Methods n Analysis of Data n Summary, Conclusions, Interpretations n Power Point Presentation