VALIDITY OF MEASUREMENT S P M V Subbarao Professor Mechanical Engineering Department Justification for Selection of Concepts to Hardware ?????

Slides:



Advertisements
Similar presentations
Scientific Method Method of scientific investigation Four MAJOR steps:
Advertisements

Issues of Reliability, Validity and Item Analysis in Classroom Assessment by Professor Stafford A. Griffith Jamaica Teachers Association Education Conference.
MEASUREMENT CONCEPTS © 2012 The McGraw-Hill Companies, Inc.
Reliability And Validity
VALIDITY AND RELIABILITY
Research Methodology Lecture No : 11 (Goodness Of Measures)
Part II Sigma Freud & Descriptive Statistics
Part II Sigma Freud & Descriptive Statistics
RESEARCH METHODS Lecture 18
Chapter 4 Validity.
MEASUREMENT. Measurement “If you can’t measure it, you can’t manage it.” Bob Donath, Consultant.
Beginning the Research Design
Lecture 7 Psyc 300A. Measurement Operational definitions should accurately reflect underlying variables and constructs When scores are influenced by other.
Scientific method - 1 Scientific method is a body of techniques for investigating phenomena and acquiring new knowledge, as well as for correcting and.
Principles of High Quality Assessment
Personality, 9e Jerry M. Burger
Understanding Validity for Teachers
VALIDITY. Validity is an important characteristic of a scientific instrument. The term validity denotes the scientific utility of a measuring instrument,
Conceptualization and Operationalization
Chapter 2 Finding Ideas to Research. Generating Topics Translate ideas into valid and reliable ways of measuring them Collect evidence Unique Topics Innovative.
Validity and Reliability
26 August 2015© Academic Conferences Limited, Validity, Reliability and Generalisability by Dr Dan Remenyi Visiting Professor School of Systems.
Slide 9-1 © 1999 South-Western Publishing McDaniel Gates Contemporary Marketing Research, 4e Understanding Measurement Carl McDaniel, Jr. Roger Gates Slides.
Measurement in Exercise and Sport Psychology Research EPHE 348.
Reliability and Validity what is measured and how well.
Instrumentation.
Psychometrics William P. Wattles, Ph.D. Francis Marion University.
THE SCIENTIFIC METHOD. What is Scientific Inquiry? SCIENCE  Science assumes the natural world is  Consistent  Predictable  Goals of science are 
The Nature of Science Mathematical Reasoning & Science.
Validity Is the Test Appropriate, Useful, and Meaningful?
URBDP 591 I Lecture 3: Research Process Objectives What are the major steps in the research process? What is an operational definition of variables? What.
6. Evaluation of measuring tools: validity Psychometrics. 2012/13. Group A (English)
Scientific Processes Mrs. Parnell. What is Science? The goal of science is to investigate and understand the natural world, to explain events in the natural.
< BackNext >PreviewMain Chapter 2 Data in Science Preview Section 1 Tools and Models in ScienceTools and Models in Science Section 2 Organizing Your DataOrganizing.
Measurement Validity.
WHAT IS THE NATURE OF SCIENCE?. SCIENTIFIC WORLD VIEW 1.The Universe Is Understandable. 2.The Universe Is a Vast Single System In Which the Basic Rules.
Validity Validity: A generic term used to define the degree to which the test measures what it claims to measure.
Evaluating Survey Items and Scales Bonnie L. Halpern-Felsher, Ph.D. Professor University of California, San Francisco.
Introduction to Science.  Science: a system of knowledge based on facts or principles  Science is observing, studying, and experimenting to find the.
Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.
The Theory of Sampling and Measurement. Sampling First step in implementing any research design is to create a sample. First step in implementing any.
MEASUREMENT. MeasurementThe assignment of numbers to observed phenomena according to certain rules. Rules of CorrespondenceDefines measurement in a given.
Validity and Item Analysis Chapter 4.  Concerns what instrument measures and how well it does so  Not something instrument “has” or “does not have”
Measurement Issues General steps –Determine concept –Decide best way to measure –What indicators are available –Select intermediate, alternate or indirect.
Measurement Experiment - effect of IV on DV. Independent Variable (2 or more levels) MANIPULATED a) situational - features in the environment b) task.
Chapter 6 - Standardized Measurement and Assessment
ERROR IN MEASUREMENTS P M V Subbarao Professor Mechanical Engineering Department How Truthful are Our Observations?
Scientific Method Making observations, doing experiments, and creating models or theories to try to explain your results or predict new answers form the.
Lesson 3 Measurement and Scaling. Case: “What is performance?” brandesign.co.za.
RELIABILITY AND VALIDITY Dr. Rehab F. Gwada. Control of Measurement Reliabilityvalidity.
Measurement and Scaling Concepts
Welcome to Review session for 2013 Exam is required for all students enrolled in Biology class as well as all 10 th graders enrolled in a biology class.
Ch. 5 Measurement Concepts.
Product Reliability Measuring
Reliability and Validity
Reliability and Validity in Research
Reliability & Validity
WHAT IS THE NATURE OF SCIENCE?
CHAPTER 5 MEASUREMENT CONCEPTS © 2007 The McGraw-Hill Companies, Inc.
Reliability & Validity
Introduction to Measurement
Human Resource Management By Dr. Debashish Sengupta
Week 3 Class Discussion.
پرسشنامه کارگاه.
Reliability and Validity of Measurement
VALIDITY Ceren Çınar.
RESEARCH METHODS Lecture 18
Evidence-Based Scientific Inquiry
Learning Targets for Introduction to Physics
Presentation transcript:

VALIDITY OF MEASUREMENT S P M V Subbarao Professor Mechanical Engineering Department Justification for Selection of Concepts to Hardware ?????

How To Measure Any Other Property? It is essential to invent a scientific principle, which connects the property to be measured and physical displacement/length/ Just a Real Number. One needs to identify/ develop hardware which can work as per the scientific principle. What is the guarantee that the hardware exactly works as per the principle? How to develop high degree of confidence in a measurement?

Validity of Measurement When we decide to study a variable, we need to devise some way to measure it. Some variables are easy to measure and others are very difficult. We try to develop the best measures we can whenever we are doing research. A good measuring instrument or test is one that is reliable and valid. Let us look at test validity first.

Test Validity Test Validity refers to the degree to which a measuring strategy (instrument, machine, or test) measures what is to be measured. This sounds obvious; right? A valid measure is the one that accurately measures the variable being studied. There are four/five ways to establish that your measure is valid: Content validity Construct validity Predictive validity Concurrent validity Convergent validity and/or Discriminant validity.

Content Validity Content validity is established if your measuring instrument samples from the areas of skill or knowledge that compose the variable. This assumes that you have a good detailed description of the domain, something that's not always true. More the number of valid theories/skills, more will be the number of measurement strategies. Consider measurement of temperature: Most popular valid theory for construction is ?

Coefficient of Thermal Expansion material CTE (ppm/°C) silicon3.2 alumina6–7 copper16.7 tin-lead solder27 E-glass54 S-glass16 epoxy resins15–100 silicone resins30–300 It is important to realise that: The CTE is often not the same in all axes (that is, not ‘isotropic’). The CTE is rarely linear. The variation in CTE with temperature is only a fairly smooth function if the material is undergoing no phase transitions.

Construct validity is the approximate truth of the conclusion that the measurement accurately reflects truth. The degree of translation of property to be measured into the measure. Construct validity is based on designing a measure that logically follows from a theory or hypothesis. Predictive validity, assesses the measurement's ability to predict something it should theoretically be able to predict. Concurrent validity, assesses the measurement's ability to distinguish between groups that it should theoretically be able to distinguish between. Refers to the ability of any measure to separate subjects who possess the attribute being studied from those who do not. Convergent validity assesses the degree to which the measurement is similar to (converges on) other measurements that it theoretically should be similar to. It is used when a valid measure exists for your variable but you want to design another measure that is perhaps easier to use or faster to take. Discriminant validity, examines the degree to which the measurement is not similar to (diverges from) other measurement that it theoretically should be not be similar to.

Ideas of Measurement Validation

Reliability Reliability is the consistency with which our measure measures. If you cannot get the same answer twice with your measure it is not reliable. A measuring strategy can be reliable and not valid, but if the instrument is not reliable it is also not valid. Measurement is never exact. At some point our measures always break down and errors creep into our data. This is when the concept of Error of Measurement becomes important. In order to be able to use any measure we need to know its error of measurement.

A good measuring strategy is reliable and, because it is reliable, it has a small amount of error in its observations. The First Law of Measurements