Multivariate Statistics Philosophical Considerations.

Slides:



Advertisements
Similar presentations
Copyright 2005, Prentice Hall, Sarafino
Advertisements

The meaning of Reliability and Validity in psychological research
Standardized Scales.
The Blind Men and the Elephant. Reading Long ago in India there lived five blind men. Even though they were blind, they knew much about the world, because.
Measurement Concepts Operational Definition: is the definition of a variable in terms of the actual procedures used by the researcher to measure and/or.
RAINBOW SPACE. READY FOR THE THREE AGREEMENTS? AGREEMENT 1: WE ARE ALL DIFFERENT! YOU.
1 Analyzing quantitative data. 2 Things aren’t always what we think! Six blind men go to observe an elephant. One feels the side and thinks the elephant.
Database Principles Conceptual Modeling. Database Principles What is a Conceptual Model? A mental model of the world around us Models necessarily mean.
THE ROLE OF MODELS IN THE CONVERGENCE OF SCIENTIFIC KNOWLEDGE Linda Weiser Friedman Zicklin School of Business, Baruch College and the Graduate Center.
Validity In our last class, we began to discuss some of the ways in which we can assess the quality of our measurements. We discussed the concept of reliability.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. Chapter 13 Experiments and Observational Studies.
RESEARCH METHODS Lecture 18
Chapter 4 Validity.
Common Factor Analysis “World View” of PC vs. CF Choosing between PC and CF PAF -- most common kind of CF Communality & Communality Estimation Common Factor.
The Methods of Social Psychology
Determining the # Of PCs Remembering the process Some cautionary comments Statistical approaches Mathematical approaches “Nontrivial factors” approaches.
Social Research Methods: Qualitative and Quantitative Approaches, 5e
University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Unit 6: Analyzing and interpreting data “There’s a world.
1 Evaluating Psychological Tests. 2 Psychological testing Suffers a credibility problem within the eyes of general public Two main problems –Tests used.
Philosophy of ICT and Islam Lecture 1: Philosophy of Science and Computing.
Measurement Concepts & Interpretation. Scores on tests can be interpreted: By comparing a client to a peer in the norm group to determine how different.
Experiments and Observational Studies.  A study at a high school in California compared academic performance of music students with that of non-music.
Scales and Indices While trying to capture the complexity of a phenomenon We try to seek multiple indicators, regardless of the methodology we use: Qualitative.
Essay Writing in Philosophy
Determining Sample Size
CIPD Foundation Level Certificate in Learning & Development Practice Delivering learning & development activities.
Copyright © 2010 Pearson Education, Inc. Chapter 13 Experiments and Observational Studies.
Experiments and Observational Studies. Observational Studies In an observational study, researchers don’t assign choices; they simply observe them. look.
Research Method Step 1 – Formulate research question Step 2 – Operationalize concepts ◦ Valid and reliable indicators Step 3 – Decide on sampling technique.
PSYCH 105 EXAM 3 JEOPARDY UNVEILING THE TRUTH BREAKING THROUGH THE BREAKTHROUGH MYTH BLUEPRINTS FOR CONSTRUCTING PSYCHOLOGY ADVANCED.
L643: Evaluation of Information Systems
MGTO 324 Recruitment and Selections Validity II (Criterion Validity) Kin Fai Ellick Wong Ph.D. Department of Management of Organizations Hong Kong University.
Slide 13-1 Copyright © 2004 Pearson Education, Inc.
1 Cronbach’s Alpha It is very common in psychological research to collect multiple measures of the same construct. For example, in a questionnaire designed.
Chapter 5 Building Assessment into Instruction Misti Foster
Cognitive Psychology: Thinking, Intelligence, and Language
Measurement Validity.
Evaluating the Experiment from the Inside: Internal Validity Taking a Broader Perspective: The Problem of External Validity Handling a Nonsignificant Outcome.
Chapter 2: Behavioral Variability and Research Variability and Research 1. Behavioral science involves the study of variability in behavior how and why.
Appraisal and Its Application to Counseling COUN 550 Saint Joseph College Ability, Intelligence, Aptitude and Achievement Testing For Class #12 Copyright.
Multivariate Analysis and Data Reduction. Multivariate Analysis Multivariate analysis tries to find patterns and relationships among multiple dependent.
Spring 2015 Kyle Stephenson
Chapter 7 Measuring of data Reliability of measuring instruments The reliability* of instrument is the consistency with which it measures the target attribute.
Chapter 14: Affective Assessment
Scales and Indices While trying to capture the complexity of a phenomenon We try to seek multiple indicators, regardless of the methodology we use: Qualitative.
RESEARCH METHODS IN INDUSTRIAL PSYCHOLOGY & ORGANIZATION Pertemuan Matakuliah: D Sosiologi dan Psikologi Industri Tahun: Sep-2009.
PSY 432: Personality Chapter 1: What is Personality?
Overview of Hinduism
How Psychologists Do Research Chapter 2. How Psychologists Do Research What makes psychological research scientific? Research Methods Descriptive studies.
Power of Concentration. No matter how long you sit with open eyes looking at the open book, hardly anything is registered in your brain unless you make.
Survey Design Class 02.  It is a true measure  Measurement Validity is the degree of fit between a construct and indicators of it.  It refers to how.
Educational Research Chapter 8. Tools of Research Scales and instruments – measure complex characteristics such as intelligence and achievement Scales.
Measurement Chapter 6. Measuring Variables Measurement Classifying units of analysis by categories to represent variable concepts.
Choosing and using your statistic. Steps of hypothesis testing 1. Establish the null hypothesis, H 0. 2.Establish the alternate hypothesis: H 1. 3.Decide.
Intro. To Psychology Intro. Unit Mr. Stalnaker. Psychology What is Psychology? Psychology is old as a study but young, vigorous, and growing as an organized.
The Study of Psychology. What to expect? Social sciences –Explore influences of society on individual behavior and group relationships Natural sciences.
1 Analyzing quantitative data. 2 Things aren’t always what we think! Six blind men go to observe an elephant. One feels the side and thinks the elephant.
Multivariate Analysis - Introduction. What is Multivariate Analysis? The expression multivariate analysis is used to describe analyses of data that have.
Building Capacity in Evaluating Outcomes Unit 6: Analyzing and interpreting data 1 “There’s a world of difference between truth and facts. Facts can obscure.
Survey Methodology Reliability and Validity
Multivariate Analysis - Introduction
Test Validity.
Understanding Results
Journalism 614: Reliability and Validity
Week 3 Class Discussion.
پرسشنامه کارگاه.
RESEARCH METHODS Lecture 18
Design Considerations: Independent Samples v. Repeated Measures
Assessing Students with Special Needs
Unit 6: Analyzing and interpreting data
Presentation transcript:

Multivariate Statistics Philosophical Considerations

Psychological Constructs Important psychological constructs are complex and difficult to measure. –Can’t use a single number to adequately represent such concepts as: Personality Parenting style Management style Adjustment Even IQ is not really adequately represented by a single number

Operational Definitions We operationally define these constructs to permit scientific study. Operational Definition: The meaning of a variable is specified in terms of the operations necessary to measure it in any concrete situation, or in terms of the experimental methods involved in its determination

Examples of Operational Definitions For research purposes we can define parenting style by using a parenting styles questionnaire. The persons parenting style is given by their scores on the scales or subscales. We can define management style by using a management styles inventory.

Problems There may be several different questionnaires available to assess a psychological construct. Different measures give different results Use different subscales and different dimensions Which is right? Frequently, when two research studies disagree on the results, it is because they have used different definitions. Source of disagreement in science.

Questions Which operational definition is right? Which operational definition is best? Is the operational definition the problem or is our idea of the concept wrong? Can we do better?

Metaphysics It is impossible get a perfect measure of important and meaningful psychological constructs. Due to complexity Due to limitations in –Human intelligence and cognitive capacity –Technology

The Parable of the Blind Men and the Elephant Three blind men come across an elephant. They decide to feel the elephant to determine what sort of creature it is. One blind man feels the back leg of the elephant. He says, "An elephant is like a tree." The second blind man feels the trunk. He says, "An elephant is like a snake." The third blind man feels the tail. He says, "An elephant is like a rope." The three blind men argue a long time about what an elephant is and based on their own personal experience each is right.

Metaphysically Psychology is a unique discipline from a philosophical point of view. Here we have a creature trying to understand itself. In many ways it is like the blind men and the elephant

Bracketing One of the best approaches to understanding complex concepts is to use bracketing Bracketing involves setting boundaries on a construct. We may not know for sure what it is but we are pretty sure it is between these two limits.

Bracketing This provides greater accuracy than using a single best guess to represent the construct. We try to refine our estimates by making our brackets narrower and narrower. We try to trap the construct between our limits. Science is like building a fence around the construct and then moving the fence in until we can get close enough to it to understand and control it.

Bracket Example Evaluating two individuals ability to use positive discipline (to make a hiring decision). Report says: –Person A is in the good to very good range –Person B is in the average to good range Hire A

Multiple Convergent Measures For the blind men and the elephant, the report of all three provided a better and more complete understanding of the elephant than any one report alone. Even though their reports appeared contradictory and impossible to reconcile. If the blind men continue to examine different aspects of the elephant and combine their knowledge they may well come up with a pretty good understanding of what an elephant is like.

Multiple Convergent Measures Similarly, the best understanding of complex psychological constructs and processes will develop from approaches that use multiple measurement, assessment, and evaluation techniques to look at the same construct. Multiple convergent measures

Approach The approach is to use multiple convergent measures to bracket complex psychological constructs and processes.

Multivariate Statistical Methods Multivariate statistical methods permit us to use multiple convergent measures to bracket complex constructs.