Can Fast and Slow Intelligence Be Differentiated? 8.4.2013.

Slides:



Advertisements
Similar presentations
Agenda Levels of measurement Measurement reliability Measurement validity Some examples Need for Cognition Horn-honking.
Advertisements

Item Response Theory in a Multi-level Framework Saralyn Miller Meg Oliphint EDU 7309.
Emotional Intelligence predicts individual differences in social exchange reasoning D. Reis, M. Brackett, N. Shamosh, K. Kiehl, P. Salovey & J. Gray.
Chapter Eight & Chapter Nine
Consistency in testing
Survey Methodology Reliability and Validity EPID 626 Lecture 12.
Chapter 4 – Reliability Observed Scores and True Scores Error
Part II Sigma Freud & Descriptive Statistics
Overview of field trial analysis procedures National Research Coordinators Meeting Windsor, June 2008.
What determines student satisfaction with university subjects? A choice-based approach Twan Huybers, Jordan Louviere and Towhidul Islam Seminar, Institute.
The art and science of measuring people l Reliability l Validity l Operationalizing.
When Measurement Models and Factor Models Conflict: Maximizing Internal Consistency James M. Graham, Ph.D. Western Washington University ABSTRACT: The.
Explanatory Secondary Dimension Modeling of Latent Different Item Functioning Paul De Boeck, Sun-Joo Cho, and Mark Wilson.
Winnie mucherah ball state university FOUNDATIONS OF QUALITY RESEARCH DESIGN: RELIABILITY & VALIDITY.
Intelligence. What is intelligence? Critique of intelligence tests by Boring (’23): “intelligence is what these tests measure” Who should have high intelligence?
Measurement Joseph Stevens, Ph.D. ©  Measurement Process of assigning quantitative or qualitative descriptions to some attribute Operational Definitions.
The Nature of Science Experimental Investigations.
Measurement, Control, and Stability of Multiple Response Styles Using Reverse Coded Items Eric Tomlinson Daniel Bolt University of Wisconsin-Madison Ideas.
Reliability and factorial structure of a Portuguese version of the Children’s Hope Scale José Tomás da Silva Maria Paula Paixão Catarina Carvalho dos Santos.
Experimental Research
Cluster Analysis Forming Groups within the Sample of Respondents.
Unanswered Questions in Typical Literature Review 1. Thoroughness – How thorough was the literature search? – Did it include a computer search and a hand.
Qualitative and Quantitative Research Quantitative Deductive: transforms general theory into hypothesis suitable for testing Deductive: transforms general.
SCIENTIFIC METHOD Scientific Method Developed by Galan in 2nd Century A.D. Series of steps followed by scientists to solve problems.
SCIENTIFIC METHOD By Dawn M. Thompson Scientific Method Developed by Galan in 2nd Century A.D. Developed by Galan in 2nd Century A.D. Series of steps.
INTRODUCTION. Scientific Method – What are the steps? 1. Pose a question (the problem) 2. Develop a hypothesis A testable prediction 3. Test the hypothesis.
Research Methods for Business 1 Chapter 16 Qualitative Data Analysis © 2012 John Wiley & Sons Ltd.
Validity and Item Analysis Chapter 4.  Concerns what instrument measures and how well it does so  Not something instrument “has” or “does not have”
Introduction to Physical Science--Vocabulary. Experiment.
How much power and speed is measured in this test? 31/10/2012.
SECOND EDITION Chapter 5 Standardized Measurement and Assessment
Chapter 6 - Standardized Measurement and Assessment
Reliability a measure is reliable if it gives the same information every time it is used. reliability is assessed by a number – typically a correlation.
2. Main Test Theories: The Classical Test Theory (CTT) Psychometrics. 2011/12. Group A (English)
+ EXPERIMENTAL INVESTIGATIONS An experimental investigation is one in which a control is identified. The variables are measured in an effort to gather.
The Reliability of Crowdsourcing: Latent Trait Modeling with Mechanical Turk Matt Baucum, Steven V. Rouse, Cindy Miller-Perrin, Elizabeth Mancuso Pepperdine.
Lesson 3 Measurement and Scaling. Case: “What is performance?” brandesign.co.za.
FACTOR ANALYSIS & SPSS. First, let’s check the reliability of the scale Go to Analyze, Scale and Reliability analysis.
Research Methods & Design Outline
WHS AP Psychology Unit 7: Intelligence (Cognition) Essential Task 7-3:Explain how psychologists design tests, including standardization strategies and.
Chapter 2 Norms and Reliability. The essential objective of test standardization is to determine the distribution of raw scores in the norm group so that.
Assessing Intelligence. Test Construction Standardization – defining the meaning of scores by comparing to a pretested “standard group”. Reliability –
1 Measurement Error All systematic effects acting to bias recorded results: -- Unclear Questions -- Ambiguous Questions -- Unclear Instructions -- Socially-acceptable.
Introduction to Survey Research
Survey Methodology Reliability and Validity
FACTOR ANALYSIS & SPSS.
1University of Oklahoma 2Shaker Consulting
Unit 8: Intelligence (Cognition)
Assessing Intelligence
Introduction Intro Problem Materials Hypothesis Procedure Results
UCMAS: A cognition tool
Chapter 2 Personality Research Methods
Classical Test Theory Margaret Wu.
Journalism 614: Reliability and Validity
Assessing the efficacy of fluency training in relating relations for increasing performance on general cognitive ability Shane McLoughlin Ian Tyndall Antonina.
Making Sense of Advanced Statistical Procedures in Research Articles
Reliability and Validity of Measurement
הערכת משתנים שאינם קוגניטיביים במרכז הערכה למיון מועמדים לרפואה
Volume 23, Issue 16, Pages R673-R676 (August 2013)
saklviTüal½y esAs_GuIsf_eGyeso UNIVERSITY OF SOUTH-EAST ASIA
Reliability.
By ____________________
01- Introduction Introduction.
Stratified Sampling for Data Mining on the Deep Web
RFID Portal Test Rfscl Laboratory UNL.
David Z. Hambrick, Michael J.Kane, and Randall W.Engle
Week 1 Vocab Definitions
Ass. Prof. Dr. Mogeeb Mosleh
Genetic Evaluation of Milking Speed for Brown Swiss Dairy Cattle
Advisor: Dr.vahidipour Zahra salimian Shaghayegh jalali Dec 2017
Presentation transcript:

Can Fast and Slow Intelligence Be Differentiated?

1. Introduction  A popular present-day approach is to look for pure measures of speed and power external to the test  Speed and power are different but positively correlated.  Slow responses are of a different nature than fast responses.  Fast responses are based on more automatic direct-link mediated processing while slow responses are based on repeating one's cognitive work and/or more controlled processing.  An interest in internal to the test

1.1 Fast and slow intelligence  Different processes?  Or different abilities?  Qualitative process differences can be inferred from the across-item pattern of difficulties, and qualitative ability differences from the across-person pattern of the latent trait values.

1.2 Aim of the study  Time-homogeneity vs. time heterogeneity  Processes  Abilities  Via two tasks: verbal analogy and matrices

1.3 Distinguishing between fast and slow responses  Within-person split  For each person, a fast and a slow subset of items is determined.  Within-item split  For each item, a fast and a slow subset of persons in determined.

2.1 Model

2.2 Hypothesis testing  3P&3I vs 2P&3I, 3P&2I, and 2P&2I  AIC & BIC  3P&3I vs 3P&2I  LR test  3P&3I vs 2P&3I  Mixture  2 test  When using the data derived from the within-item split…

2.3 Intelligence tests 2.4 Data sets  Verbal analogies test  726 persons & 34 items  Raven-like matrices test  503 persons & 35 items

3.1 Description of the data  Response frequencies in two approaches  Persons may differ more in their response times than items do.  Cronbach alpha: Fast responses were more reliable than the slow responses.

3.2 Model comparison

 Correlations between the two accuracy (  2 &  3 )  Because the difficulties are fixed effects, no such correlations are available.  Estimated variances are larger for fast than slow 3.3 Correlations and variances

3.4 Additional analysis 3.5 Speed and accuracy within-item splitwithin-person split gg  ’ 2 gg  ’ 2 1 1 gg.767 gg.661 within-item splitwithin-person split gg  ’ 2 gg  ’ 2 1 1 gg.646 gg.590

4. Discussion and conclusion  Fast and slow intelligence can be differentiated, and they are strongly correlated.  Fast responses differentiate better than slow responses between persons as well as items.  A somewhat different kind of ability is measured for respondents with primarily slow responses compared to the ability that is measured for respondents with primarily fast responses.  Given the higher variance of fast intelligence compared to slow intelligence, the ability of fast respondents is measured in a more reliable way than the ability of slow respondents.  Time pressure