Political Science Scope and Methods Observation, Measurement, and Political Implications.

Slides:



Advertisements
Similar presentations
PhD Research Seminar Series: Valid Research Designs
Advertisements

Chapter 3 Introduction to Quantitative Research
Chapter 3 Introduction to Quantitative Research
REGRESSION, IV, MATCHING Treatment effect Boualem RABTA Center for World Food Studies (SOW-VU) Vrije Universiteit - Amsterdam.
Reliability and Validity
Measurement Reliability and Validity
Operationalizing Concepts Issues in operationally defining your concepts, validity, reliability and scales.
Reliability and Validity Dr. Roy Cole Department of Geography and Planning GVSU.
Validity, Sampling & Experimental Control Psych 231: Research Methods in Psychology.
Beginning the Research Design
MSc Applied Psychology PYM403 Research Methods Validity and Reliability in Research.
Epistemology and Methods Data Selection, Operationalization and Measurement May
Lecture 7 Psyc 300A. Measurement Operational definitions should accurately reflect underlying variables and constructs When scores are influenced by other.
Statistics Micro Mini Threats to Your Experiment!
Rules for Constructing Causal Theories King, Keohane and Verba
Measurement: Reliability and Validity For a measure to be useful, it must be both reliable and valid Reliable = consistent in producing the same results.
SOWK 6003 Social Work Research Week 5 Measurement By Dr. Paul Wong.
Psych 231: Research Methods in Psychology
Variables cont. Psych 231: Research Methods in Psychology.
Chapter 2 Research Process Part 1: Aug 29, Research Methods Importance of scientific method Research Process – develop ideas, refine ideas, test.
Validity, Reliability, & Sampling
Political Science Scope and Methods Case Studies, Comparing Cases, and Statistical Analysis.
Measurement Concepts & Interpretation. Scores on tests can be interpreted: By comparing a client to a peer in the norm group to determine how different.
The Practice of Social Research
Foundations of Sociological Inquiry
Designing Social Inquiry Understanding What to Avoid Jaechun Kim.
Political Science Scope and Methods Case Selection.
Measurement Neuman and Robson Ch. 6. What is it? The process of creating measurable concrete variables from abstract concepts Extends the senses (empirical)
Teaching Registrars Research Methods Variable definition and quality control of measurements Prof. Rodney Ehrlich.
Introduction In medicine, business, sports, science, and other fields, important decisions are based on statistical information drawn from samples. A sample.
The Scientific Method in Psychology.  Descriptive Studies: naturalistic observations; case studies. Individuals observed in their environment.  Correlational.
Measurement Cameron G. Thies University of Iowa. The Measurement Process What is measurement? – The process of assigning numbers or labels to units of.
Psychology 290 Lab #2 Sept. 26 – 28 Types & Parts of Articles Operational Definition Variables Reliability & Validity.
The Basics of Experimentation Ch7 – Reliability and Validity.
Tests and Measurements Intersession 2006.
Slides to accompany Weathington, Cunningham & Pittenger (2010), Chapter 3: The Foundations of Research 1.
Reliability vs. Validity.  Reliability  the consistency of your measurement, or the degree to which an instrument measures the same way each time it.
PowerPoint presentation to accompany Research Design Explained 6th edition ; ©2007 Mark Mitchell & Janina Jolley Chapter 10 The Simple Experiment.
Validity RMS – May 28, Measurement Reliability The extent to which a measurement gives results that are consistent.
Measurement. What is measurement? “the assignment of a value on a variable to a unit of measurement in accordance with an operational definition” (Kleinnijenhuis.
Copyright  2003 by Dr. Gallimore, Wright State University Department of Biomedical, Industrial Engineering & Human Factors Engineering Human Factors Research.
Experiment Basics: Variables Psych 231: Research Methods in Psychology.
1 Statistics in Research & Things to Consider for Your Proposal May 2, 2007.
Reliability, Validity, and Bias. Reliability Reliability Reliability is the extent to which an experiment, test, or any measuring procedure yields the.
Epistemology and Methods Data Selection, Operationalization, and Measurement May
Modeling Political Phenomena Using Control Variables and Gauging Validity.
Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.
Measurement Issues General steps –Determine concept –Decide best way to measure –What indicators are available –Select intermediate, alternate or indirect.
Political Science Scope and Methods Observation, Measurement, and Political Implications.
Political Science Scope and Methods Introduction to Research Design and The Experimental Method.
Evaluating VR Systems. Scenario You determine that while looking around virtual worlds is natural and well supported in VR, moving about them is a difficult.
Reliability and Validity Themes in Psychology. Reliability Reliability of measurement instrument: the extent to which it gives consistent measurements.
Measurement Experiment - effect of IV on DV. Independent Variable (2 or more levels) MANIPULATED a) situational - features in the environment b) task.
Review of Causal Analysis  Guidelines for Theory Building  The Structure of a Causal Argument (And Key Assumptions)  Common Problems with Operationalization.
Measuring Research Variables
Common Pitfalls in Randomized Evaluations Jenny C. Aker Tufts University.
Copyright (c) 2004 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 7 Inferences Concerning Means.
Measurement and Scaling Concepts
ESTABLISHING RELIABILITY AND VALIDITY OF RESEARCH TOOLS Prof. HCL Rawat Principal UCON,BFUHS Faridkot.
Rules for Constructing Causal Theories
Tests and Measurements: Reliability
Samples or groups for comparison
Political Science Scope and Methods
Political Science Scope and Methods
Types of Control I. Measurement Control II. Statistical Control
Reliability, Validity, and Bias
Political Science Scope and Methods
Experiment Basics: Variables
Introduction to Experimental Design
Rules for Constructing Causal Theories
Presentation transcript:

Political Science Scope and Methods Observation, Measurement, and Political Implications

Onto the Nuts and Bolts… This week: Measurement (part 1) Important Concepts  Operationalization  Reliability and Validity  Unbiasness and Efficiency Putnam Example

Measurement: An Introduction Steps in Measurement  Operational definition  Agreement?  Levels of measurement NominalzOrdinalzInterval

Reliability and Validity Reliability: Extent to which measurement procedure yields same result on repeated trials  Example: 2000 Presidential election Validity: How well the measure we use correspondents to the underlying concept  Face validity  Construct validity  Multiple measures – inter-item association

Unbiiasness and Effciency Unbiased Measure: estimate centered on the truth Efficient Measure: reducing the bound of uncertainty around a point estimate as much as possible

Threats to Unbasness and Effciency Measurement error  Non-random error  Random error In DV: increases uncertainty In IV: attenuates estimate of effect (but careful!) Omitted Variable Bias  If your IV of interested is correlated with another IV that is also correlated with your DV ⇒ Bias

Omitted Variable Bias: WWII Example Dislike Italian Immigrants Aid Engand in War Educaton + +-

Taking it too far… Can’t control for every omitted variable Control for important plausible alternative hypotheses Tradeoff with efficiency Bottom line: data is precious, use it wisely

Putnam Example 12 Indicators in 3 areas  Policy process  Policy pronouncements  Policy implantation Is Putnam the model?  Validity?  Reliability?