The (im)possibility of separating age, period and cohort effects Andrew Bell School of Geographical Sciences NCRM Research Methods.

Slides:



Advertisements
Similar presentations
Correlational and Differential Research
Advertisements

Random effects as latent variables: SEM for repeated measures data Dr Patrick Sturgis University of Surrey.
SC968: Panel Data Methods for Sociologists Random coefficients models.
HSRP 734: Advanced Statistical Methods July 24, 2008.
Happiness, Lottery Winners, and Your Heart Andrew Oswald Warwick University * Much of this work is joint with coauthor Nick Powdthavee. I also owe a great.
The Importance of Detail: Sensitivity of Household Secondary Attack Rate and Intervention Efficacy to Household Contact Structure A. Marathe, B. Lewis,
MODELLING REPEATED MEASURES ON FAMILY MEMBERS IN GEOGRAPHICAL AREAS IAN PLEWIS UNIVERSITY OF MANCHESTER PRESENTATION TO RESEARCH METHODS FESTIVAL OXFORD,
OCTOBER 13, 2010 SCHOOL OF EDUCATION RESEARCH SEMINAR SERIES Natasha K. Bowen UNC School of Social Work Too Good to Be True: Can a Brief Writing Intervention.
1 Module II Lecture 3: Misspecification: Non-linearities Graduate School Quantitative Research Methods Gwilym Pryce.
School of Veterinary Medicine and Science Multilevel modelling Chris Hudson.
Why Program? CSE111 – Great ideas in Computer Science Clearly programming fits here Programming is a Great Idea in Computer Science. It has allowed computers.
Validity, Sampling & Experimental Control Psych 231: Research Methods in Psychology.
Validity, Sampling & Experimental Control Psych 231: Research Methods in Psychology.
Longitudinal Experiments Larry V. Hedges Northwestern University Prepared for the IES Summer Research Training Institute July 28, 2010.
Non-Experimental designs: Developmental designs & Small-N designs
Age and the Social Stratification of Long-Term Trajectories of Physical Activity ACKNOWLEDGEMENTS This research was supported by the grant R01 AG
© 2005 The McGraw-Hill Companies, Inc., All Rights Reserved. Chapter 4 Choosing a Research Design.
Non-Experimental designs
EXPERIMENTS AND OBSERVATIONAL STUDIES Chance Hofmann and Nick Quigley
Foster Care Reunification: The use of hierarchical modeling to account for sibling and county correlation Emily Putnam-Hornstein, MSW Center for Social.
Is there such a thing as conscious will?. What is “conscious will”?! Having “free will” or “conscious will” basically means being in control of one’s.
Experiments and Observational Studies.  A study at a high school in California compared academic performance of music students with that of non-music.
PEPA is based at the IFS and CEMMAP © Institute for Fiscal Studies Identifying social effects from policy experiments Arun Advani (UCL & IFS) and Bansi.
Issues in Experimental Design Reliability and ‘Error’
McGraw-Hill/Irwin Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. Choosing a Research Design.
Gaussian process modelling
 Healthcare workers must work with and provide care to a variety of people  YOU must be aware of factors that cause each individual to be unique 
1 POPULATION PROJECTIONS Session 8 - Projections for sub- national and sectoral populations Ben Jarabi Population Studies & Research Institute University.
Causal inferences During the last two lectures we have been discussing ways to make inferences about the causal relationships between variables. One of.
Chapter 1: Scientists’ Tools. Chemistry is an Experimental Science Common characteristics Although no one method, there are Careful observation s Accurate.
Questions From Reading Activity? Big Idea(s):  The interactions of an object with other objects can be described by forces.  Interactions between.
Biostatistics Case Studies 2008 Peter D. Christenson Biostatistician Session 5: Choices for Longitudinal Data Analysis.
Human Happiness and the Midlife ‘Crisis’ Andrew Oswald University of Warwick, UK I would like to acknowledge that much of this work is joint with coauthors.
CHAPTER 9: Producing Data: Experiments. Chapter 9 Concepts 2  Observation vs. Experiment  Subjects, Factors, Treatments  How to Experiment Badly 
Persuasive Writing. Paragraph 1: Introduction What makes an effective introduction? It grabs the reader’s attention. It clearly implies an organizational.
“Teach A Level Maths” Vol. 1: AS Core Modules
Introduction to Cohort Analysis PRI SUMMER METHODS WORKSHOP June 16, 2008 Glenn Firebaugh.
28. Multiple regression The Practice of Statistics in the Life Sciences Second Edition.
Demographic Transition Model Highlight Color: RED.
Scientific Debugging. Errors in Software Errors are unexpected behaviors or outputs in programs As long as software is developed by humans, it will contain.
Quadratic Regression ©2005 Dr. B. C. Paul. Fitting Second Order Effects Can also use least square error formulation to fit an equation of the form Math.
Chapter 5 Multilevel Models
MENTAL HEALTH: Personality Development Ms. Mai Lawndale High School.
CHAPTER 9: Producing Data Experiments ESSENTIAL STATISTICS Second Edition David S. Moore, William I. Notz, and Michael A. Fligner Lecture Presentation.
Identification in Econometrics: A Way to Get Causal Information from Observations? Damien Fennell, LSE UCL, May 27, 2005.
Differences-in-Differences
Sex Ratios Illustrates both the power of game theory. As well as how to “test’ game theory model. Albeit not our domain.
Research Methods Festival, Bath, July 2016
CHAPTER 4 Designing Studies
Statistical Data Analysis - Lecture /04/03
Department of Politics and International Relations
Differences-in-Differences
CHAPTER 4 Designing Studies
Chapter 1: Scientists’ Tools
Experiments and Observational Studies
Lucan Community College Leaving Certificate Mathematics
CHAPTER 4 Designing Studies
Joint Statistical Meetings, Vancouver, August 1, 2018
CHAPTER 4 Designing Studies
Chapter 4: Designing Studies
Statistical Reasoning December 8, 2015 Chapter 6.2
CHAPTER 4 Designing Studies
CHAPTER 4 Designing Studies
CHAPTER 4 Designing Studies
CHAPTER 4 Designing Studies
Chapter 4: Designing Studies
CHAPTER 4 Designing Studies
CHAPTER 4 Designing Studies
Rachael Bedford Mplus: Longitudinal Analysis Workshop 23/06/2015
CHAPTER 4 Designing Studies
Presentation transcript:

The (im)possibility of separating age, period and cohort effects Andrew Bell School of Geographical Sciences NCRM Research Methods Festival, Oxford, July 2014

Summary Age, period and cohort (APC) effects The APC identification problem The HAPC model Why it doesn’t work Example: mental wellbeing

APC effects A: I can’t seem to shake off this tired feeling. Guess I’m just getting old. [Age effect] B: Do you think it’s stress? Business is down this year, and you’ve let your fatigue build up. [Period effect] A: Maybe. What about you? B: Actually, I’m exhausted too! My body feels really heavy. A: You’re kidding. You’re still young. I could work all day long when I was your age. B: Oh, really? A: Yeah, young people these days are quick to whine. We were not like that. [Cohort effect] (From Suzuki 2012:452)

APC identification problem Age = Period – Cohort “the term [confounded] is not used in the traditional design sense of experimentally confounded but in the stronger sense of logically or mathematically confounded” (Goldstein, 1979, 19)

Impossible to isolate effects Cannot hold age and cohort constant and vary period (without time travel – Suzuki 2012 ) – Goldstein 1979: “there is no direct evidence for three distinct types of causal factors” – Glenn 2005: “One of the most bizarre instances in the history of science of repeated attempts to do something that is logically impossible” If you have age in your model, you also have period and cohort, and vice versa (whether you like it or not)

Consider these DGPs

Multilevel model for individuals nested in cohort groups and periods Yang and Land’s HAPC model Cohort Period Individual (Age) Health = Intercept + Age linear trend + Age quadratic trend + Cohort residual + Period residual + individual residual

Yang and Land’s HAPC model Claimed that this breaks the colinearity by – Including an age-squared term, and/or – Treating age in a different way to periods/cohorts “the underidentification problem of the classical APC accounting model has been resolved by the specification of the quadratic function for the age effects” Yang and Land (2006:84) "An HAPC framework does not incur the identification problem because the three effects are not assumed to be linear and additive at the same level of analysis" Yang and Land (2013:191) "This contextual approach...helps to deal with (actually completely avoids) the identification problem" Yang and Land (2013:71) Unfortunately this is not the case – See Bell, A and Jones, K (2014) Another futile quest? A simulation study of Yang and Land’s Hierarchical age-period-cohort model. Demographic Research, 30, 11, DOI: /DemRes

Bell, A and Jones, K (2014) Don’t birth cohorts matter? A commentary and simulation exercise of Reither, Hauser and Yang’s age-period-cohort study of obesity. Social Science and Medicine, 101, Obesity epidemic apparently the result of periods, not cohorts

Bell, A and Jones, K (2014) Don’t birth cohorts matter? A commentary and simulation exercise of Reither, Hauser and Yang’s age-period-cohort study of obesity. Social Science and Medicine, 101,

Why model is enticing Intuitive – Aging occurs within individuals – Cohorts are external – we belong to them – Periods are external – we pass from one into another Multilevel model, so has all the extensions that go with that – Other covariates at all levels – Additional levels (eg individuals, neighbourhoods) – Random coefficients

Our view HAPC framework is valuable, but…… Decision as to which of APC most likely caused the data should be made based on intuition and theory Assumptions constraining one of the parameters (often to zero) should be made explicitly (so it can be challenged) E.g. to constrain the period effect to zero: Health = Intercept + Age linear trend + Age quadratic trend … + Cohort linear trend + cohort quadratic trend … + Cohort residual + Period residual + individual residual

Example – mental wellbeing Previous consensus: life course of mental wellbeing is U-shaped, worsening to the ‘midlife crisis’ and then improving into old age I argue that linear period trends are unlikely, and so constrain continuous period trends to zero Mental wellbeing measured by GHQ score, using data from the BHPS Additionally add higher levels (individuals, local authority districts, households), random coefficients, covariates, interactions (for more details see Bell, 2014)

Example – mental wellbeing Predicted GHQ Score Age

Example – mental wellbeing Predicted GHQ Score Age U-shape? But currently cohort is not controlled in this graph

Male Female Predicted GHQ score Age No U-shape found Other findings of U- shape result from older cohorts having better mental wellbeing (i.e. cohorts were not appropriately controlled Find mental wellbeing worsens throughout the life course. Example – mental wellbeing

Cohort effects combine quadratic trend with stochastic variation Those brought up during recessions have generally better mental health throughout their life course? Male Female Predicted GHQ Score Birth Year Example – mental wellbeing

Conclusions Be careful. If you are interested in any of APC, be aware of the APC identification problem. If you have age in your model, you also have period and cohort (and vice versa) There is no mechanical solution to the problem Assumptions about APC need to be made, be based on theory, and stated explicitly

For more information Bell, A and Jones, K (2014) Another futile quest? A simulation study of Yang and Land’s Hierarchical age-period-cohort model. Demographic Research, 30, 11, DOI: /DemRes /DemRes Bell, A and Jones, K (2014) Don’t birth cohorts matter? A commentary and simulation exercise of Reither, Hauser and Yang’s age-period-cohort study of obesity. Social Science and Medicine, 101, , Bell, A and Jones, K (2013) Bayesian informative priors with Yang and Land’s Hierarchical age-period-cohort model. Quality and Quantity. DOI: /s /s – For constraining parameters to something other than zero Bell, A (2014) Life course and cohort trajectories of mental wellbeing in the UK, – a multilevel age-period-cohort analysis. Under review, available on researchgate.netresearchgate.net Bell, A and Jones, K (forthcoming) Age, period and cohort processes in longitudinal and life course analysis: a multilevel perspective. In A life course perspective on health trajectories and transitions, edited by Claudine Burton- Jeangros, Stéphane Cullati, Amanda Sacker and David Blane. Springer.

Periods or Cohorts? For obesity –changing diets/exercise regimes/technologies etc – Period effect – changes in culture affect everyone the same – Cohort effect – changes effect the young in their formative years – Could look at age effect – which is the most likely? (I think the one associated with cohorts) – A cohort effect could cause a period effect? (eg parents/overall culture influenced by their children)

Periods or Cohorts? For mental wellbeing – changes in pace of life/working patterns/level of stigma/narcissism – Period effect – changes in culture affect everyone the same – Cohort effect – changes effect the young in their formative years – Eg has everyone become more narcissistic? Or is increasing narcissism in society the result of narcissism amongst newer cohorts? I think the later is more plausible / has a clearer causal mechanism