Just how comparative are comparative statistics? Roger Jowell Centre for Comparative Social Surveys City University LLAKES International Conference

Why bother with comparative social statistics? Discovering differences and similarities “Comparative sociology is not a particular branch of sociology. It is sociology itself.” Durkheim Understanding one’s own society Critical for cross-national governance Helps challenge national stereotypes But comparisons ideally needed both between countries AND over time

Obstacles to cross-national social measurement Cultural incompatibilities The language barrier Breaching the ‘principle of equivalence’ Temptation of league tables Clash between standards and consistency Differences in methodological capacity Differences in methodological habits

Overcoming the obstacles – at least partially Ensuring equivalence of methods in all countries: Sampling Mode of data collection Language equivalence Concept equivalence Meticulous documentation Consultative design, not ‘safari’ method Contextual variables

A case history - the European Social Survey Multinational time series, started countries so far Contributes to scholarship and governance Large training component and potential Several substantive and methodological innovations Widespread usage

Five main aims To chart and explain changes in Europe’s social, political and moral climate To achieve and spread high standards of rigour in comparative social measurement To establish new indicators of societal well-being to stand alongside existing factual and behavioural indicators To facilitate quantitative monitoring of value change by academics, policymakers, businesses and the public To create and maintain a new contextual data repository

UK Greece Finland Ireland Portugal Slovakia Lithuania Turkey Switzerland Latvia Austria Czech Republic Luxembourg Iceland Bulgaria Ukraine Cyprus Norway Croatia Romania Italy Spain France Israel Sweden Russia Denmark Belgium Estonia Hungary Poland Netherlands Slovenia Germany ESS Countries Headquarters London, UK

ESS Countries by Round COUNTRYR1R2R3R4 Austria Belgium Bulgariaxx Croatiaxxx Cyprusxx Czech xx Denmark Estoniax Finland France Germany Greece x Hungary Icelandx xx Ireland Israel xx Italy xx COUNTRYR1R2R3R4 Latviaxx Lithuaniaxxx Luxembourg xx Netherlands Norway Poland Portugal Romaniaxx Russiaxx Slovakiax Slovenia Spain Sweden Switzerland Turkeyx x Ukrainex UK

Funding story to date Initiated and seed-funded by European Science Foundation Then core-funded for five biennial rounds (to date) by European Commission National costs of each round met by national academic funding councils Over 30 separate funding decisions each round Now selected as a prospective ‘ESFRI’ Research Infrastructure with prospect of long-term funding

Question clusters – some core, some rotating T rust in institutions Citizen engagement Socio-political values Immigration Moral & social attitudes Quality of life Crime and security Value orientations Perceptions of criminal justice National, ethnic, religious ID Health and welfare issues Life course perceptions Ageism Work and family life Education and occupation Financial circumstances Household circumstances Demographic composition

Outreach 32,000 registered data users to date (2500+ in UK) On-line bibliography of publications based on ESS contains: 236 journal articles, 36 books and 90 chapters so far Data increasingly deployed in policy debates Training courses heavily over-subscribed Influence on comparative methods well beyond Europe

A few summary findings

Education and Political Interest

Four Dimensions of Institutional Trust… Trust in the police varies but is high…

Four Dimensions of Institutional Trust… Trust in the legal system is lower….

Four Dimensions of Institutional Trust… Trust in national parliaments is lower still…

Four Dimensions of Institutional Trust… Trust in politicians is the lowest of all.

Attitudes to migration Surges of xenophobia associated with economic downturns New dangers of recession But education matters More education, less xenophobia, greater sympathy towards cultural diversity Educated are more accepting of all newcomers, even of potential labour market competitors

10 Laws of comparative research

Law 1 Don’t confuse respect for cultural differences with tolerance of methodological anarchy

Law 2 Never design questions or interpret data about a country one knows little or nothing about

Law 3 Confine cross-national studies to the smallest number of nations compatible with the study’s intellectual needs

Law 4 Pay as much attention to collecting aggregate-level background information about each country as to individual-level variables

Law 5 Always be at least as absorbed by the limitations of the data as about their explanatory power

Law 6 Assume initially that any major ‘new’ cross-national variation one discovers is an artefact

Law 7 Resist the temptation to produce ‘gee- whiz’ league tables containing every nation in every analysis

Law 8 Undertake collective, study-specific, multi-national development work and pre-testing

Law 9 Routinely include methodological experiments in cross-national studies

Law 10 Ensure that cross-national datasets are accompanied by detailed methodological reports about procedures and outcomes in each nation