Internet access to UK Census interaction data: that's WICID! John Stillwell Centre for Computational Geography University of Leeds, Leeds LS2 9JT

Slides:



Advertisements
Similar presentations
The Economic and Social Data Service (ESDS) Karen Dennison UK Data Archive Improving access to government datasets 18 January 2007.
Advertisements

Constructing population time series with an ethnic breakdown for sub-national areas in England and Wales, Albert Sabater PhD student at CCSR.
1-3 September 2008Census microdata 2008 Mixed-Ethnic Unions in England and Wales in the 1990s Zhiqiang Feng 1,2 Gillian Raab 1,2 Paul Boyle 1,2 Maarten.
2001 Census Programme Using the Census for contemporary and historical research ESRC Research Methods Festival Oxford, July 2004.
The Census Area Statistics Myles Gould Understanding area-level inequality & change.
Mapping and Visualising Census Data Keith Cole Jackie Carter Geo-data forum - 4/4/2001.
Let us Bring You to Your Census: Recent Developments in UK Census Data Provision Lucy Bell Census Registration Service Co-ordinator UK Data Archive
School of Geography FACULTY OF EARTH & ENVIRONMENT Using OAC for analysis of the 2001 Census interaction data Oliver Duke-Williams
1 Combining migration data from multiple sources: Applications to internal movements in England, James Raymer with Peter W.F. Smith and Corrado.
Opportunities and Challenges of the 2011 Census: A view from academia Tony Champion Paper for the TWRI Policy & Research Conference.
Understanding Population Trends and Processes: Links between internal migration, commuting and within household relationships Oliver Duke-Williams School.
T HE W EB - BASED I NTERFACE TO C ENSUS I NTERACTION D ATA - WICID Presentation to the ESRC Research Methods Festival Adam Dennett Centre for Interaction.
Web-based Access to Complex UK Census Data Sets IASSIST 2002,University of Connecticut, Storrs, CT, USA June 11-15, 2002 Oliver Duke-Williams and John.
Sample of Anonymised Records: User Meeting Propensity to migrate by ethnic group: 1991 & 2001 Paul Norman 1, John Stillwell 2 & Serena Hussain 2 School.
Access routes to 2001 UK Census Microdata: Issues and Solutions Jo Wathan SARs support Unit, CCSR University of Manchester, UK
Learning and Teaching with the UK Census Developing the Collection of Historical and Contemporary Census Data and Materials into a Major Learning and Teaching.
Scotland’s 2011 Census Migration Matters Scotland Thematic Event Cecilia Macintyre 26 February 2015.
2001 Census Programme Delivering UK Census Data to Researchers: Progress and Challenges David Martin University of Southampton and ESRC/JISC Census Programme.
Part of the Arts and Humanities Data Service and the UK Data Archive. Funded by the Joint Information Systems Committee and the Arts and Humanities Research.
Joint Information Systems Committee Supporting Higher and Further Education Development of an Information Environment for UK Learning and Teaching NOF-Digitise.
Geography and Geographical Analysis using the ONS Longitudinal Study Christopher Marshall & Julian Buxton CeLSIUS.
Census interaction data: from CIDS to CIDER Census interaction data: from CIDS to CIDER John Stillwell School of Geography, University of Leeds, CIDS Director.
The ONS Longitudinal Study. © London School of Hygiene and Tropical Medicine The Office for National Statistics Longitudinal Study (LS) o What is it o.
EAS 293 Data Library, Rutherford North 1 st Floor Chuck Humphrey Data Library October 14, 2008.
Access to UK Census Data for Spatial Analysis: Towards an Integrated Census Support Service John Stillwell 1, Justin Hayes 2, Rob Dymond-Green 2, James.
Interaction Data John Stillwell and Oliver Duke-Williams Centre for Interaction Data Estimation and Research (CIDER) School of Geography, University of.
Dynamics of diversity: evidence for West Yorkshire from the 2011 Census Dr Stephen Jivraj & Dr Nissa Finney Centre on Dynamics of Ethnicity, University.
Secondary Data Analysis Using the Census Stephen Drinkwater WISERD School of Business and Economics Swansea University.
Census.ac.uk Census Area Statistics and Casweb David Rawnsley Census Dissemination Unit (CDU) Mimas University of Manchester.
Census Interaction Data: Characteristics and Access John Stillwell Centre for Interaction Data Estimation and Research (CIDER) School of Geography, University.
Geographical Data Products Carol Blackwood UKBORDERS 3 rd July 2012.
Nigel James Bodleian Library The Census Accessing and mapping British Census Data.
Household projections for Scotland Hugh Mackenzie April 2014.
Interaction Data: Progress and Potential John Stillwell and Oliver Duke-Williams Centre for Interaction Data Estimation and Research (CIDER) School of.
‘Estimating with Confidence’ and hindsight: Population estimates for areas smaller than districts, revisions to levels of 1991 Census non-response Paul.
Understanding Population Trends and Processes WHAT HAPPENS WHEN INTERNATIONAL MIGRANTS SETTLE? ETHNIC GROUP POPULATION TRENDS AND PROJECTIONS FOR UK LOCAL.
GEOG3025 Census and administrative data sources 2: Outputs and access.
Internal migration of Britain’s ethnic populations Serena Hussain and John Stillwell School of Geography University of Leeds Presentation for the UPTAP.
Handling Migration and Commuting Flow Data Day session at the ESRC Research Methods Festival at St Catherine’s College, University of Oxford, 2 July 2008.
Using PostGIS and MapServer in the Census Interaction Data Service Presentation to AGI Technical SIG 'Open-Source in GIS' British Antarctic Survey, Cambridge,
Plans for Access to UK Microdata from 2011 Census Emma White Office for National Statistics 24 May 2012.
School of Geography FACULTY OF Environment Spatial Interaction: An Audit of Population Flow Data in the UK Adam Dennett, Oliver Duke-Williams and John.
Monitoring UK internal migration in the twenty-first century John Stillwell Centre for Interaction Data Estimation and Research (CIDER), School of Geography,
Providing Access to Census- based Interaction Data in the UK: That’s WICID! John Stillwell School of Geography, University of Leeds Leeds, LS2 9JT, United.
POPGROUP Slide 1 The Derived Forecasts module of the POPGROUP software Ludi Simpson, University of Manchester BSPS day meeting on household projection.
1 Measuring Quality Issues Associated with Internal Migration Estimates Joanne Clements, Amir Islam, Ruth Fulton & Jane Naylor Demographics Methods Centre.
Using WICID (Web-based Interface to Census Interaction Data) in the Classroom John Stillwell School of Geography, University of Leeds Leeds, LS2 9JT, United.
New and easier ways of working with aggregate data and geographies from UK censuses Justin Hayes UK Data Service Census Support.
Internet Access to Census Migration and Journey-to-Work Data John Stillwell and Oliver Duke-Williams Centre for Computational Geography University of Leeds,
WICID AND THE 2001 INTERACTION DATA John Stillwell and Oliver Duke-Williams School of Geography, University of Leeds Presentation at the Ninth International.
School of Geography FACULTY OF EARTH & ENVIRONMENT New disclosure threats in Census interaction data Presented at the 6 th International Conference on.
Using the 2001 Census to measure the migration of ethnic groups in relation to concentration John Stillwell School of Geography, University of Leeds Presentation.
Web Access to Census Interaction Data John Stillwell and Oliver Duke-Williams Centre for Computational Geography University of Leeds, Leeds LS2 9JT Paper.
1 Research Methods Festival 2008 Zhiqiang Feng 1,2 and Paul Boyle 1 1 School of Geography & Geosciences University of St Andrews 2 The Centre for Census.
JOINT UN-ECE/EUROSTAT MEETING ON POPULATION AND HOUSING CENSUSES GENEVA, MAY 2009 DETERMINING USER NEEDS FOR THE 2011 UK CENSUS IAN WHITE, Office.
Structural analysis of the aggregate outputs from the 2011 Census to develop alternative integrated multidimensional conceptual models of data and geographies.
ETHNIC MIGRATION IN BRITAIN: Analyses of census data at district and ward scales John Stillwell and Adam Dennett School of Geography, University of Leeds,
The micro-geography of UK demographic change Paul Norman School of Geography, University of Leeds Understanding Population Trends & Processes.
Jonathan Smith and Cal Ghee Migration Statistics Improvement, ONSCD Centre for Demography Improving internal migration estimates of students.
School of Geography FACULTY OF ENVIRONMENT ESRC Research Award RES What happens when international migrants settle? Ethnic group population.
The micro-geography of UK demographic change Paul Norman Cathie Marsh Centre for Census & Survey Research (CCSR), University of Manchester ESRC.
Interregional migration England and Wales Emily Grundy and Rachel Stuchbury CeLSIUS The London School of Hygiene and Tropical Medicine.
Exploring Microsimulation Methodologies for the Estimation of Household Attributes Dimitris Ballas, Graham Clarke, and Ian Turton School of Geography University.
The micro-geography of UK demographic change Paul Norman School of Geography, University of Leeds understanding population trends and processes.
INTERNAL MIGRATION BY ETHNICITY: A LONDON WARD-LEVEL STUDY John Stillwell School of Geography, University of Leeds, Leeds LS2 9JT Paper prepared for the.
JOINT UN-ECE/EUROSTAT MEETING ON POPULATION AND HOUSING CENSUSES GENEVA, 7-9 JULY 2010 DISSEMINATING THE RESULTS OF THE 2011 CENSUS IN ENGLAND AND WALES.
Measuring ethnic group population change for small areas using census microdata and demographic population estimates ESRC Research Methods Festival St.
Samples of Anonymised Records from the U.K. Census 1991 and 2001 Integrating Census Microdata Workshop Barcelona th July 2005 Dr. Ed Fieldhouse Cathie.
UKBORDERS is the Geography Data Support Unit for the ESRC Census Programme. UKBORDERS focus is on Digital Boundaries and postcode directories.
Measuring Internal Migration: Comparing Census and Administrative Data
Presentation transcript:

Internet access to UK Census interaction data: that's WICID! John Stillwell Centre for Computational Geography University of Leeds, Leeds LS2 9JT

Focus §The provision and development of a Census Interaction Data Service (CIDS) §The development of a web-based information system (WICID) that allows researchers to extract data on interaction flows between origins and destinations

Presentation § Population censuses § CIDS challenge: aims and objectives § Census based interaction data sets § Importance of interaction data in planning § System architecture and metadata structure § Features of the interface § Some examples of data extraction and analysis

Acknowledgements § Funded by ESRC and JISC under the 2001 Census of Population Programme (Award number H ) § Began: 1 August 2001 § Ends: 31 July 2006 § Paul Boyle and Zhiqiang Feng, University of St Andrews § Keith Cole and Justin Hayes, University of Manchester

Population censuses § reliable § comprehensive § small area scale § very important for geographic research but § periodic § not problem free

Problems § Incorrect or missing information e.g. origin or workplace unstated § Measures taken to preserve confidentiality e.g. minimum thresholds for persons and households § Underenumeration e.g. missing million in is first ‘One Number Census’ where underenumeration has been adjusted for by imputation

2001 Census population counts: male deficit in young adult ages: cause for concern? Parity

Digital data products §Various different products of 1991 Census - LBS: Local Base Statistics - SAS: Small Area Statistics - SMS: Special Migration Statistics -SWS: Special Workplace Statistics -SARs: Samples of Anonymised Records -LS: Longitudinal Study -DBD: Digital Boundary Data §Similar set of products for 2001 Census

Data Support Units §Census Registration Service (CRS) (University of Essex) §Census Dissemination Unit (University of Manchester) for CAS (LBS/SAS) §Geography Data Unit: UKBORDERS (University of Edinburgh) for DBD §Census Interaction Data Service (CIDS) (University of Leeds) for SMS/SWS §Census Microdata Unit, CCSR (University of Manchester) for SARs §Centre for Longitudinal Study Information and User Support (CeLSIUS) (University of London School of Hygiene and Tropical Medicine) for LS

CIDS Challenge § Aim is to increase the use of the Origin- Destination (interaction) data sets that will be produced as outputs from the 2001 UK Census (as well as the equivalent special migration and commuting data sets produced from 1991 and 1981 censuses)

Objectives § To provide users with access to existing census based interaction data sets (for 1991 and 1981) via the Internet § To develop an ‘user-friendly’ interface for query building and data extraction § To develop a flexible system that allows new data sets (e.g Census interaction data) to be added without any major system redesign

Objectives § To allow users the option of constructing queries that involve the selection of origin and destination areas at different spatial scales § To produce a library of popular sub-sets of interaction data for quick extraction and downloading § To provide facilities to download the data in alternative formats

Interaction Data Sets for 1991 Original migration data sets §SMS Set 1 (2 tables, 12 counts, wards) §SMS Set 2 (12 tables, 93 counts, districts)

Interaction Data Sets for 1991 Original commuting and student data sets § SWS Set C (9 tables, 274 counts, wards) § Table 100 (2 tables, 47 counts, districts) Derived data sets § SMS Set 1 Tables 3-10 (adjusted by Rees and Duke-Williams) so-called SMSGAPS § SMS Set 1 Table 3 (adjusted by Simpson and Middleton) so called SMS-MIGPOP

Suppression problem §Only flows for some origin- destination pairs are available §Can identify the extent of suppression using a raster image based on SMS Set 2 Table 1 (no flows suppressed) §Each cell shaded - white when cell empty - grey when flow is black when flow is 10+

Interaction Data Sets for 1981 §1981 SMS Set 2 (Male and female migrants between wards in 1991) §1981 SWS Set C (Five tables counts - of journey to work flows between wards in 1991) §all re-estimated for 1991 ward geography by Boyle and Feng as part of a Census Development Programme project

Importance of interaction data in planning § Interaction data sets are very important because they provide information on migration and commuting flows between small areas (wards) § e.g. migration data used for population estimation and projection by central and local government agencies § e.g. commuting data used to define TTWAs and in transport planning

System Architecture

Metadata Structure

Features of the Interface: CIDS homepage

Login page

Welcome page

Different parts of the page Status line Feedback and Help Part of each page where you will interact Logout Key Links

Off the shelf

Flow summaries

General query page

Area Selection Tools

List Area Selection Tool

Origins selected

Data Selection Tools

Data Selection Options

Table Selection for 1991 SMS 2

Variable Selection with Table 1 of 1991 SMS 2

Current query summary

Data extraction

Output Planner

Output previewer

Download file

Examples of data extractions § In-migrants to Cardiff § Immigrants from Greece by age and sex § Immigrants from Greece § Net migration in Scotland § Students to and from Sussex § Social class of commuters in Leeds

Query: What were the in-migration flows to Cardiff district from various origins in ?

In-migration flow to Cardiff, using SMS Set 2, Source: 1991 Census Crown Copyright: ESRC/JISC Purchase

Query: What is the age structure of migrants from Greece to GB in ?

Age profile of migrants from Greece, Source: 1991 Census Crown Copyright: ESRC/JISC Purchase

Query: What is the distribution of migrants from Greece by district of GB in ?

Districts receiving most migrants from Greece, Source: 1991 Census Crown Copyright: ESRC/JISC Purchase

What are the net migration balances of Scottish districts for (a) moves within Scotland and (b) moves between Scotland and England and Wales?

Source: 1991 Census Crown Copyright: ESRC/JISC Purchase

Query: Where do universities in Sussex get their students from?

Main county origins with term-time addresses in Sussex Source: 1991 Census Crown Copyright: ESRC/JISC Purchase

Social structure of Leeds and surrounding districts using 1991 SWS

Query: What are the journey to work flows between zones by social class in 1991?

Social class structure of commuters in Leeds and between Leeds and surrounding districts, 1991 Source: 1991 Census Crown Copyright: ESRC/JISC Purchase

Source: 1991 Census Crown Copyright: ESRC/JISC Purchase Proportions of commuters to Central Leeds from other wards and surrounding districts by social class, 1991 Professional Managerial and Technical

Source: 1991 Census Crown Copyright: ESRC/JISC Purchase Skilled Non-manual Skilled Manual

Source: 1991 Census Crown Copyright: ESRC/JISC Purchase Partly Skilled Unskilled

Conclusions/Next steps § CIDS now available and WICID stable § Usage rates reasonable (particularly since Athens One Stop Sign On was introduced by Census Registration Service) §Access available at

Next steps § Flexible metadata structure of WICID will allow 2001 Census results to be included in the system § WICID will be used to verify the 2001 data in 2003

Next steps Mapping option for geographical area selection now being developed

Next steps § Analysis and modelling facilities in WICID intended but raises difficult questions § Important to consider the research agenda for the future… what are the key research areas that should be investigated: e.g. validation studies, comparative studies, empirical research, modelling work