1 How to produce population gridded data - the aggregation approach Ola Nordbeck Statistics Norway

2 Conversion and aggregation of point- based source data into grids I. Collection - of micro data and the European LAEA grid net II. Projection - f rom national coordinate system to European ETRS89-LAEA III. Creation of grid cell identification codes IV. Aggregation(sum) of population figures per LAEA grid cells V. Join aggregated data with the LAEA grid net VI. Making the populated grid data compliant with Eurostat data description

3 Collection C OLLECTING DATASETS –Georeferenced national micro data or populated national grid data –LAEA grid net country clip: Can be downloaded from datasets/eurogridhttp:// datasets/eurogrid A NALYSING MICRO DATA AND LAEA GRID NET COUNTRY CLIP –Analysing the Spatial extent of the grid net grid net country clip I N A RC GIS: 1. Add micro data of interest and the “country clip” grid 2. Carry out the spatial selection and verify the data: –Go to the main menu and chose Selection > Select By Location –In the dialog box enter:  Selection method: “Select features from”  Target layer: the micro data  Source Layer: “country clip”  Spatial selection method: Target layer features intersect the Source layer feature 3. Verify the result of the selection in the table – all points should be selected –Right click on the micro data layer and select “Open attribute table”

4 Reprojection R EPROJECTION OF NATIONAL MICRO DATA In order to preserve the sphere-like body properties each country has various ways to project national map data. This is also the case on a European level. In order to populate the European LAEA grid the national point-based microdata or grid data need to be reprojected into ETRS89/LAEA. I N A RC GIS: 1. To reproject data from national projection to ETRS89-LAEA using Project tool. See figure below. –A. In ArcToolbox go to Data Management > Tools > Projections and Transformations > Project –B. Enter the micro data as input and verify that the input coordinate system is correct. Define the output dataset and coordinate system (select “Coordinate Systems\Projected Coordinate Systems\Continental\Europe\ETRS 1989 LAEA.prj”)

5 Creation of grid cell identification codes Grid cell identification codes are based on grid cell’s lower left-hand corner coordinates truncated by grid cell size: –1kmN4534E5066 is result from coordinates Y= , X= and the cell size 1km S PATIAL JOIN APPROACH AND TABULAR APPROACH –The easiest way to create ids is to join the reprojected data spatially with the grid dataset. –Tabular approach generating ids is to prefer for heavy datasets I N A RC GIS: A. In ArcToolbox go to Analysis Tools > Overlay > Spatial Join B. Enter the point dataset as target features and the “country clip” as join features. Set “Intersect” to be the match option

6 Aggregation of population figures by LAEA grid cells Aggregating micro data using tabular data approach Aggregating micro data using SAS, SQL, Excel Aggregating of grid cell centroids using GIS software I N A RC GIS: A. In ArcToolbox go to Analysis Tools > Statistics > Summary statistics B. Input table: Your new point layer Statistics field: Tot_P Statistics type: SUM Case field: GRID_ID

7 Join with the LAEA grid net J OIN AGGREGATED DATA WITH THE “C OUNTRY CLIP LAEA GRID NET ” USING A RC GIS –In order to generate a spatial dataset with population by square grid cells I N A RC GIS: A. In order to join the two datasets in ArcGIS use Join fields B. In ArcToolbox go to Data Management Tools > Joins > Join Field C. As input dataset enter the “country clip” and specify GRID_ID to be the join field D. As join table add the aggregated table and the GRID_ID as join field. Select thereafter from the field list the fields to be included in the join

8 Making the populated grid data Eurostat compliant - data description, 1 Grid cell info heading: Definition: GRD_ID* Grid cell id (based on the LAEA grid) starts with the grid cell size (e.g. 1km) followed by the coordinates of the lowerleft-hand corner. The coordinates are in km and start with the letter “N” followed by the latitude and “E” followed by the longitude This results in the following GRD_ID: 1kmN4101E4453 [text field 13 characters] METHD_CL Method used to determine the population of the grid cell; A (aggregated), D (disaggregated) and M (mixed). [text field 1 character] YEARReference year of the data [text field 1 character] CNTR_CODE* ISO code of the country in which the grid cell is located (in the case of border cells the grid cell is reported from all neighboring countries with the same GRD_ID, but different CNTR_CODE attribute). [text field 2 characters] DATA_SRCFor national datasets the country code; for the European disaggregated datasets the data source. For border cells a similar approach as for CNTR_CODE was adopted. [text field 2 characters] T HE E UROPEAN DATASET HAS A STANDARDIZED TABLE STRUCTURE WITH PRE - DEFINED PRIMARY KEYS ( MARKED WITH *):

9 Making the populated grid data Eurostat compliant - data description, 2 Name of the variableDefinition TOT_P[Number of inhabitants, total] Name of the variableDefinition TOT_M[Number of inhabitants, male] TOT_F[Number of inhabitants, female] Name of the variableDefinition M_00_14[Number of inhabitants, male age 0-14] M_15_64[Number of inhabitants, male age 15-64] M_65_[Number of inhabitants, male age 65-] F_00_14[Number of inhabitants, female age 0-14] F_15_64[Number of inhabitants, female age 15-64] F_65_[Number of inhabitants, female age 65-] T HE GEOSTAT 1B PROJECT AIMED FOR HAVING POPULATION VARIABLES BY SEX AND AGE FOLLOWING A STANDARDISED STRUCTURE : T OTAL POPULATION P OPULATION BY SEX P OPULATION BY SEX AND AGE :

10 Making the populated grid data Eurostat compliant - data description, 3 D URING THE GEOSTAT 1B PROJECT IT WAS DISCUSSED TO INCLUDE A CONFIDENTIALITY TREATMENT METHOD DESCRIPTION PER GRID CELL : " TOT_P_CON_DT” is a text field. Proposed by Eurostat to be a 10 characters long [field length] indicating if the cell: –is not treated/manipulated [proposed value: “0”] –is treated with a threshold value, by indicating the threshold value below which information is treated. –is treated with other methods

11 Making the populated grid data Eurostat compliant - data description, 4 I N ORDER TO : I N A RC GIS: A. In order to structure the data according to Eurostats guidelines for population grids use the table field options in ArcGIS B. In ArcToolbox go to Data Management Tools > Fields > Add Field/Delete Field or Calculate Field C. Make your data Eurostat compliant (slide 8-9) D. Identify a way to render this table work more efficient?

12 Exercise 1. Find test data on the server 2. Produce gridded population statistics using the point data set and empty grid net 3. In case you are done and wait for others. Find the Quality Assessment sheets as handed out and consider how to complete it using your national data

13 Discussion 1. About the exercise 2. About the Quality Assessment sheets