1 How to produce population gridded data - the aggregation approach Ola Nordbeck Statistics Norway.

Slides:



Advertisements
Similar presentations
School of Geography FACULTY OF ENVIRONMENT Working with Tables 1.
Advertisements

NSF DUE ; Module 4.3. NSF DUE ; GeoTEd Partners Module name and number.
Geoprocessing; Useful Tools You Should Know in ArcToolbox Unlock the hidden secrets of ArcToolbox to discover tools that make your work easier and analysis.
Conversions from national grid data to harmonized European grid data EFGS Lisbon October 2011 Production and challenges Rina Tammisto, Senior Statistician,
EAS781 Practical Geophysics: The Tools and How to Use Them ArcGis Introduction ArcView ArcInfo ArcGis ?
NR 322: Single Layer Analysis Jim Graham Fall 2008 Chapter 8 & 9.
©2005 Austin Troy Lecture 9: Introduction to GIS 1.Vector Geoprocessing Lecture by Austin Troy, University of Vermont.
Geography 241 – GIS I Dr. Patrick McHaffie Associate Professor Department of Geography Cook County, % population < 5.
GIS in a Nutshell with ArcGIS 10.2
@ 2007 Austin Troy. Geoprocessing Introduction to GIS Geoprocessing is the processing of geographic information. – Creating new polygon features through.
Intro. To GIS Lecture 6 Spatial Analysis April 8th, 2013
@ 2007 Austin Troy. Geoprocessing Introduction to GIS Geoprocessing is the processing of geographic information. Perform spatial analysis and modeling.
Day 1-3. Variable Selection and GIS Processing 1.Discuss V mapping goals, targeted system (what is vulnerable?), framework 2.Choose data layers (criteria:
Add a File with X, Y coordinates to MapWindow
Basic Spatial Analysis
Habitat Analysis in ArcGIS Use of Spatial Analysis to characterize used resources Thomas Bonnot
Chapter 2 Querying a Database
Preparing Data for Analysis and Analyzing Spatial Data/ Geoprocessing Class 11 GISG 110.
Chapter 2 Querying a Database MICROSOFT ACCESS 2010.
Attribute Data in GIS Data in GIS are stored as features AND tabular info Tabular information can be associated with features OR Tabular data may NOT be.
GIS2: Geo-processing and Metadata Treg Christopher.
GIS 1 GIS Lecture 4 Geodatabases. GIS 2 Outline Administrative Data Example Data Tables Data Joins Common Datasets Spatial Joins ArcCatalog Geodatabases.
MSc in Geoinformatics – Managing Energy, Resources, Environment Teacher Training Dushanbe, – TEMPUS This project has.
Introduction to SPSS Edward A. Greenberg, PhD
Threats Database V4 Model Geodatabase Relation Class Creation and Data Population June 25, 2007 Marlene McKinnon, GIS Specialist.
Exploring your geospatial data. It’s all about Relationships!
Major parts of ArcGIS ArcView -Basic mapping, editing and Analysis tools ArcEditor -all of ArcView plus Adds ability to deal with topological and network.
School of Geography FACULTY OF ENVIRONMENT Introduction to ArcToolbox and Geoprocessing.
Martin Dodge Practical 2, 24th March 2004, pm Social Science Research Methodologies.
Exploring ArcToolbox Presented by: Isaac Johnson.
GIS 1 GIS Lecture 4 Geodatabases Copyright – Kristen S. Kurland, Carnegie Mellon University.
ArcGIS: ArcMap Tables. Agenda Opening tables The interface Working with columns Working with records Making selections Advanced table tools ▫Add fields.
Part 2A (Today’s Part) Press and hold the small red button to turn receiver on Once the receiver acquires its position, press the page button until the.
ATN GIS Support ArcGIS: ArcCatalog.
Data Creation and Editing Based in part on notes by Prof. Joseph Ferreira and Michael Flaxman Lulu Xue | Nov. 3, :A Workshop on Geographical.
Query and Reasoning. Types of Queries Most GIS queries will select spatial features Query by Attribute (Select by Attribute) –Structured Query Language.
CZECH STATISTICAL OFFICE | Na padesátém 81, Prague 10 | czso.cz1/X Ing. Jaroslav Kraus, Ph.D. Mgr. Štěpán Moravec DISAGGREGATION METHODS FOR GEOREFERENCING.
Advanced GIS Using ESRI ArcGIS 9.3 Spatial Analyst 2.
NR 143 Study Overview: part 1 By Austin Troy University of Vermont Using GIS-- Introduction to GIS.
ArcGIS: ArcCatalog. Agenda The ArcCatalog Interface General ArcCatalog ▫Navigating directories ▫Preview data ▫View metadata Advanced ArcCatalog ▫Modifying.
Geoprocessing Geoprocessing is a fancy name for Spatial Operations So what is Geoprocessing? Processing or manipulating of geographic/spatial data to.
ArcGIS 9 ch 6 Edited 10/28/05 1 Land Use Analysis An important aspect of any GIS is the use of analysis. Analysis helps us to say something meaningful.
Introduction to Geographic Information Systems Fall 2013 (INF 385T-28620) Dr. David Arctur Research Fellow, Adjunct Faculty University of Texas at Austin.
1 Production of grid statistics Methods for producing and harmonise statistics on grid ESTP course on Geographic Information Systems (GIS): Use of GIS.
Folio3 IPhone Training Session 2 Testing App on device Presenter: Imam Raza.
1 PEER Session 02/04/15. 2  Multiple good data management software options exist – quantitative (e.g., SPSS), qualitative (e.g, atlas.ti), mixed (e.g.,
Environmental GIS Nicholas A. Procopio, Ph.D, GISP
Intro. To GIS Pre-Lab Spatial Analysis April 1 st, 2013.
Data disclosure control Nordic Forum for Geography and Statistics Stockholm, 10 th September 2015.
PRODUCTION PROCESSES FOR A HARMONISED E UROPEAN POPULATION GRID Marja Tammilehto-Luode Rina Tammisto Statistics Finland October 2012European Forum.
Data Visualization and Best Practices Webinar. Overview Environmental Data Sources and Considerations  SDWIS, radon labs, local health departments, for.
Excel Chapter 1 Creating a Worksheet and an Embedded Chart
Geocoding Chapter 16 GISV431 &GEN405 Dr W Britz. Georeferencing, Transformations and Geocoding Georeferencing is the aligning of geographic data to a.
Geocoding Chapter 16 GISV431 &GEN405 Dr W Britz. Georeferencing, Transformations and Geocoding Georeferencing is the aligning of geographic data to a.
Lecture 18: Spatial Analysis Using Rasters Jeffery S. Horsburgh CEE 5190/6190 Geographic Information Systems for Civil Engineers Spring 2016.
European Monitoring Platform for Mapping of QoS and QoE
GIS Institute Center for Geographic Analysis
Demo #5: creating a point shapefile from Excel tables
ArcMap: Geoprocessing
Spatial Data Processing
Preliminaries: -- vector, raster, shapefiles, feature classes.
Preparing raster files for Condatis
Ola Nordbeck Statistics Norway
GIS Institute Center for Geographic Analysis
Technical guidance for grid based provision of data for MSFD reporting
Vector Geoprocessing.
GIS Institute Center for Geographic Analysis
Introduction to hands-on exercise - accessibility
Spatial Analysis with Raster Datasets-1
How to GEOSTAT census data?
Presentation transcript:

1 How to produce population gridded data - the aggregation approach Ola Nordbeck Statistics Norway

2 Conversion and aggregation of point- based source data into grids I. Collection - of micro data and the European LAEA grid net II. Projection - f rom national coordinate system to European ETRS89-LAEA III. Creation of grid cell identification codes IV. Aggregation(sum) of population figures per LAEA grid cells V. Join aggregated data with the LAEA grid net VI. Making the populated grid data compliant with Eurostat data description

3 Collection C OLLECTING DATASETS –Georeferenced national micro data or populated national grid data –LAEA grid net country clip: Can be downloaded from datasets/eurogridhttp:// datasets/eurogrid A NALYSING MICRO DATA AND LAEA GRID NET COUNTRY CLIP –Analysing the Spatial extent of the grid net grid net country clip I N A RC GIS: 1. Add micro data of interest and the “country clip” grid 2. Carry out the spatial selection and verify the data: –Go to the main menu and chose Selection > Select By Location –In the dialog box enter:  Selection method: “Select features from”  Target layer: the micro data  Source Layer: “country clip”  Spatial selection method: Target layer features intersect the Source layer feature 3. Verify the result of the selection in the table – all points should be selected –Right click on the micro data layer and select “Open attribute table”

4 Reprojection R EPROJECTION OF NATIONAL MICRO DATA In order to preserve the sphere-like body properties each country has various ways to project national map data. This is also the case on a European level. In order to populate the European LAEA grid the national point-based microdata or grid data need to be reprojected into ETRS89/LAEA. I N A RC GIS: 1. To reproject data from national projection to ETRS89-LAEA using Project tool. See figure below. –A. In ArcToolbox go to Data Management > Tools > Projections and Transformations > Project –B. Enter the micro data as input and verify that the input coordinate system is correct. Define the output dataset and coordinate system (select “Coordinate Systems\Projected Coordinate Systems\Continental\Europe\ETRS 1989 LAEA.prj”)

5 Creation of grid cell identification codes Grid cell identification codes are based on grid cell’s lower left-hand corner coordinates truncated by grid cell size: –1kmN4534E5066 is result from coordinates Y= , X= and the cell size 1km S PATIAL JOIN APPROACH AND TABULAR APPROACH –The easiest way to create ids is to join the reprojected data spatially with the grid dataset. –Tabular approach generating ids is to prefer for heavy datasets I N A RC GIS: A. In ArcToolbox go to Analysis Tools > Overlay > Spatial Join B. Enter the point dataset as target features and the “country clip” as join features. Set “Intersect” to be the match option

6 Aggregation of population figures by LAEA grid cells Aggregating micro data using tabular data approach Aggregating micro data using SAS, SQL, Excel Aggregating of grid cell centroids using GIS software I N A RC GIS: A. In ArcToolbox go to Analysis Tools > Statistics > Summary statistics B. Input table: Your new point layer Statistics field: Tot_P Statistics type: SUM Case field: GRID_ID

7 Join with the LAEA grid net J OIN AGGREGATED DATA WITH THE “C OUNTRY CLIP LAEA GRID NET ” USING A RC GIS –In order to generate a spatial dataset with population by square grid cells I N A RC GIS: A. In order to join the two datasets in ArcGIS use Join fields B. In ArcToolbox go to Data Management Tools > Joins > Join Field C. As input dataset enter the “country clip” and specify GRID_ID to be the join field D. As join table add the aggregated table and the GRID_ID as join field. Select thereafter from the field list the fields to be included in the join

8 Making the populated grid data Eurostat compliant - data description, 1 Grid cell info heading: Definition: GRD_ID* Grid cell id (based on the LAEA grid) starts with the grid cell size (e.g. 1km) followed by the coordinates of the lowerleft-hand corner. The coordinates are in km and start with the letter “N” followed by the latitude and “E” followed by the longitude This results in the following GRD_ID: 1kmN4101E4453 [text field 13 characters] METHD_CL Method used to determine the population of the grid cell; A (aggregated), D (disaggregated) and M (mixed). [text field 1 character] YEARReference year of the data [text field 1 character] CNTR_CODE* ISO code of the country in which the grid cell is located (in the case of border cells the grid cell is reported from all neighboring countries with the same GRD_ID, but different CNTR_CODE attribute). [text field 2 characters] DATA_SRCFor national datasets the country code; for the European disaggregated datasets the data source. For border cells a similar approach as for CNTR_CODE was adopted. [text field 2 characters] T HE E UROPEAN DATASET HAS A STANDARDIZED TABLE STRUCTURE WITH PRE - DEFINED PRIMARY KEYS ( MARKED WITH *):

9 Making the populated grid data Eurostat compliant - data description, 2 Name of the variableDefinition TOT_P[Number of inhabitants, total] Name of the variableDefinition TOT_M[Number of inhabitants, male] TOT_F[Number of inhabitants, female] Name of the variableDefinition M_00_14[Number of inhabitants, male age 0-14] M_15_64[Number of inhabitants, male age 15-64] M_65_[Number of inhabitants, male age 65-] F_00_14[Number of inhabitants, female age 0-14] F_15_64[Number of inhabitants, female age 15-64] F_65_[Number of inhabitants, female age 65-] T HE GEOSTAT 1B PROJECT AIMED FOR HAVING POPULATION VARIABLES BY SEX AND AGE FOLLOWING A STANDARDISED STRUCTURE : T OTAL POPULATION P OPULATION BY SEX P OPULATION BY SEX AND AGE :

10 Making the populated grid data Eurostat compliant - data description, 3 D URING THE GEOSTAT 1B PROJECT IT WAS DISCUSSED TO INCLUDE A CONFIDENTIALITY TREATMENT METHOD DESCRIPTION PER GRID CELL : " TOT_P_CON_DT” is a text field. Proposed by Eurostat to be a 10 characters long [field length] indicating if the cell: –is not treated/manipulated [proposed value: “0”] –is treated with a threshold value, by indicating the threshold value below which information is treated. –is treated with other methods

11 Making the populated grid data Eurostat compliant - data description, 4 I N ORDER TO : I N A RC GIS: A. In order to structure the data according to Eurostats guidelines for population grids use the table field options in ArcGIS B. In ArcToolbox go to Data Management Tools > Fields > Add Field/Delete Field or Calculate Field C. Make your data Eurostat compliant (slide 8-9) D. Identify a way to render this table work more efficient?

12 Exercise 1. Find test data on the server 2. Produce gridded population statistics using the point data set and empty grid net 3. In case you are done and wait for others. Find the Quality Assessment sheets as handed out and consider how to complete it using your national data

13 Discussion 1. About the exercise 2. About the Quality Assessment sheets