SSW - Spatial Statistics on Web Tuuli Pihlajamaa, Marja Tammilehto-Luode September 10th 2015 Nordic Forum for Geography and Statistics

Contents Introduction Oskari platform SSW in practise: Development by Scrum methodology Testing procedure User stories in the project Examples of the analysis methods to be developed Oskari Pilot in Statistics Finland Concluding remarks 18 September 2018 Etunimi Sukunimi

Introduction Objectives of the project Eurostat grant 2014-2015 To provide spatial statistics on the web To improve the national geoportal from the point of view of statistics To gain experience about an open source web application To promote cooperation between the NSI and the NMA Focus on usability of grid-base data – use of Inspire data and concept Eurostat grant 2014-2015 Inspiring cooperation with the National Land Survey SF project leader, 4 SF project members, 4 NLS project members + scrum team Supported by both DGs 18 September 2018 Etunimi Sukunimi

Oskari platform Open source applications Created and maintained by the National Land Survey Built on standard Open Source components (OpenLayers, Geotools, Geoserver…) Promotes extension of functionalities in a coordinated manner – integration of applications Open Source - MIT/EUPL dual licensing Guidelines, source code and all the content on the Developer Web Site and in GitHub Oskari network (more than 30 user organisations), management group, integrator (e.g. responsible for maintaining the Developer Web Site) The National Geoportal is an implementation of using the Oskari platform 18 September 2018 Etunimi Sukunimi

SSW in practise

Development by Scrum methodology The Oskari software development in National Land Survey of Finland (later NLS) is done based on agile software development methodology Scrum In this project one sprint lasted usually two weeks Statistics Finland’s (later SF) part in the project was to write user stories for NLS and test that the stories were implemented right NLS divided the user stories into smaller stories to be used for development 18 September 2018 Etunimi Sukunimi

Testing procedure NLS provided a demo environment, that SF could use to test the tools and functions that were developed, before launching them in Paikkatietoikkuna SF gave feedback and reported if the tools needed improvements Mostly testing was done by the members in the project team, but besides that we organized also two workshops, where the application was tested by users outside the project group 18 September 2018 Etunimi Sukunimi

User stories in the project 13 stories were to be finished Functions included in the stories: Key ratios computation based on different area selections (free hand, area code, sectors and buffers) Handling the population grid data in calculations, dealing data with protected/no-data values Difference computation, calculating difference in population grid data values between different years Filtering data based on the values in the data or based on the results of key ratios computation Spatial join, joining data based on location Heatmap analysis 18 September 2018 Etunimi Sukunimi

Previous analysis methods to be developed Buffer creating buffers around features (buffers for multiple points, buffers for lines and polygons) for buffer analysis Key ratios computation calculating median was added handling the grid data with no-data values/protected values filtering data by using results from key ratios computation 18 September 2018 Etunimi Sukunimi

Buffer - creating buffers around features (buffers for multiple points, buffers for lines and polygons) for buffer analysis 18 September 2018 Etunimi Sukunimi

Key ratios computation - handling the grid data with no-data values/protected values 18 September 2018 Etunimi Sukunimi

Key ratios computation – filtering data by using results from key ratios computation 18 September 2018 Etunimi Sukunimi

New analysis methods to be created Buffers and sectors (Multiple Buffer) creating buffers and sectors for analysis Difference computation calculating difference in population grid data values between different years Spatial join enriching data based on spatial location using spatial join in key ratios computation 18 September 2018 Etunimi Sukunimi

Buffers and sectors (Multiple Buffer) - creating buffers and sectors for analysis 18 September 2018 Etunimi Sukunimi

Difference computation - calculating difference in population grid data values between different years 18 September 2018 Etunimi Sukunimi

Spatial join – enriching data based on spatial location Example: Giving postal code for educational institutions 18 September 2018 Etunimi Sukunimi

Spatial join - using spatial join in key ratios computation, case buffers and sectors Using population grid data for the aggregation 18 September 2018 Etunimi Sukunimi

Spatial join - using spatial join in key ratios computation, case buffers and sectors Key ratios of population by sectors 18 September 2018 Etunimi Sukunimi

Heatmap (Kernel density) Choose WMS-layer fo the analysis Choose the radius of kernels, pixels per cell and weight property 18 September 2018 Etunimi Sukunimi

Heatmap (Kernel density) Results: 18 September 2018 Etunimi Sukunimi

Oskari Pilot in Statistics Finland Aim of the pilot is to have experience of the technical implementation of Oskari and it’s usability in SF. Results will support the GIS technology review. To reach the aim, we will: Build internal catalog service of spatial statistics data of Statistics Finland Document the process, how to build Oskari services, based on practical experience 18 September 2018 Etunimi Sukunimi

Approach to the Oskari Pilot First stage: Technical understanding of Oskari platform Building a test environment How to implement Oskari functions in the Pilot service Questions regarding update and the administration of the intranet service Defining the demands of opening a public service (maybe in the future) Second stage: Building a pilot service Defining the service (data and functions) Implementing data and metadata in the service Implementing Oskari functions to the Pilot service 18 September 2018 Etunimi Sukunimi

First stage: Technical understanding - Intranet application in function 18 September 2018 Etunimi Sukunimi

Second stage: Pilot service to be build Viewing service in intranet Open data from SF interface services and other data Ready service will support statistics production and increase the understanding of the data available in SF 18 September 2018 Etunimi Sukunimi

Data in the pilot service INSPIRE-data (newest) Municipality-based statistical units Grid net for statistics 1 km x 1km Population Distribution Production- and Industrial Facilities Educational Institutions PAAVO – Open data by postal code area Municipal sub-areas Prices of dwellings in housing companies – by postal code area 18 September 2018 Etunimi Sukunimi

Pilot service – draft from the data list and metadata from National Geoportal 18 September 2018 Etunimi Sukunimi

Pilot service – dataproducer’s tools User administration Layer administration Layer rights administration 18 September 2018 Etunimi Sukunimi

Current situation of Oskari Pilot and results Technical understanding is still evolving Results of the piloting - by the end of the year 2015 SSW project ends at the end of the year Results are meant to support the GIS technology review, that will be done by the end of the year 18 September 2018 Etunimi Sukunimi

Concluding remarks Mutual interest – a concrete cooperation project Learning by doing – learning from each others Promoted further cooperation Open source application on the web feasible - Further development is promising (graphs and tables) Cooperation with other Oskari platform users Final report due January 2016 (Interim report available) http://www.paikkatietoikkuna.fi/web/en/map-window http://www.oskari.org/ 18 September 2018 Etunimi Sukunimi

tuuli.pihlajamaa@stat.fi marja.tammilehto-luode@stat.fi Questions? tuuli.pihlajamaa@stat.fi marja.tammilehto-luode@stat.fi