Standardizing and industrializing a business process – the dissemination use case – Annex 1 Alessio Cardacino - (alcardac@istat.it) ESTP Course “Information standards and technologies for describing, exchanging and disseminating data and metadata” THE CONTRACTOR IS ACTING UNDER A FRAMEWORK CONTRACT CONCLUDED WITH THE COMMISSION

SDMX Modelling of the primary hypercube Hypercube definition: A single hypercube containing data on: Handicraft enterprises active at 31 december, by section of economic activity; Italy, Lombardia and provinces. Handicraft enterprises active at 31 december, by legal form; Italy, Lombardia and provinces. Demography of handicraft enterprises; Birthrates and deathrates; Italy, Lombardia and provinces.

Handicraft enterprises active by section of economic activity

Handicraft enterprises active by legal form

Demography of handicraft enterprises; birthrates and deathrates

Creation of the primary data hypercube from the HANDICRAFT+IT1+1 Creation of the primary data hypercube from the HANDICRAFT+IT1+1.0 DSD through the «SDMX Datamanager» web application

Acess to the SDMX Datamanager Username: admin Password: admin

Import of the DSD In the «Manager Structure» interface of the «Builder» section, click on the «Import Structure» button. In the pop-up window, click on the «Add File» button, select the HANDICRAFT+IT1+1.0, containing the DSD and the referenced artefacts, and click on the «Upload» button.

Primary hypercube creation In the «Manager Structure» interface of the «Builder» section: select the HANDICRAFT+IT1+1.0 DSD (that has to be final) Click on the «Select Category» button and in the popup window select the «Enterprises» category

Primary hypercube creation 3. Fill in the «Datacube unique code» textbox the HANDICR code 4. Click on the «Add Name» button, and in the popup windows fill in the italian and english name of the hypercube: Handicraft enterprises of the Lombardia region

Primary hypercube creation Select the conditional Attributes to be included in the hypercube structure (Dimensions and mandatory Attributes are selected as a default) and click on the «Create Datacube»

Primary hypercube creation

Csv data upload on the primary hypercube through the «SDMX Datamanager» web application

Mapping of the csv data structure The columns of the csv file must be mapped against the data structure of the hypercube in order to allow the data import.

Mapping of the csv data structure : steps In the «Manager mapping» interface of the «Builder» section, click on the «New MappingSet» button. Select the hypercube to be mapped: BL_HANDICR

Mapping of the csv data structure : steps 3. Select the csv file to be mapped: ASR_LOMB_1602.csv

Mapping of the csv data structure : steps 4. Perform the mapping: 5. Save mapping

Load the csv data file 1. In the «Data import» interface of the «Loader» section, select the mapping previously created: 2. Select the file to be uploaded:ASR_LOMB_1602.csv

Load the csv data file 3. Upload the file by clicking on the button «Upload» 4. Preview the data to be imported

Load the csv data file 5. Click on the «Import button» 6. At the end of the «Import» task, the system returns a report indicating the state of the upload (successful or not) and the eventual issues with the indication of the affected records

Load the csv data file 7. View the imported records in the «Manager structure» interface of the Builder section, by clicking on the «Cube Details» button

Definition and publication of the Dataflows/views to be disseminated through the ««SDMX Datamanager» web application

Hypercubes to be disseminated Starting from the primary hypercube («Handicraft enterprises of Lombardia region»), have to be disseminated in SDMX format and via web service the following hypercubes, without performing any duplication of data in the definition of the hypercubes: Handicraft enterprises active, by section of economic activity, Lombardia region. Handicraft enterprises active, by juridical form , Lombardia region. Demography of handicraft enterprises; birth and death rates , Lombardia region.

SDMX Dissemination though the ISTAT’s SDMX Datamanager and the SDMX-RI’s NsiWebService SDMX Datamanager has been developed by ISTAT using standard SDMX libraries provided by Eurostat (SdmxSource.NET) In order to provide the data through the SDMX web service are automatically generated by the Datamanager SDMX mappings of the local data structures (DDB hypercubes) against the DSDs referenced by the published dataflows that are derived by the DSD through which as been generated the primary cube

Definition of the Dataflows Under the «Enterprises» category, have to be created the following dataflows: Dataflow Id Dataflow name (en) HANDICR_SEZNACE Handicraft enterprises active, by section of economic activity, Lombardia region HANDICR_FGIUR Handicraft enterprises active, by juridical form , Lombardia region HANDICR_MOVIMPR Demography of handicraft enterprises; birth and death rates , Lombardia region.

Dataflow creation of HANDICR_SEZNACE In the «Query builder» section, click on the «New Cube View» button:

Dataflow creation of HANDICR_SEZNACE 2. In the «Dataflow» tab, insert the following information:

Dataflow creation of HANDICR_SEZNACE 3. In the «Query» tab, select the BL_HANDICR hypercube 4. Select the following cube columns:

Dataflow creation of HANDICR_SEZNACE 5. insert the following filter conditions:

Dataflow creation of HANDICR_SEZNACE 6. Query preview:

Dataflow creation of HANDICR_SEZNACE 7. Dataflow categorization: 8. Save Dataflow by clicking on the «Save View» button

Dataflow creation of HANDICR_SEZNACE 6. View in the list and Set in production:

Put in production Dataflow/Views From the Dataflow/Views list, click on Then insert eventually header information about sender and/or receiver for the selected dataflow

Dataflow HANDICR_SEZNACE in production

Dataflow creation of HANDICR_FGIUR

Dataflow creation of HANDICR_FGIUR Selected cube columns:

Dataflow creation of HANDICR_FGIUR Filter conditions:

Dataflow creation of HANDICR_MOVIMPR

Dataflow creation of HANDICR_MOVIMPR Selected cube columns:

Dataflow creation of HANDICR_MOVIMPR Filter conditions:

Dataflow creation List of created dataflows:

Browse the SDMX WEB Service content (the created dataflows) through the Eurostat’s NSI Client

Eurostat’s NSI Client data browsing Selection of a dataflow (HANDICR_FGIUR) and dimension filtering:

Eurostat’s NSI Client data browsing Tabular view of selected data

Browse the SDMX Web Service content (the created dataflows) through the ISTAT’s SDMX Data Browser

ISTAT’s Data Browser Selection of a dataflow (HANDICR_FGIUR) and dimension filtering:

ISTAT’s Data Browser Tabular view of selected data