1. Metadata Store Management Platform GE Fabrizio Verroca, Roberto Pagnin Telecom Italia WP1.3, FIWARE – WI DATA-55 Sprint 4.1.2 fabrizio.verroca@telecomitalia.it, roberto.pagnin@telecomitalia.it fabrizio.verroca@telecomitalia.itroberto.pagnin@telecomitalia.it

2. Metadata Store GE Metadata Store GE will allow a smooth approach to a Big Data platform decoupling from technical usage issues, maintaining platform objects descriptors enabling complex processing flows and controlling the access to the data and data APIs by the authorized users, keeping accounting of the data consumption and supporting its publication. Services BI aaS Apps Objects Dataset Algorithm Process Dashboard API Metadata store GE enable the ease of use Big Data Portal

3. Which objects are described in Metadata Store GE? User Dataset Algorithm Dashboard API Process Application Everything that a User can use, publish, buy, in the FiWare Big Data environment, can be managed as an object and can be described into the Metadata Store. An object can be private and owned by user owner Or An object can be public, owned by user owner and buyed by one or more users. The Metadata Store GE maintains the relation between user and his objects.

4. Metadata Store GE The Metadata store management platform describes the objects used by GEs such as BigData, Context Broker, Data Store and others. Possible object types are: Datasets, Algorithms, API, Dashboard, Apps, Process... It is composed by: Metadata Access Layer (via ws) Metadata Repository:is the container of metadata describing the objects of the platform (syntax and semantics) Metadata Repository Metadata Access layer

5. Publish Dataset (>CKAN size limits)in the CKAN Store Big Data Portal Metadata Store GE CKAN GE Big Data GE Auth access Objects List Request Objects List Response Dataset Details Request Dataset Details Response Dataset Selection Publish Dataset Enable Dataset for Publishing Add metadata on Dataset Add Sample on Dataset

6. Publish Results in the CKAN Store Big Data Portal Metadata Store GE CKAN GE Big Data GE Auth access Objects List Request Objects List Response Process Details Request Process Details Response Process Selection Process Start Create new dataset object descriptor Publish dataset result Upload dataset on CKAN (only if < CKAN size linit)

7. Publish Algorithm/Process in the CKAN Store Big Data Portal Metadata Store GE CKAN GE Big Data GE Auth access Objects List Request Objects List Response Algorithm Details Request Algorithm Details Response Algorithm Selection Publish Algorithm Enable Algorithm for Publishing Add metadata on Algorithm

8. Retrieving a dataset from CKAN in Big Data Big Data Portal Metadata Store GE CKAN GE Big Data GE Objects List Response Select Open Data dataset Auth access Objects List Request Download metadata Download open Data dataset Analysis on own private, purchased and open datasets

9. Thanks!