1. Monetize your APIs and Datasets or Make Them Available as Open Data

2. Agenda 1.Open Data Open Data in FIWARE Lab 2.CKAN Providing Data  Creating a dataset  Publish the Dataset in the WStore  Increase Data Value Consuming Data  Search  Acquisition  APIs 3.Hands On 2

3. anyone free to use, reuse, and redistribute it “A piece of data or content is open if anyone is free to use, reuse, and redistribute it — subject only, at most, to the requirement to attribute and/or share-alike.” [http://opendefinition.org/#sthash.6ieidzit.dpuf] Sergio García Gómez 3

4. Open Data implies often hidden costs – Lack of quality – Insufficient documentation – Unstructured information – Limited amount of information All data cannot be open – Conflicting interests – Security 4

5. Data Data is the fuel that enables, inspires and boosts entrepreneurs, remarkably in Smart Cities. Lab FIWARE Lab offers the environment where all the stakeholders meet together around innovation. FIWARE FIWARE provides the technology to build the entrepreneurs and developers ecosystem. Open Data in FIWARE Lab Sergio García Gómez 5

6. Datasets Existing Datasets (census, geographical, tourism,...) Historic Data (from sensors, events...) Real Time Vertical Systems (mobility, events...) Internet of Things (sensors, Smart meters...) Media Video streams (traffic, surveillance..) Audio (microphones), speaches... Open APIs Data from Smart Cities in FIWARE Lab Sergio García Gómez 6

7. CKAN

8. (Open) Data Platform Search & Discover Data: – Search by keywords – Browse by facets – Explore data with previews & visualization – REST/JSON APIs to access data and metadata Data Management for publishers – Easy store & update of metadata Sergio García Gómez 8

9. FIWARE Lab Instance Integrated with FIWARE Lab IdM (OAuth2) – Users do not need to have different accounts – Users can access the portal without log in to read open data Ability to create private datasets – Accessible only by certain users Ability to publish datasets in the WStore – Manage the users that can access private datasets – Charge users for accessing your data – Ensure that users only access your data under some legal terms – …  https://data.lab.fi-ware.orghttps://data.lab.fi-ware.org 9

10. FIWARE Lab Instance CKANWStore Application Mashup Identity Manager Authenticate user Retrieve data Publish data Notify acquisition Francisco de la Vega Other Applications Retrieve data … Other Applications Retrieve data 10

11. PROVIDER SIDE CKAN/WStore/Application MashUp

12. Entering data (web, files, CKAN API) Harvest data from external repositories (geospatial servers, HTML, CKANs...) Manage the publication process: visibility, organizations, workflows... Publishing and Managing Data Sergio García Gómez 12

13. Publishing and Managing Data Public: Readable by everybody (Open) Private: Readable only by certain users List of users that can read the data URL where the user can acquire rights to read the dataset 13

14. Publishing a Dataset in the WStore is the showcase of FIWARE – Advertise your data for free – Make your data visible to prospective users Manage users that can access your data – Update the list of allowed users automatically Force users to accept some terms to use your data Charge users for accessing your data – Single Payment – Subscription – Pay per use 14

15. Publishing a Dataset in the 15 Open Data can only be sold for free Result: A new offering in the WStore containing a only resource: your dataset

16. Increasing your datasets value MashUp Platform widgets Tables Graphs: linear, pies,… Maps 16

17. Increase your datasets value Sell your datasets together with the Mashup to visualize the data – Add extra value – Ease users the utilization of the information Enable buyers to embed the Mashup in other web pages and increase the benefits – Online Newspapers – Government – Social Networks – … 17

18. Increase your datasets value Attach the visualization MashUp to your offering and add extra value without effort 18

19. CLIENT SIDE CKAN/WStore/Application MashUp

20. Search and query through an API Search by text, facets (tags, format,...) in the portal Search and discovery Sergio García Gómez Search in the WStore 20

21. Acquiring Private Datasets 21

22. APIs Full query/search through a JSON API – Get full datasets meta-information – Create, Update (metadata), Delete datasets and resources CKAN (DataStore plugin) provides APIs for – Inserting, updating and deleting data – Querying data (JSON Filters, SQL, HTSQL) API Key – X-Auth-Token: FIWARE Lab IdM Token (OAuth2) – Authorization: CKAN default token 22

23. APIs: Package Show 23 GET /api/action/package_show?id=european-elections-results-spain HTTP/1.1 Host: data.lab.fi-ware.org { "help": "[...]", "success": true, "result": { "license_title": "...", "maintainer": "", "relationships_as_object": [], "maintainer_email": "", "revision_timestamp": "...", "id": "...", "metadata_created": "...", "metadata_modified": "...", "author": "", "author_email": "", "state": "active", "version": "", "license_id": "notspecified", "type": "dataset", "resources": [ { [...] "state": "active", "description": "...", "format": "CSV", [...], "url_type": "upload", "name": "...", "created": "...", "url": "https://.../dataset/.../resource/.../dow nload/....csv", "webstore_url": null, "mimetype_inner": null, "position": 0, "revision_id": "...", "resource_type": null } ], + tags, group, organization and much more…

24. APIs: DataStore SQL GET /api/action/datastore_search_sql?sql=SELECT * from "3fd9115d-4ccb-4e37- 9418-4a7fe54605b9" HTTP/1.1 Host: data.lab.fi-ware.org 24 { "help": "[...]", "success": true, "result": { "records": [ { "Partido": "P.P.", "Votos": "4074363", "_id": 1, "_full_text": "'p.p':1", "Escanyos": "16" }, { "Partido": "PSOE", "Votos": "3596324", "_id": 2, "_full_text": "'pso':1", "Escanyos": "14" }, […] ] "fields": [ { "type": "int4", "id": "_id" }, { "type": "tsvector", "id": "_full_text" }, { "type": "text", "id": "Partido" }, { "type": "numeric", "id": "Votos" } ], "sql": "..." }

25. APIs: DataStore JSON GET /api/action/datastore_search?resource_id=3fd9115d-4ccb-4e37-9418- 4a7fe54605b9&fields=Partido,Votos HTTP/1.1 Host: data.lab.fi-ware.org 25 { "help": "[...]", "success": true, "result": { "fields": [ { "type": "text", "id": "Partido" }, { "type": "numeric", "id": "Votos" } ], "records": [ { "Partido": "P.P.", "Votos": "4074363" }, { "Partido": "PSOE", "Votos": "3596324" }, { "Partido": "LA IZQUIERDA PLURAL", "Votos": "1562567" }, { "Partido": "PODEMOS", "Votos": "1245948" }, [...] ], [...] } + the number of results, links to the next results,…

26. Visualizing the Dataset in the MashUp Platform 1. Go to Marketplace 2. Click Install 3. Create a workspace based on the template 26

27. 4. Enjoy it! 27

28. HANDS ON Publishing and Consuming Data

29. Thanks!