Metadata Store Management Platform GE Fabrizio Verroca, Roberto Pagnin Telecom Italia WP1.3, FIWARE – WI DATA-55 Sprint 4.1.2

Slides:



Advertisements
Similar presentations
1 Ontolog OOR Use Case Review Todd Schneider 1 April 2010 (v 1.2)
Advertisements

FI-WARE Testbed Access Control temporary solution.
Fi-WARE IoT Architecture Carlos Ralli Ucendo Architecture Week. Madrid, April 3 rd 2013.
© 2012 Cisco and/or its affiliates. All rights reserved. Presentation_ID Cisco Public Quad APIs and SDK Preview Sachin Smotra Product Manger, Enterprise.
Tuomo Vierros, Dream Broker Topic H: Video sharing app for iOS / Android / WP7.
FI-WARE – Future Internet Core Platform FI-WARE Cloud Hosting July 2011 High-level description.
Cloud based linked data platform for Structural Engineering Experiment Xiaohui Zhang
INTERACT : M OTION S ENSOR D RIVEN G ESTURE R ECOGNITION C LOUD S ERVICE School of Electronic & Computer Engineering Technical University of Crete, Greece.
LINKED DATA AS A SERVICE WITH THE INFORMATION WORKBENCH SEMTECHBIZ San Francisco 2012 Peter Haase fluid Operations AG.
Software to Data model Lenos Vacanas, Stelios Sotiriadis, Euripides Petrakis Technical University of Crete (TUC), Greece Workshop.
Interoperability in the Cloud By Alex Espinoza
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
SURENDER SARA 10GAS Building Corporate KPI’s
Agenda Motivation on why a “Business Framework” is relevant in the Future Internet Provide insights into possibilities with the framework Catch a glimpse.
Integrations, APIs, and the introduction of the Library Data Layer IGeLU: September Budapest, Hungary.
FI-WARE NGSI Overview Juanjo Hierro Telefonica Digital, Coordinator and Chief Architect, FI-WARE
SCHOLARONE MANUSCRIPTS ORCID Outreach Meeting – 5/17/12 Chris Heid, Product Manager ScholarOne.
FI-CORE Data Context Media Management Chapter Release 4.1 & Sprint Review.
Mehdi Ghayoumi Kent State University Computer Science Department Summer 2015 Exposition on Cyber Infrastructure and Big Data.
FI-WARE and Open Data Juanjo Hierro – Chief Architect FI-WARE.
frustrated consumer confused content owner world wide web All Web Sites All Web Browsers.
A Service Oriented Architecture for the Finance Case Study
Metadata Store Management Platform GE:architectural notes Fabrizio Verroca, Roberto Pagnin Telecom Italia WP1.3, FIWARE
FCM Workflow using GCM.
TopCAT Use Cases Priorities User Interface 1 ICAT developer workshop, August 2009 Laurent Lerusse – STFC
Query Health Technical WG Update 1/12/2011. Agenda TopicTime Slot Administrative stuff and reminders2:00 – 2:05 pm Specification Updates QRDA HQMF Query.
NSDL Technical Platforms Diagrams. NSDL Collections Technical Platform NSDL.org Library search and browse UI Key Ingest services and tools Repository.
1 Data Architecture Strawman - Grimshaw Important points Everything is a service (object) >All have a name (EPR) and an interface (type) One or more base.
Storing digital assets on Grid/EGI FedCloud with gLibrary Giuseppe La Rocca, INFN DARIAH ERIC.
Linked Open Data for European Earth Observation Products Carlo Matteo Scalzo CTO, Epistematica epistematica.
Excel Services Displays all or parts of interactive Excel worksheets in the browser –Excel “publish” feature with optional parameters defined in worksheet.
Ideas on Opening Up GEOSS Architecture and Extending AIP-5 Wim Hugo SAEON.
Methods of Tracking Position i Pod Touch – Wi-Fi used to find location by detecting known hotspots. iPhone – Cellular triangulation uses the mobile communication.
1 Case Study: Business Intelligence & Customer Data Customer Support Web-based Dashboard VP Marketing SQL XSLT XML Data Grid Customer Data Customer Order.
UNEP Live. What is UNEP Live? - An on-line knowledge management platform - Focuses on open access to global, regional and national data and knowledge.
What if your app could put the power of analytics everywhere decisions are made? Modern apps with data visualizations built-in have the power to inform.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI /04/14 1 EGI Community Forum 2014 Federated Cloud image management Marios.
Welcome Hotmail Customer care Welcome Hotmail Customer care Call Now
The Big Data Network (phase 2) Cloud Hadoop system
REDCap Mobile Application
How to use IoT in Bluemix
ProQuest Ebook Central and SUSHI Harvesting in Alma
Joslynn Lee – Data Science Educator
Cloud based linked data platform for Structural Engineering Experiment
Working with Feature Layers
Enabling Access and Use of EO Data in E&SA John Kiema Director Technical Services, RCMRD June 2017 Sunyani Ghana.
GeoPortal Training Workshop 1st March 2017
Brokering Agreement process Stefano Nativi and Mattia Santoro ESSI-lab of CNR-IIA San Petersburg (Russia), 07 Nov 2016.
VI-SEEM Data Discovery Service
Flanders Marine Institute (VLIZ)
Steering Group Member, Link Digital
WStore integration with other GEris
Solutions for federated services management EGI
Training course on Euro SDMX Registry
Yukon Geomatics: Delivering Yukon’s SDI & Enabling Citizens
BusinessObjects 4.2 SP3 What's new for System Administration in CMC
Device Apps Joseph Ngari| Program Manager.
X-Road as a Platform to Exchange MyData
Future Requirements of WIS Centres
Publishing data and metdata From iRODS to repositories
Metadata The metadata contains
Welcome to SQLSaturday #767! Hosted by Lincoln SQL Server User Group
Quoting and Billing: Commercialization of Big Data Analytics
  The National Data Portal (Register of Registers) 8th April 2019.
Microsoft Azure Data Catalog
Introduction to the SHIWA Simulation Platform EGI User Forum,
Continuous Integration and Delivery (CI/CD) in Azure Data Factory
SDMX Global Conference Francesco Rizzo – ISTAT, Italy
Presentation transcript:

Metadata Store Management Platform GE Fabrizio Verroca, Roberto Pagnin Telecom Italia WP1.3, FIWARE – WI DATA-55 Sprint

Metadata Store GE Metadata Store GE will allow a smooth approach to a Big Data platform decoupling from technical usage issues, maintaining platform objects descriptors enabling complex processing flows and controlling the access to the data and data APIs by the authorized users, keeping accounting of the data consumption and supporting its publication. Services BI aaS Apps Objects Dataset Algorithm Process Dashboard API Metadata store GE enable the ease of use Big Data Portal

Which objects are described in Metadata Store GE? User Dataset Algorithm Dashboard API Process Application Everything that a User can use, publish, buy, in the FiWare Big Data environment, can be managed as an object and can be described into the Metadata Store. An object can be private and owned by user owner Or An object can be public, owned by user owner and buyed by one or more users. The Metadata Store GE maintains the relation between user and his objects.

Metadata Store GE The Metadata store management platform describes the objects used by GEs such as BigData, Context Broker, Data Store and others. Possible object types are: Datasets, Algorithms, API, Dashboard, Apps, Process... It is composed by: Metadata Access Layer (via ws) Metadata Repository:is the container of metadata describing the objects of the platform (syntax and semantics) Metadata Repository Metadata Access layer

Publish Dataset (>CKAN size limits)in the CKAN Store Big Data Portal Metadata Store GE CKAN GE Big Data GE Auth access Objects List Request Objects List Response Dataset Details Request Dataset Details Response Dataset Selection Publish Dataset Enable Dataset for Publishing Add metadata on Dataset Add Sample on Dataset

Publish Results in the CKAN Store Big Data Portal Metadata Store GE CKAN GE Big Data GE Auth access Objects List Request Objects List Response Process Details Request Process Details Response Process Selection Process Start Create new dataset object descriptor Publish dataset result Upload dataset on CKAN (only if < CKAN size linit)

Publish Algorithm/Process in the CKAN Store Big Data Portal Metadata Store GE CKAN GE Big Data GE Auth access Objects List Request Objects List Response Algorithm Details Request Algorithm Details Response Algorithm Selection Publish Algorithm Enable Algorithm for Publishing Add metadata on Algorithm

Retrieving a dataset from CKAN in Big Data Big Data Portal Metadata Store GE CKAN GE Big Data GE Objects List Response Select Open Data dataset Auth access Objects List Request Download metadata Download open Data dataset Analysis on own private, purchased and open datasets

Thanks!