Introduction to the Open Refine RDF tool March 2014 PwC EU Services

Learning objectives By the end of this module, you will have an understanding of:  How to easily describe your solutions using a pre-defined template compliant with ADMS-AP.  How to automatically transform your solutions’ descriptions into machine readable language, i.e., RDF.  How to get your interoperability solutions ready to be shared on Joinup. 2

How can this tutorial help you to use ADMS-AP? This tutorial shows how you can generate ADMS- AP-compliant descriptions of your interoperability solutions from a spreadsheet using the RDF extension in Open Refine.RDF extensionOpen Refine What is the ADMS-AP? The ADMS-AP (Asset Description Metadata Schema – Application Profile for Joinup) allows publishers of interoperability solutions to easily share their description metadata on Joinup using a common vocabulary, and consequently enabling the reuse possibilities of their solutions by a wider audience. “More than 35 repositories from EU Member States, EU Institutions (such as the Publications Office and Eurostat), standardisation bodies (such as W3C, CEN and the DCMI), and EU co- funded initiatives (such as e- CODEX) have shared description metadata of their interoperability solutions on the catalogue on Joinup” For more info about ADMS-AP: ngs/Introduction_to_ADMS-AP.pptx 3

Outline ADMS-AP for describing your interoperability solutions Automatic or manual path to generate ADMS-AP compliant RDF 1. The context Using the spreadsheet Importing into Open Refine Adding the skeleton Exporting 2. The manual path3. A practical example 4

ADMS-AP for describing your interoperability solutions on Joinup ADMS-AP Repository ADMS-AP Repository ADMS-AP Your Repository ADMS-AP Repository Using the ADMS Application Profile Public administrations Academic Standardisation bodies Businesses Explore Find Select Obtain 5

Automatic or manual path to generate ADMS-AP Cleansing with SPARQL Your repository of interoperability solutions Transformation with Open Refine Manual Automatic See how to cleanse RDF with SPARQL: to_metadata_cleansing.pptx 6

Outline ADMS-AP for describing your interoperability solutions Automatic or manual path to generate ADMS-AP compliant RDF 1. The context Using the spreadsheet Importing into Open Refine Adding the skeleton Exporting 2. The manual path3. A practical example 7

This tutorial will describe the 4 steps of the MANUAL path for transforming your interoperability solution’s description into an ADMS-AP-compliant description: 1. Use the spreadsheet template to describe your solution project, releases, packages, etc. 2. Import your spreadsheet in Open Refine 3. Add the pre-defined mappings using the Open Refine RDF extension 4. Export to RDF using the Open Refine RDF extension 8

1. Use the spreadsheet template to describe your solution … getting the template Click on the following link to get the Excel template 9

1. Use the spreadsheet template to describe your solution … understanding the template The spreadsheet template contains all concepts and fields included in the ADMS Application Profile. To describe your solution you have to fill in the different fields of the spreadsheet according to the following colour codes: 10

1. Use the spreadsheet template to describe your solution … some spreadsheets refer to controlled vocabulary The following sheets help you to select the right codes when completing the classes’ fields: Asset_TypeTheme_Taxonomy Publisher_TypeTheme StatusFile_Format License_TypeGeographic_Coverage Representation_TechniqueOperating_System Interoperability_levelUser_Interface_Type LanguageProgramming_Language Example: the field “theme” in the “Asset” sheet has to be in the format “ based on the controlled vocabulary described in the “Theme” sheet. “ 11

2. Import your spreadsheet into Open Refine … getting Open Refine and the RDF extension Download Open Refine from this link Note that Open Refine does not work properly on Internet Explorer Download the RDF extension from this link Install RDF extension into Open Refine following the installation guide 12

2. Import your spreadsheet into Open Refine … creating your project Import the Excel file you completed in step 1 Fill in the following parameters: Create your project 13

3. Add the pre-defined mapping using the Open Refine RDF extension … understanding the RDF skeleton What The Open Refine RDF extension allows you to map the current fields of your data to the required RDF structure by drawing a so-called RDF Skeleton. Why The RDF skeleton specifies how the RDF data will get generated from your own data. The cells in each record of your data will get placed into nodes within the skeleton that conforms to the ADMS-AP. How Even though it is possible to build the RDF Skeleton “manually”, it is easier here to re- apply the operation history that contains all operations required to build the RDF Skeleton from the template. 14

… applying the operations history 1. Click ‘Undo/Redo’ > ‘Apply’ 2. Paste the operation history 3. Click “Perform Operations” 4. Click “RDF” > “Edit RDF Skeleton...” and verify that the RDF Skeleton has been created 3. Add the pre-defined mapping using the Open Refine RDF extension 15

… aligning the RDF schema By clicking on RDF > Edit RDF Skeleton..., you can check/modify the current mapping between your data and the RDF skeleton. 3. Add the pre-defined mapping using the Open Refine RDF extension 16

4. Export to RDF using the Open Refine RDF extension … the final step Now everything is in place to generate an ADMS RDF file, containing your solution’s description. Click “Export” > “RDF in Turtle” to get an RDF description of your solution 17

Outline ADMS-AP for describing your interoperability solutions Automatic and manual path to generate ADMS- AP compliant RDF 1. The context Using the spreadsheet Importing into Open Refine Adding the skeleton Exporting 2. The manual path3. A practical example 18

Practical example … describe your asset CLASSPROPERTYEXAMPLE OF VALUE Asset (models an interoperability solution) AssetURIhttp://myasset.com Theme (controlled voc.) Description Description of the asset Modified Publisher Name The name of the asset Type (controlled voc.) nt Publisher PublisherURI Name The name of the publisher Publisher type label (controlled voc.) National authority Publisher type (controlled voc.) thority Note that for simplifying the example, we only filled up the mandatory classes with their mandatory properties. 19

Practical example … describe your asset Use the template to describe your asset: Asset Publisher 20

Practical example … import your description Import the Asset and Publisher descriptions into Open Refine 21

Practical example … map to the RDF Skeleton Copy/Paste the operation history for building the ADMS-AP RDF Skeleton 22

Practical example … export your RDF description to Turtle or RDF/XML Turtle RDF/XML For more info about RDF: 23

24 Upload your metadata to Joinup How to import and export ADMS-AP conform metadata of interoperability solutions on Joinup The following tutorial helps you uploading your ADMS-AP RDF containing the descriptions of your solutions to Joinup

Related learning resources Introduction to ADMS-AP How to import and export ADMS-AP conform metadata of interoperability solutions on JoinupHow to import and export ADMS-AP conform metadata of interoperability solutions on Joinup Introduction to metadata cleansing using SPARQL Using Joinup as catalogue for interoperability solutions Introduction to the advanced search functionality of EFIR 25

Disclaimers 1.The views expressed in this presentation are purely those of the authors and may not, in any circumstances, be interpreted as stating an official position of the European Commission. The European Commission does not guarantee the accuracy of the information included in this presentation, nor does it accept any responsibility for any use thereof. Reference herein to any specific products, specifications, process, or service by trade name, trademark, manufacturer, or otherwise, does not necessarily constitute or imply its endorsement, recommendation, or favouring by the European Commission. All care has been taken by the author to ensure that s/he has obtained, where necessary, permission to use any parts of manuscripts including illustrations, maps, and graphs, on which intellectual property rights already exist from the titular holder(s) of such rights or from her/his or their legal representative. 2.This presentation has been carefully compiled by PwC, but no representation is made or warranty given (either express or implied) as to the completeness or accuracy of the information it contains. PwC is not liable for the information in this presentation or any decision or consequence based on the use of it. PwC will not be liable for any damages arising from the use of the information contained in this presentation. The information contained in this presentation is of a general nature and is solely for guidance on matters of general interest. This presentation is not a substitute for professional advice on any particular matter. No reader should act on the basis of any matter contained in this publication without considering appropriate professional advice.

on Twitter Join the CISR community on Joinup Project Officer Get involved Visit our initiatives 27 Joinup and ADMS are funded by the ISA ProgrammeISA Programme