DIAS & DIAS data release 2 years DIAS-GCI Cooperation Hiroko KINUTANI DIAS (Data Integration and Analysis System in Japan) 2016-11-07, St. Petersburg

DIAS Introduction (Movie) Please download the movie separately

DIAS: Overview The DAIS is archived big amount of miscellaneous environmental data. Those data are analyzed and integrated to provide useful information for solving environmental problems, such as climate change, natural disasters.

DIAS: Structure

3 Functions: 1. Collect data, Store data, Release data 2 3 Functions: 1.Collect data, Store data, Release data 2.Analysis space 3.Cooperation with various research fields for implementing the outcome of research projects R&D Community Climate, Weather, Water, Agriculture, Biodiversity, Urban, Economics, Health Registered 2,000 person Application Development for Data Archiving, earching, Processing and Analyzing Storage, Server, Network Infrastructure

DIAS: Case Study

Data Cleansing, QC & metadata registration by Data Provider

Metadata about dataset : Document-metadata DIAS Metadata Adopt the XML metadata used in geographic information system ISO19115 (ISO19139) Metadata about dataset : Document-metadata For the purpose of search for and comparison of dataset The granule of dataset is coarse, in general, and is decided after discussion with data provider Files which include both data and metadata (such as those in netCDF) are not included in our target datasets. Once metadata is created, Document-metadata is automatically generated in HTML, PDF. Data providers have to publish datasets with Document-metadata.

Architecture of DIAS Metadata System DIAS Metadata Management System OAI-PMH Other metadata portals in Japan Metadata DIAS Search System ISO 19139 Registration of dataset metadata Metadata created by DIAS MMS DIAS metadata view Metadata imported from other metadata portals Original metadata page of each system http://search.diasjp.net/en/ DIF EML

Keyword input boxes specification of ontologies (GCMD_science, GCMD_platform, GEOSS, AGU, Country, others) selection of hierarchical keywords from menu

DIAS Metadata Management System A Web Application The system manage the registered metadata at the server side. Metadata input person using this system does not need to be aware of the XML. This system create one metadata (Japanese, English) per dataset. The system has minimum required fields specified by the metadata schema, and recommended fields by the DIAS. The system reduce manual input fields as much as possible. The system avoid duplication input against language-independent input fields. Templates:　Reference of previous created metadata and reuse Copy-and-paste of contact information The system does not display the automatically generating metadata fields. The category specification field is controlled by the selection menu. The system has the thesaurus dictionaries for supporting the user to input keywords. The system manage data revision history and manage update history of the metadata.

The Workshop for DIAS metadata input The contents of metadata cannot know except the data provider. We have held the workshop about DIAS metadata input in order to understand what kind of information should be inputted for each field of metadata. The workshop has held 2 or 3 times a year.

Management of Data Access Privilege Access to and search for Document-metadata is open to public Data Access Restrictions: Login account is required Free access Agreement with data policy is required Approval from data administrator is required Require manual procedure for approval Prepare an application form, assist on automatic email and so on. Others / special treatment Contact with data administrator by email or other media. If an application is approved, the user account is granted permission. The system provides UI for data administrator to change the access privilege for individual user account.

DIAS registered user statistics

DIAS-GCI Cooperation DIAS published data is searchable and accessible from GEOSS Portal GCI: GEOSS Common Infrastructure Export of DIAS metadata http://www.geoportal.org/

DIAS data release status GCI-DAB metadata harvest

DOI registration plan for DIAS data https://japanlinkcenter.org/ Until the end of FY2016, we have a plan to register a few DOIs to JaLC (Japan Link Center). Add a new function to DIAS metadata management system to manage DOIs. Add DOI in each DIAS document-metadata (XML, HTML, PDF) Convert DIAS metadata xml to JaLC xml to register DOI to DataCite through JaLC Create a new DOI registration system from DIAS to JaLC

Thank you ! DIAS Web Site http://www.diasjp.net/en/ Hiroko KINUTANI kinutani@tkl.iis.u-tokyo.ac.jp