CMIP6-DICAD – FU Berlin - Germany Christopher Kadow and Thomas Schartner I. Kirchner and U. Ulbrich Visualisation of ESMValTool results with FREVA as part of the CMIP6-DICAD project Christopher Kadow ESMVal @ Munich November, 15th 2016

Motivation 2/13 website: www-miklip.dkrz.de | visitor-login: Click on ‚guest?‘ -> Login

Freva - Freie Univ Evaluation System 3/13 Freva - Freie Univ Evaluation System Agenda: 1. What is ? 2. Cooperation in CMIP6-DICAD between ESMVal and Freva to bring pictures to the community 3. Freva as a platform to support ESMVal developer and validation producers to interact with each other and data producers

Freva - Freie Univ Evaluation System 3/13 Freva - Freie Univ Evaluation System Agenda: Usability & Flexibility Data Access Plugin Transparency & Reproducibility

Usability & Flexibility Plugin Transparency & Reproducibility 3/13 Usability & Flexibility Plugin Transparency & Reproducibility Data Access

www-miklip.dkrz.de Shell and Web 4/13 HPC running at “German Climate Computing Centre“ with access to ESGF > 5 million datasets Shell and Web ssh USER@miklip.dkrz.de module load miklip-ces freva --plugin freva --history freva --databrowser www-miklip.dkrz.de Plugins History Data-Browser Usability & Flexibility Plugin Transparency & Reproducibility Data Access

MiKlip uses CMOR & access several ESGF standards 5/13 MiKlip uses CMOR & access several ESGF standards SOLR Apache Indexing the different standards Usability & Flexibility Plugin Transparency & Reproducibility Data Access Host a search tool using CMOR options Support developers in process this data

Every analysis is saved and can be rerun Freva Usability & Flexibility Plugin Transparency & Reproducibility Data Access 6/13 MySQL Database Every analysis is saved and can be rerun Can be shared among scienists GIT Versioning Every tool and system version is saved to the analysis!

Featured Recommendations Usability & Flexibility Plugin Transparency & Reproducibility Data Access 7/13 Featured Recommendations Inspired by your browsing history Saving CPU time, I/O and disk space!

Freva Transparency & Reproducibility Usability & Flexibility 8/13 3 example tools to show Plugin developers how2plugin via different scripts Plugin users how2use the evaluation system ADVANTAGES: No specific programming language requested No need to know all the code environments Freva Usability & Flexibility Plugin Transparency & Reproducibility Data Access freva --plugin MoviePlotter input=/path/2/tas_Amon_MPI-ESM-LR_decadal2000_r1i1p1_2003.nc outputdir=./ from evaluation_system.api import plugin class MoviePlotter(plugin.PluginAbstract): __short_description__ = "Plots 2D lon/lat movies in GIF format" __version__ = (0,0,1) __config_metadict__ = plugin.metadict(compact_creation=True, input =(None, dict(type=str, mandatory=True, help=' File to be plotted')), outputdir =(None, dict(type=str, mandatory=True, help='default output dir'))) def runTool(self, config_dict=None): input = config_dict['input'] outputdir=config_dict[‘outputdir’] result= self.call('%s/movie_plotter.sh %s %s' % (self.getClassBaseDir(),input,outputdir)) MoviePlotter PCA DiffPlotter NCL ./movie_plotter.sh /path/2/INPUT /path/2/OUTPUT C++ Python

Usability & Flexibility Plugin Transparency & Reproducibility 9/13 Usability & Flexibility Plugin Transparency & Reproducibility Data Access

A standardized data and application system for evaluation… 10/13 A standardized data and application system for evaluation… Usability & Flexibility Plugin Transparency & Reproducibility Data Access … of climate model forecasts, hindcasts and projections

2. Cooperation in CMIP6-DICAD between ESMVal and Freva to bring pictures to the community 11/13 Step: Bring ESMVal and Freva to life at the DKRZ Step: Support ESMVal: getting and adding data Shell data-browser as efficient local help

2. Cooperation in CMIP6-DICAD between ESMVal and Freva to bring pictures to the community 11/13 Step: Bring ESMVal and Freva to life at the DKRZ Step: Support ESMVal: getting and adding data Shell data-browser as efficient local help Step: Connect both via quasi-interface DLR describes the meta-data to the output FUB writes plugin to collect pictures, data, and meta-data *Discuss real connectivity to establish a real system

3. Freva as a platform to support ESMVal developer and validation producers to interact with each other and the data producers 12/13 COMMUNITY COMMUNITY CMIP6 @ DKRZ FREVA Data browser ESMVal FREVA WEB META DATA RESULTS

3. Freva as a platform to support ESMVal developer and validation producers to interact with each other and the data producers 12/13

3. Freva as a platform to support ESMVal developer and validation producers to interact with each other and the data producers 12/13 COMMUNITY COMMUNITY CMIP6 @ DKRZ FREVA Data browser ESMVal FREVA WEB Outside META DATA RESULTS

3. Freva as a platform to support ESMVal developer and validation producers to interact with each other and the data producers 13/13 Freva platform allows ESMVal producers to keep track … with CMIP6 data and its revisions … with their results in every development stage … comments and discussions from the community Main Task of FUB in CMIP6 DICAD: Provision of Freva as a platform for the community at DKRZ Improve the annotation system to be a full discussion forum Annotations of every result, picture, and comments Improve sharability, incorparate into annotation system Maintain and extent availability of ESMVal results for developers, community, and beyond in a step by step approach Christopher Kadow ESMVal @ Munich November, 15th 2016

Summary of Freva Freie Univ Evaluation Framework Standardized data & applications Usability & Flexibility Transparency & Reproducibility Resource Management Application Potential Major Projects & Big Institutions More Informations @ DKRZ www-miklip.dkrz.de CMIP6 DICAD More Informations @ FU-Berlin freva.klimod.de vast.klimod.de Christopher Kadow ESMVal @ Munich November, 15th 2016