1. CMIP6-DICAD – FU Berlin - Germany
Christopher Kadow and Thomas Schartner
I. Kirchner and U. Ulbrich
Visualisation of ESMValTool results with FREVA
as part of the CMIP6-DICAD project
Christopher Kadow Munich November, 15th 2016

2. Motivation
2/13
website: www-miklip.dkrz.de | visitor-login: Click on ‚guest?‘ -> Login

3. Freva - Freie Univ Evaluation System
3/13
Freva - Freie Univ Evaluation System
Agenda:
1. What is ?
2. Cooperation in CMIP6-DICAD
between ESMVal and Freva to bring pictures to the community
3. Freva as a platform to support ESMVal developer and validation producers to interact with each other and data producers

4. Freva - Freie Univ Evaluation System
3/13
Freva - Freie Univ Evaluation System
Agenda:
Usability & Flexibility
Data Access
Plugin
Transparency & Reproducibility

5. Usability & Flexibility Plugin Transparency & Reproducibility
3/13
Usability & Flexibility
Plugin
Transparency & Reproducibility
Data Access

6. www-miklip.dkrz.de Shell and Web
4/13
HPC running at “German Climate Computing Centre“ with access to ESGF
> 5 million datasets
Shell
and
Web
ssh
module load miklip-ces
freva --plugin
freva --history
freva --databrowser
www-miklip.dkrz.de
Plugins
History
Data-Browser
Usability & Flexibility
Plugin
Transparency & Reproducibility
Data Access

7. MiKlip uses CMOR & access several ESGF standards
5/13
MiKlip uses CMOR & access several ESGF standards
SOLR Apache
Indexing the different standards
Usability & Flexibility
Plugin
Transparency & Reproducibility
Data Access
Host a search tool using CMOR options
Support developers in process this data

8. Every analysis is saved and can be rerun
Freva
Usability & Flexibility
Plugin
Transparency & Reproducibility
Data Access
6/13
MySQL Database
Every analysis is saved and can be rerun
Can be shared among scienists
GIT Versioning
Every tool and system version is saved to the analysis!

9. Featured Recommendations
Usability & Flexibility
Plugin
Transparency & Reproducibility
Data Access
7/13
Featured Recommendations
Inspired by your
browsing history
Saving CPU time,
I/O and disk space!

10. Freva Transparency & Reproducibility Usability & Flexibility
8/13
3 example tools to show
Plugin developers
how2plugin via different scripts
Plugin users
how2use the evaluation system
ADVANTAGES:
No specific programming language requested
No need to know all the code environments
Freva
Usability & Flexibility
Plugin
Transparency & Reproducibility
Data Access
freva --plugin MoviePlotter input=/path/2/tas_Amon_MPI-ESM-LR_decadal2000_r1i1p1_2003.nc outputdir=./
from evaluation_system.api import plugin
class MoviePlotter(plugin.PluginAbstract):
__short_description__ = "Plots 2D lon/lat movies in GIF format"
__version__ = (0,0,1)
__config_metadict__ = plugin.metadict(compact_creation=True,
input =(None, dict(type=str, mandatory=True, help=' File to be plotted')),
outputdir =(None, dict(type=str, mandatory=True, help='default output dir')))
def runTool(self, config_dict=None):
input = config_dict['input']
outputdir=config_dict[‘outputdir’]
result= self.call('%s/movie_plotter.sh %s %s' % (self.getClassBaseDir(),input,outputdir))
MoviePlotter
PCA
DiffPlotter
NCL
./movie_plotter.sh /path/2/INPUT /path/2/OUTPUT
C++
Python

11. Usability & Flexibility Plugin Transparency & Reproducibility
9/13
Usability & Flexibility
Plugin
Transparency & Reproducibility
Data Access

12. A standardized data and application system for evaluation…
10/13
A standardized data and application system for evaluation…
Usability & Flexibility
Plugin
Transparency & Reproducibility
Data Access
… of climate model forecasts, hindcasts and projections

13. 2. Cooperation in CMIP6-DICAD
between ESMVal and Freva to bring pictures to the community
11/13
Step: Bring ESMVal and Freva to life at the DKRZ
Step: Support ESMVal: getting and adding data
Shell data-browser as efficient local help

14. 2. Cooperation in CMIP6-DICAD
between ESMVal and Freva to bring pictures to the community
11/13
Step: Bring ESMVal and Freva to life at the DKRZ
Step: Support ESMVal: getting and adding data
Shell data-browser as efficient local help
Step: Connect both via quasi-interface
DLR describes the meta-data to the output
FUB writes plugin to collect pictures, data, and meta-data
*Discuss real connectivity to establish a real system

15. 3. Freva as a platform to support ESMVal
developer and validation producers to interact
with each other and the data producers
12/13
COMMUNITY
COMMUNITY
CMIP6 @
DKRZ
FREVA
Data
browser
ESMVal
FREVA
WEB
META DATA
RESULTS

16. 3. Freva as a platform to support ESMVal
developer and validation producers to interact
with each other and the data producers
12/13

17. 3. Freva as a platform to support ESMVal
developer and validation producers to interact
with each other and the data producers
12/13
COMMUNITY
COMMUNITY
CMIP6 @
DKRZ
FREVA
Data
browser
ESMVal
FREVA
WEB
Outside
META DATA
RESULTS

18. 3. Freva as a platform to support ESMVal
developer and validation producers to interact
with each other and the data producers
13/13
Freva platform allows ESMVal producers to keep track
… with CMIP6 data and its revisions
… with their results in every development stage
… comments and discussions from the community
Main Task of FUB in CMIP6 DICAD:
Provision of Freva as a platform for the community at DKRZ
Improve the annotation system to be a full discussion forum
Annotations of every result, picture, and comments
Improve sharability, incorparate into annotation system
Maintain and extent availability of ESMVal results for
developers, community, and beyond
in a step by step approach
Christopher Kadow Munich November, 15th 2016

19. Summary of Freva Freie Univ Evaluation Framework
Standardized data & applications
Usability & Flexibility
Transparency & Reproducibility
Resource Management
Application Potential
Major Projects & Big Institutions
More DKRZ
www-miklip.dkrz.de
CMIP6 DICAD
More FU-Berlin
freva.klimod.de
vast.klimod.de
Christopher Kadow Munich November, 15th 2016