1 ESMF. May 2003 PRISM Data and Visualisation Data formats and Processing Toolkit Low End Visualisation High End Visualisation Prepared by: Ros Hatcher - Met Office Karin Meier-Fleischer- MPI-Met Gabriella de Martino- KNMI Presented by Luis Kornblueh (MPI-Met)

2 ESMF. May 2003 File Format & Processing Library NetCDF - File format for data exchange CF convention - Metadata standard COCO - Processing Library

3 ESMF. May 2003

4 ESMF. May 2003 Data Processing COCO (CDMS Overloaded for CF Objects)  Extension to CDMS (Climate Data Management System)  Written predominately in Python with some C  Dynamically typed - ease of use for scientists  Reads & Manipulates netCDF(CF) data  A single object contains both data and its metadata. The data and metadata is processed simultaneously. Functionalities have been prioritised. Top 10 include: Averaging, Arithmetic ops., Information, Conversion to new grid, Statistical ops., Extraction of region and slices, Sampling, Gather, Masking, Tests and confidence intervals.

5 ESMF. May 2003

6 ESMF. May 2003 Graphics Package Review Important criteria for the Low End graphics: Yes yesYesVTK With minor effort NoProprietaryYesOpenDX Yes CDAT/VCS YesNo PartialFerret YesNo GrADS DODS and LAS support CDMS/COCO Integration scripting language like Python Unstructured/ irregular grids netCDF-CF should be opened and read by a function inside the COCO library, similar to cdms.open(file name) in CDMS.

7 ESMF. May 2003 Software architecture diagram main Python program local browser of the user Web-based GUI (WP4b) and/or LAS fixed set of functions, could be changed by the user plot graphics to output file browser User Interface data DODS / LASPrepIFS/SMS maindefaults projection linear, mollweide,.. graphics method Isoline, isofill, boxfill,... maskingsub-regions plot to file GIF, PS, EPS,.. server

8 ESMF. May 2003 CDAT/VCS example script: w=vcs.init() w.open() w.setcolormap('default') if MESH==1: m=w.createmeshfill('new') m.mesh=MESH m.wrap=[0,360] m.projection=PROJECTION ls=vcs.mkscale(MIN,MAX,nc=NCOLS) ls.insert(0,1E20) ls.append(1E20) m.levels=ls m.fillareacolors=vcs.getcolors(ls) #-- Get new slab. slab = fdat(VAR, longitude=(LON0,LON1), latitude=(LAT0,LAT1)) slab = slab.subRegion( squeeze=1 ) print 'set region' if slab.rank()==3: slab=slab(slice(0,1),squeeze=1) elif slab.rank()==4: slab=slab(slice(0,1),slice(0,1),squeeze=1) if MESH==1: # print '**** M.shape = ',M.shape, 'slab.shape = ',slab.shape for i in range(2): for j in range(4): HOPE-E ORCA

9 ESMF. May 2003 Graphical packages review for the High-End Yes No Yes No Yes 3D interactive Yes No Yes No Yes No Yes Unstructured/ irregular grid Active YesVTK Active YesVIS5D+ Active YesVISAD Very active YesOpen DX Not very active YesNCAR Graphics Active NoIDL Not very active YesGrADS Active NoAVS Supporting community Open Source  Features and capabilities of a set of graphical packages has been examined.  Some key characteristics are:

10 ESMF. May 2003 OpenDX: from a network to an interactive image

11 ESMF. May 2003 VTK: the scripting approach