1. Wim Hugo SAEON/ SAEOS SAEOS AND C ROSS -D OMAIN I NTEROPERABILITY : P RACTICAL A PPLICATIONS OF STANDARDS June 2012

2. MANIFESTO It is possible, desirable, and in the public interest to:  Ensure that scientific data is described properly, preserved properly, and discoverable;  Once discovered, its utility, quality, and scope can be understood, even if the data sets are huge;  Once understood; it can be accessed freely and openly;  Once accessed, it can be included into distributed processes, preferably automatically, and on large scales;  Once processed, the knowledge gathered can be re-used. … across multiple domains.

3. Who are the current Stakeholders? B ACKGROUND

4.  SAEON and the CSIR has collaborated on GeoPortal infrastructure since 2004/5.  The list of stakeholders have grown to include DST and several additional smaller initiatives.  SAEOS and SA-GEO are an important facet of the shared infrastructure.  Recent technical developments, which is based on service-oriented architecture, has seen the emergence of loosely integrated components that are ‘glued’ together with open standards interfaces.  This means that many components can be re-used In any system and do not rely on a specific platform to work. BACKGROUND

5. PORTALS AND PLATFORM Spatial Data Other Data Documents and Publications Meta-Data and Data Management Functions Content Visualisation and Presentation Data Analysis and Processing Main Shared Platform Services Portals: Main Stakeholders and Initiatives SAEOS Portal SAEOS Portal NSIF Application NSIF Application SAEON Nodes and Initiatives CSIR GSDI Risk and Vulnerability Atlas World Data Centre for BHH BioEnergy Atlas SAEOS WDC CSIR SAEON RAVA NSIF BEA Meta-Data and Data Services NSIF Portal Data and Meta-Data

6. MetaData Data Standards Automation Mediation C ONTEXT AND C ONCEPTS P ERSPECTIVE OF E ARTH AND E NVIRONMENTAL S CIENCES

7. MAIN USE CASES DISCOVERY AND VISUALISATION The platform is based on a shared and aggregated meta-data repository, and the meta-data repository is capable of accepting and working with a range of well- established meta-data standards. These include Dublin Core, SANS 1878, the ISO 19115 family, EML, and FGDC. The list is likely to be extended from time to time to accommodate other standards in widespread use by a user community or new provider. Harvesters can be used to automate meta-data acquisition from standardised providers.

8. MAIN USE CASES MEDIATION AND COLLATION Mediators are required to tailor (bind) a data source or sources to a process or service. The service can be as simple as a mapping service, and the mediation as rudimentary as renaming the layers to match the context of a map. More advanced mediations define the linkages between distributed data sets, how data should be aggregated for analysis or display purposes, which columns to match to a charting service, and so on. Mediations are stored in ‘Web Context Documents’.

9. MAIN USE CASES AUTOMATED PROCESS CHAINING ? ? Distributed data sources and processes can also be chained together: in such cases, one needs to describe the process in a standardised way for future re-use. This happens already in e- commerce systems, and it is likely that the same standards in use for automation of web commerce will be used in scientific process automation – but the jury is still out on this. Automation and mediation rely greatly on ontologies for their efficient functioning. These are agreed dictionaries of terms, and can automate some of the mediation.

10. MAIN COMPONENTS Data Meta- Data Data www Discovery Meta- Data www “Publish” “Find” “Bind” Visualise Process Assess Mediator Analysis

11. ‘Minimum’ ‘Medium’ ‘Clone’ IMPLEMENTATION OPTIONS Fire Escape

12. MINIMUM IMPLEMENTATION Data: SHP>WMS Meta-Data: Excel>SDP www Discovery S-CS/W www Visualise S-O/L Mediator: WCD Inventory S-CS/W Upload www

13. MEDIUM IMPLEMENTATION Data: GeoServer Meta-Data: SDP www Discovery S-CS/W www Visualise S-O/L Mediator: WCD Inventory S-CS/W Upload www Meta-Data: GeoNetwork www Harvest

14. Examples Interoperability W ALKTHROUGH

15. SAEOS LANDING PAGE Societal Benefit Areas Search for Data

16. TYPICAL SEARCH RESULT (CLIMATE) Summary Meta- Data

17. FILTERING SEARCH RESULTS Filter by Author, Custodian, Date, etc.

18. SEARCH RESULT ANALYSIS Analysing Search Results

19. SPATIAL COVERAGE OF SEARCH RESULTS Analysing Search Results Click to see detail

20. DETAILED META-DATA

21. SEARCH FOR WEB MAP SERVICES WMS

22. SPATIAL DATA SERVICES Click to see detail

23. PREVIEW OR DOWNLOAD Layers available from service Download formats and options

24. Select appropriate layer

25. MULTIPLE LAYERS/ RASTERS IN SAME SERVICE Note alternative styles

26. SENSOR OBSERVATION SERVICES Click to see detail

27. OBSERVED FEATURES ARE SHOWN Location of sensors

28. CLICK A FEATURE … Latest values for observed phenomena

29. TIME SERIES DATA Select start and end dates

30. EXAMPLES: INTEROPERABILITY  Distributed WxS in OpenLayers Client  Distributed WxS, KML, and GeoRSS in OpenLayers Client  Persist distributed WxS plus others as WCD  SHP/ Raster to SQL/ WxS/ SLD  CS/W Request as Dublin Core  CS/W Request as JSON/Atom to Search Result Presentation  CS/W Request as GeoRSS to OpenLayers Client  CS/W Request integrated with OpenLayers Client  CS/W Request integrated with Desktop Client  Search GUI to any CS/W endpoint  Search GUI to OAI-PMH endpoint  EuroGEOSS Broker Return to Search Presentation  CS/W Request to EuroGEOSS Broker  SOS in Extended OpenLayers Client  NetCDF in Extended OpenLayers Client  HDF-4 in Extended OpenLayers Client  Distributed WFS, NetCDF, and SOS to Charting Services (Google Charts)+ mediation  Citizen Science Module to WFS  Citizen Science to EML and ISO 19115  WPS in Scientific Workflow + mediation

31. MULTIPLE WXS SOURCES Meraka Institute, Pretoria, SA, WMS FAO, Rome, WMS

32. PERSIST WEB CONTEXT DOCUMENTS Load from server storage List of WCDs

33. SUPPORT MULTIPLE DATA STANDARDS WxS GeoRSS Also: KML, NetCDF, HDF-4, SOS

34. DATA UPLOAD, STYLING, AND PUBLICATION

35. META-DATA REPOSITORY Meta-Data Entry Multiple Custodians Multiple Standards

36. SEARCH INTERFACE AND RESULT FORMATS Meta-Data EntryMultiple Formats

37. GEORSS SEARCH PIPED TO MAP CLIENT

38. NON-SPATIAL REPRESENTATIONS OF DATA Data captured by Schools Program directly to WFS Mediated HTTP calls to Google Charts

39. NETCDF INTEGRATION

40. EMBEDDING IN OTHER PLATFORMS

41. I MPORTANT N EXT S TEPS

42.  Identify the achievable ‘Launch’ meta-data set.  Programme to obtain meta-data and data samples.  Consensus on Presentation/ Look and Feel/ Support Materials  Finalise Documentation BEFORE WE LAUNCH SAEOS …

43.  Large Gridded Multidimensional Data Sets  Meraka, MRSU, CSAG, …  Multi-dimensional viewers  Non-spatial Data Representation  Citation Management  Quality Assurance and Usability Statistics PIPELINE

44.  Large Multidimensional/ Gridded Data Collections  CSI and stakeholder engagement/ SA-GEO and NEOSS  Capacity Building, Technology Transfer and ‘SWAT Team’ CHALLENGES