1. Lesley Wyborn and Stuart Girvan Geoscience Australia, pmd*CRC ACHIEVING PRACTICAL CROSS- JURISDICTIONAL INTEROPERABILITY FOR THE AUSTRALIAN MINING INDUSTRY Australian Government Geoscience Australia

2. PPDM Australian Data Management Conference 2004 Geoscience Australia Outline of Presentation This presentation is about the Australian AUSindustry ‘Interoperability for Geospatial Data Project’ Our presentation will be based on the OpenGIS ® Reference Model We will discuss: o what were the drivers for this project o which pieces of the standard service orientated architecture were developed o whether other communities and domains can use our results We will elaborate on what were the most important lessons learnt

3. PPDM Australian Data Management Conference 2004 Geoscience Australia Interoperability for Geospatial Data Project: Acknowledgements People o Simon Cox, Rob Woodcock, Joan Esterle – CSIRO o Stuart Girvan – Predictive Mineral Discovery CRC o Tim Mackey, Aaron Sedgmen – Geoscience Australia o Rob Atkinson, Peter Barrs – Social Change Online Funding Organisations (~$250K cash) o AUSIndustry o pmd*CRC o Minerals Council of Australia o Geoscience Australia o Every State and Territory Geoscience Agency

4. PPDM Australian Data Management Conference 2004 Geoscience Australia OpenGIS ® Reference Model Enterprise Viewpoint Engineering Viewpoint Information Viewpoint Computational Viewpoint Technology Viewpoint Business drivers, policies Who else is doing it? What technology do we use? What language are we speaking? What components & Interfaces? Source http://www.opengeospatial.org/specshttp://www.opengeospatial.org/specs Who does what?

5. PPDM Australian Data Management Conference 2004 Geoscience Australia Key Driver: Minerals Exploration Action Agenda – June 2004 Industry input highlighted problems in gaining access to pre-competitive geoscience information. described existing information as commonly incomplete and fragmented across eight government agencies, each with its own information management systems and structures. noted that the disparate systems lead to inefficiencies causing higher costs, reduced effectiveness and increased risk incurred by the industry and its service providers

6. PPDM Australian Data Management Conference 2004 Geoscience Australia Key Driver: Minerals Exploration Action Agenda – June 2004 Key Initiative o Australian Government, State and Territory geoscience agencies, professional associations and industry to cooperatively develop and implement nation-wide protocols, standards and systems that provide internet-based access to, and effective storage and archiving of, industry and government exploration-related DATA Recommended actions o Implement web-based services for on-line access o Develop and endorse a plan for implementation of an Australian Earth Science Grid

7. Client has to down load and then locally merge each file into single data set The Geoscience Portal is an index of websites To merge common data types from all surveys either 1. All data sets are downloaded from each source and then combined or 2. All data are combined into a single data set and hosted by one source: currency of data is a major issue NSW databases Victorian Databases Queensland Databases Tasmanian databases NT Databases GA Databases WA Databases SA Databases

8. PPDM Australian Data Management Conference 2004 Geoscience Australia Global Driver: the exponentially increasing digital world Therefore : No long do data, programs and computer grunt have to be local We need to switch to a distributed culture, ie an interoperable culture where data, programs and computer grunt are ‘operable’ regardless of where they are housed Moore’s Law vs. storage improvements vs. optical improvements. Graph from Scientific American (Jan-2001) by Cleo Vilett, source Vined Khoslan, Kleiner, Caufield and Perkins.

9. PPDM Australian Data Management Conference 2004 Geoscience Australia Evolution of the Internet Source: http://www.dstc.edu.au/Tech_Transfer/Events/Canberra/web_services_cnb02.pdf People Content Application

10. PPDM Australian Data Management Conference 2004 Geoscience Australia Multiple overlaid maps One GetMap request: Web Map Service (WMS) can access multiple maps Borders Elevation Cloud cover Cities Source: Reed, C., 2004. Data Integration and Interoperability: ISO/OGC Standards for Geo-Information http://www.directionsmag.com/article.php?article_id=687 http://www.directionsmag.com/article.php?article_id=687

11. PPDM Australian Data Management Conference 2004 Geoscience Australia WMS GetMap returns a server’s “dumb” JPEG, GIF or PNG representation of the data on the server. It does NOT return the actual data, only a bitmap of the data. WMS can’t “give data away.” Roma Source: Reed, C., 2004. Data Integration and Interoperability: ISO/OGC Standards for Geo-Information http://www.directionsmag.com/article.php?article_id=687 http://www.directionsmag.com/article.php?article_id=687

12. PPDM Australian Data Management Conference 2004 Geoscience Australia Web Feature Server GetFeature request: Feature & attribute data Web Feature Service (WFS) returns data. I-95 I-295 I-87 Source: Reed, C., 2004. Data Integration and Interoperability: ISO/OGC Standards for Geo-Information http://www.directionsmag.com/article.php?article_id=687 http://www.directionsmag.com/article.php?article_id=687

13. PPDM Australian Data Management Conference 2004 Geoscience Australia Multiple thematic data layers GetFeature request: Web Feature Service (WFS) gets operable feature data from multiple servers Cities Borders Elevation Each layer is data, not merely a view: Country is: Name: Italy Population: 57,500,000 Area: 301,325 sq km... Source: Reed, C., 2004. Data Integration and Interoperability: ISO/OGC Standards for Geo-Information http://www.directionsmag.com/article.php?article_id=687 http://www.directionsmag.com/article.php?article_id=687

14. PPDM Australian Data Management Conference 2004 Geoscience Australia Why seek funding from the AUSIndustry Innovation Access Program (IAccP) AUSIndustry is part of the Department of Industry, Tourism and Resources The goal of the IAccP is to promote innovation and competitiveness by improving Australian access to global, leading-edge research and technologies and facilitate their uptake by Australian firms, particularly by SME’s and researchers. The IAccP is a technology diffusion program

15. PPDM Australian Data Management Conference 2004 Geoscience Australia External links – who else is doing it? This project provides a mechanism to understand and share practice with other domains Australian: o ASIBA Spatial Interoperability Demonstration Project (SIDP) o Australian Spatial Data Infrastructure (ASDI) o Australian Earth and Ocean Network (AEON) o Australia Partnership for Advanced Computing (APAC) o National Oceans Office (NOO) o Australian Antarctic Division (AAD) International o GEON (Geoscience Network) - US o NERC Datagrid (UK National Environmental Research Council) o IUGS CGI (International Union of Geological Sciences)

16. PPDM Australian Data Management Conference 2004 Geoscience Australia Policy Issues for our Project Pricing and Charging o For both Commonwealth, State and Territory Geoscience Agencies, all data are free over the internet o Thus we did not have to build charging into our project Managing Intellectual Property o Easy to put data source and request for client to acknowledge into data set o Acknowledgement of the data source at the destination is difficult to enforce Copyright and licensing o Source Agency still maintains copyright o They still need to know who is using it o How this is done is a global issue o Geoscience Australia is participating in the OGC project on Digital Rights Management (DRM)

17. PPDM Australian Data Management Conference 2004 Geoscience Australia OpenGIS ® Reference Model Enterprise Viewpoint Engineering Viewpoint Information Viewpoint Computational Viewpoint Technology Viewpoint Who does what? Business drivers, policies Who else is doing it? What technology do we use? What language are we speaking? What components & Interfaces? Source http://www.opengeospatial.org/specshttp://www.opengeospatial.org/specs

18. PPDM Australian Data Management Conference 2004 Geoscience Australia Computational Viewpoint: Standard Web Services Architecture Services Registry Client Applications publish bind find Data Access Services Model Management Services Processing Services

19. Computational Viewpoint: Notional Architecture Services Data Access Services Registry Client Applications Model Management Services Features Coverages Models Real-time data publish bind find Ontology Service Metadata Persistent Bindings Feature Type Catalog Dataset Metadata Processing Services

20. PPDM Australian Data Management Conference 2004 Geoscience Australia Computational Viewpoint: our simplified architecture of components and interfaces Services Registry Client Applications publish bind find Data Access Services For our demonstrator we are 1.not using registries to find or publish services 2.focusing on delivering data as operable ‘features’ 3.hard wiring the applications to the data services Model Management Services Processing Services

21. PPDM Australian Data Management Conference 2004 Geoscience Australia Computational Viewpoint: registries & catalogues Services Registry Client Applications publish bind find Data Access Services NOO, QLD NRE, WA DLI, SEEGRID These people are developing/thinking about developing registries and catalogues in Australia

22. PPDM Australian Data Management Conference 2004 Geoscience Australia Services WMS Coord. Transf. Service Coverage Portrayal Service Data Services Portrayal Services Processing Services Archives WFS WCS SCS GeocodingChaining Gazetteer This Project/ SEEGrid ASIBA CANRI WA DLI QLD NRE GA etc WA DLI GA Data Access Services Who else is doing what in OZ in the Computational Viewpoint Portrayal Services Processing Services

23. PPDM Australian Data Management Conference 2004 Geoscience Australia Our Computational Viewpoint of Components and Interfaces Services Client Applications bind Data Access Services This project is focusing on Data Access Services and on binding these to client applications

24. PPDM Australian Data Management Conference 2004 Geoscience Australia Main International Standards used in Project OGC Services o Web Feature Service (WFS) o Web Map Service (WMS) OGC Languages o Geography Markup Language (GML) o eXploration and Mining Markup Language (XMML) W3C Languages o eXtensible Markup Language (XML) W3C Web services o Simple Object Access Protocol (SOAP)

25. PPDM Australian Data Management Conference 2004 Geoscience Australia OpenGIS ® Reference Model Enterprise Viewpoint Engineering Viewpoint Information Viewpoint Computational Viewpoint Technology Viewpoint Business drivers, policies Who else is doing it? What technology do we use? What language are we speaking? What components & Interfaces? Source http://www.opengeospatial.org/specshttp://www.opengeospatial.org/specs Who does what?

26. PPDM Australian Data Management Conference 2004 Geoscience Australia Who is doing what in Australia in language standards to enable data binding Encodings GML XIMA SLD Service Capabilities SensorMLObs&Meas Image Metadata CSIRO SEEGRID OGC Services Client Applications bind Data Access Services

27. PPDM Australian Data Management Conference 2004 Geoscience Australia Traditional GIS data models for Geosceince do not allow the same data to be viewed seamlessly in 2D, 3D, 4D Data are in points, lines and polygons Geometry-centric abstraction relates to the implementation, not the business object One shape per feature does not allow multiple spatial properties, scale-dependent versions … Tenement

28. PPDM Australian Data Management Conference 2004 Geoscience Australia Information Viewpoint in the OZ Geosciences Borehole  collar location  shape  collar diameter  length  operator  logs  related observations  … Fault  shape  surface trace  displacement  age  … Ore-body  commodity  deposit type  host formation  shape (point, polygon, 3D shell)  resource estimate  … Observation  location  subject/specimen/station  property/theme/measurand  method  operator  date/time  result (+ type/reference system/scale/classification)  … We use ‘feature’ models which: o are based on geological concepts o allow for multiple geometries in 2D, 3D, and 4D Basin  formations  shape – time dependent  resource estimate  …

29. PPDM Australian Data Management Conference 2004 Geoscience Australia OpenGIS ® Reference Model Enterprise Viewpoint Engineering Viewpoint Information Viewpoint Computational Viewpoint Technology Viewpoint Who does what? Business drivers, policies Who else is doing it? What technology do we use? What language are we speaking? What components & Interfaces? Source http://www.opengeospatial.org/specshttp://www.opengeospatial.org/specs

30. PPDM Australian Data Management Conference 2004 Geoscience Australia SEEGrid Community Engineering Viewpoint Our Project’s Focus SEEGrid is helping to coordinate the building of an interconnected distributed modelling and computational services, whereby the models as well as the input data and modelling programs are preserved in a model library

31. PPDM Australian Data Management Conference 2004 Geoscience Australia Our project’s Engineering Viewpoint Services Client Applications bind Data Access Services

32. PPDM Australian Data Management Conference 2004 Geoscience Australia Bind Our projects Engineering Viewpoint in Detail (who engineered what?) WA Geochemistry Feature Data Source SA Web Feature Service (WFS) Client Applications GA Geochemistry Feature Data Source SA Geochemistry Feature Data Source WA Web Feature Service (WFS) GA Web Feature Service (WFS) South Australia Western Australia Gescience Australia pmd*CRC, GA, CSIRO, Social Change On-line

33. PPDM Australian Data Management Conference 2004 Geoscience Australia OpenGIS ® Reference Model Enterprise Viewpoint Engineering Viewpoint Information Viewpoint Computational Viewpoint Technology Viewpoint Business drivers, policies Who else is doing it? What technology do we use? What language are we speaking? What components & Interfaces? Source http://www.opengeospatial.org/specshttp://www.opengeospatial.org/specs Who does what?

34. PPDM Australian Data Management Conference 2004 Geoscience Australia Our Project’s Technology Viewpoint: what technology do we use? Services Client Applications bind Data Access Services

35. PPDM Australian Data Management Conference 2004 Geoscience Australia Bind XMML, GML Our projects Technology Viewpoint in Detail Client Applications Geoserver (Open Source) PostGIS (OpenSource) Web Map Composer (Proprietary) GA Reporting Application GA PLOT-IT Application South Australia Western Australia Geoscience Australia WA Web Feature Service (WFS) SA Web Feature Service (WFS) GA Web Feature Service (WFS) GA Geochemistry Feature Data Source Oracle ( Proprietary) PostGIS (Open Source) SA Geochemistry Feature Data Source WA Geochemistry Feature Data Source

36. PPDM Australian Data Management Conference 2004 Geoscience Australia Our Technology for distributing data We used Geoserver – open source Needed modification to be able to o Source data from complex database (many tables of data) o Produce complex application schemas (ie more complex than simple GML such as XMML) Other WFS software*: o Degree (open source), Cadcorp SIS Map Server, CARIS Spatial Fusion Enterprise, RedSpider Web 3.0, Map Manager, GenaWare, SclFeatureServer, JCarnacGIS, GeoMedia WebMap, MapXtreme (MapInfo), MapServer(UMN) 4.2 + more o We do not know if any of these can do complex mapping * Source: OGC Registered ProductsOGC Registered Products

37. PPDM Australian Data Management Conference 2004 Geoscience Australia Client has to down load and then locally merge each file into a single data set The Geoscience Portal is an index of websites To merge common data types from all surveys either 1. All data sets are downloaded from each source and then combined or 2. All data are combined into a single data set and hosted by one source: currency of data is a major issue NSW databases Victorian Databases Queensland Databases Tasmania databases NT Databases GA Databases WA Databases SA Databases

38. GA Databases WA Databases SA Databases Many other data types besides geochem!!! Project results: the Geoscience Portal will now have these wfs components to enable access of SA, WA, GA geochem data in real time via common interfaces each participant to develop their database to suit their business needs Chem WA Geochem Interface SA Geochem Interface GA Geochem Interface NSW databases Victorian Databases Queensland Databases Tasmania databases Northern Territory Databases wfs interfaces still needed for these Surveys

39. PPDM Australian Data Management Conference 2004 Geoscience Australia Information Viewpoint requires the most work Enterprise Viewpoint Engineering Viewpoint Information Viewpoint Computational Viewpoint Technology Viewpoint Business drivers, policies Who else is doing it? What technology do we use? What language are we speaking? What components & Interfaces? Source http://www.opengeospatial.org/specshttp://www.opengeospatial.org/specs Who does what?

40. PPDM Australian Data Management Conference 2004 Geoscience Australia XMML schema’s developed by CSIRO Borehole Observation (OGC SensorWeb) Gravity measurement Geochemistry/Assay result Geological material Geological timescale Mineral occurrence Procedure, Project, Station, Specimen, Tenement Point, Curve, Surface, Solid volume with properties Structural geology Time-series Finite element model (FLAC, FastFlo) Simulation/model state implemented but only for WA, SA and GA

41. PPDM Australian Data Management Conference 2004 Geoscience Australia Who is the XMML Community? The XMML community led by CSIRO is one of the most advanced globally – why? The XMML community has been going since 2000 Data types within each domain have different communities For XMML o For locations community is global – this led to GML3 o For Geochemistry metadata, community is the Australian Mining industry This illustrates the complexity of developing community schema There is no national or international coordinating agency

42. Introducing the Solid Earth and Environmental Grid (SEEGrid) Community languages http:www.seegrid.csiro.au

43. PPDM Australian Data Management Conference 2004 Geoscience Australia Community pages

44. PPDM Australian Data Management Conference 2004 Geoscience Australia Lesson’s learnt: Business Issues Interoperability represents perhaps the most significant paradigm shift in how data and information are managed and utilised since the emergence of the Internet The Interoperable world is a Markedly Different Business Paradigm: change is from ‘supply’ to ‘demand’ o In the supply or ‘push’ paradigm, suppliers push their content to clients, how they think their clients want to utilise that content o In the demand or user ‘pull’ paradigm clients access and use what data and information they require, from any data supplier that can supply authoritative data in the appropriate standardised formats. For the Interoperable paradigm, data suppliers must be able to map their content word for word to international standard interfaces. Source: Williams, Neil, 2004. Interoperability – responding to National Drivers. http://www.osdm.gov.au/osdm/docs/resources/osdm_interoperability_con_03112004/neilwilliams1.pdf http://www.osdm.gov.au/osdm/docs/resources/osdm_interoperability_con_03112004/neilwilliams1.pdf

45. PPDM Australian Data Management Conference 2004 Geoscience Australia Lesson’s learnt: Impacts on Business Business process o Workflow and versioning control are critical o Archiving dynamically changing data is an issue As clients get very large data sets, statistically valid data mining is a reality o Much more detailed metadata will be required for machine to machine transfer (SensorML in particular) o Errors are more likely to be picked up o Need for, and administration of, organisation-wide QA/QC will be a major impact

46. PPDM Australian Data Management Conference 2004 Geoscience Australia Key Take Home Messages Cross jurisdictional interoperability has been achieved in the geoscience community (almost) by standards based interfaces The final project release will be in March at the SEEGrid 2 workshop in Canberra – please come The greatest amount of work still needs to be done on the XML data models (application schemas) used in any data system within and between communities The ability of technology and specifications to deal with data models that realistically reflect the complexities of real world geoscience from the technical perspective Effective global governance for dividing the complexities of the real world into manageable pieces for effective data modelling is required and will help mitigate the above Track our progress (or better still join us) on http://www.seegrid.csiro.au http://www.pmdcrc.com.au/ http://geoserver.sourceforge.net http://www.seegrid.csiro.au http://www.pmdcrc.com.au/ http://geoserver.sourceforge.net