1. Community Earth Science Informatics Initiatives & Their Impacts Lee Allison, Arizona Geological Survey Association of American State Geologists

2. In 5-10 years, if your data are not online in an integrated, interoperable network, you won’t exist. Prediction 200 million+ websites – if you don’t have a website, you don’t exist.

3. 1000’s of National and Regional Databases topographic, orthoimagery, hydrography mineral resources water geochemistry geophysics (aeromag, gravity, aerorad) earthquake catalogs biological surveys vegetation/speciation maps Tower of Babel

4. Conclusions: Growing Consensus for an NGS Goals – interoperable, distributed, Web-service based, synoptic 4-D system Goals – interoperable, distributed, Web-service based, synoptic 4-D system Challenges Challenges Technical – adapting-adopting existing capabilitiesTechnical – adapting-adopting existing capabilities Cultural –organizational – controls, recognitionCultural –organizational – controls, recognition How do we get there? How do we get there? Agreement on standards, protocols, architectureAgreement on standards, protocols, architecture Geological Surveys as data archives, providersGeological Surveys as data archives, providers Parallel community efforts are linkingParallel community efforts are linking Implementation is underwayImplementation is underway Sustainability is an issueSustainability is an issue

5. Current electronic delivery

6. The Goal

7. Most of the technology exists Challenges are cultural and organizational

8. One system to rule them all, one system to find them, one system to bring them all, and in the darkness bind them. With apologies to JRR Tolkien

9. How do we get there? NSF to the Solid Earth Sciences: how do you build a sustainable community system? - 2-year community engagement process underway

10. Earth science cyberinfrastructure Distributed Web-based Interoperable Early paradigm: Central databases for each topic

11. Goal is making data interoperable Ian Jackson, BGS

12. interoperability "The capability to communicate, execute programs, or transfer data among various functional units in a manner that requires the user to have little or no knowledge of the unique characteristics of those units." ISO/IEC 2382-01 (SC36 Secretariat, 2003)

13. Example: the electrical utility Simple interface– put plug in wall, get electricity Simple interface– put plug in wall, get electricity Afghanistan 220 V 50 Hz Andorra 230 V 50 Hz Anguilla 110 V 60 Hz Antigua 230 V* 60 Hz Cayman Islands 120 V 60 Hz Cyprus 240 V 50 Hz Czech Republic 230 V 50 Hz ……

14. Complexity

15. Other complex things

16. National Geoinformatics System “Killer applications” User cases & best practices in meeting stakeholder needs Data discovery, catalogs, inventories, metadata profiles, metadata aggregation service(s) – 4D search engines, Informatics specifications, data model, interoperability, & standards Web portal & Registry development and implementation Accessing & licensing protocols, recognition & credit Community of practice Communication, dissemination, & awareness Ontologies, vocabularies Access to high-resolution spatial geological & applied datasets “Big Iron” – high performance computing Digitization of legacy data Liaison and integration with related groups & initiatives Sustainability

17. Computer printer services Old days Old days Word Processor Spreadsheet HP Driver 2 CalcompDriver 2 Brothers Driver 2 HP Driver 1 CalcompDriver 1 Brothers Driver 1 HP printer Calcomp plotter Brothers printer Each application has driver for each printer Large format inkjet Now Now Word Processor Spreadsheet Printer driver Metafile interpreter Laserwriter Film writer Metafile interpreter Metafile interpreter Printing service, uses Metafile= interchange format Printer driver wrapper service Advantages one driver (wrapper) per application Application need know nothing about printer—separation of concerns

18. Interoperability via web service GA BGS USGS GSC USGS schema BGS hema GA hema GSC hema GA BGS USGS GSC GA BGS NGMDB GSC wrapper Web Services Client Communication between service providers and clients takes place using XML mark up. Use of standard markup language means schema mapping only needs to be done once Participants implement one interface for each service Applications focus on application logic, not data access. Wrapper implements interface to service — formulate requests, interpret results

19. GeoSciML developers GeoServer Keyworth, UK GeoServerCanberra Cocoon Uppalla, Sweden Mapserver Arizona Cocoon Ottawa, Canada GeoServer Melbourne, Australia Cocoon Virginia, USA Ionic Orleans, France Tsukuba, Japan Mark-up language “wrapper” translates your data

20. Using a web service – step 1 GeoSciML Web Services: Request

21. Web service request – step 2

22. GeoSciML Web Services: Response Web service response – part 1

23. Web service response - part 2 GeoSciML Web Services: Response

24. Geoscience Information Network (GIN) ORGANIZATION: Unique missions of geological surveys - collect, archive, disseminate data 2,000 – 3,000 databases 1000’s of collections 80,000+ geologic maps Distributed Web-based Interoperable

25. is distributed (vs centralized)is distributed (vs centralized) is interoperableis interoperable uses open source standards and common protocols (OGC, GeoSciML)uses open source standards and common protocols (OGC, GeoSciML) respects and acknowledges data ownershiprespects and acknowledges data ownership fosters communities of practice to growfosters communities of practice to grow facilitates development of new web services and clientsfacilitates development of new web services and clients We agree on a data network that:

26. System overview GIN

27. Geologic map service scenarioArcGIS Catalog: NGMDB? OneGeology? NDC? GEON? NGDS? OGC CSW ArcMap OGC WMS Survey map servers Registration

28. National Geologic & Geophysical Data Preservation Program -$1M per year -National inventory -Metadata catalogue -National Digital Catalogue

29. 79,000+ maps, images, data, and products from 350+ publishers 79,000+ maps, images, data, and products from 350+ publishers Lexicon of Geologic Names of the United States Lexicon of Geologic Names of the United States Data discovery -

30. Defining GIN collections of service definitions, interchange formats, and vocabularies collections of service definitions, interchange formats, and vocabularies independent of hardware, operating system, or lower- level network protocols independent of hardware, operating system, or lower- level network protocols new technology will only require implementation of network elements in a new environment new technology will only require implementation of network elements in a new environment architecture allows for the use of multiple conventions for different user groups architecture allows for the use of multiple conventions for different user groups

31. WWW GIN http – hypertext transfer protocol (& ftp, etc) http – hypertext transfer protocol (& ftp, etc) html – hypertext mark-up language html – hypertext mark-up language url – universal resource locator url – universal resource locator browser – built by others browser – built by others Open source standards – Open Geospatial Consortium Open source standards – Open Geospatial Consortium data interchange tool – GeoSciML data interchange tool – GeoSciML distributed data catalogues (National Geologic Map DB; National Data Catalogue, etc) distributed data catalogues (National Geologic Map DB; National Data Catalogue, etc) Web services & applications – built by others Web services & applications – built by others

32. Challenges to building community Who sets the standards? Who controls the system? Who makes the decisions?

33. Interoperability The network is voluntary, not imposed from above

34. We won’t take your data away – they stay with you We won’t take your data away – they stay with you Your participation is voluntary Your participation is voluntary Keep your formats, system, servers Keep your formats, system, servers

35. Will 3,000 interoperable data bases become an 800-lb gorilla?

36. GIN is partnering with the global Earth science community AASG & USGS National Geoinformatics System OneGeology-Europe – 21 nations Marine Metadata Interoperability Initiative US DOE National Geothermal Data System (NGDS) US DOE Geothermal Technologies Program Energy Industry Metadata Standards Working Group - Energistics

37. PARTNERS & COLLABORATORS:

38. MS SciScope – geospatial data discovery Welcome to SciScope! SciScope is a tool by Microsoft Research to help geoscientists discover data from numerous data repositories with ease through a single, intuitive interface. Users can display multiple map layers related to the scope of their study and interact with geographical features on the map including dams, rivers, water bodies, geology, aquifer systems, ecological regions and river basins.

39. GIN DEMO PROGRAM NSF INTEROP GIN 3 year development of standards, services 3 year development of standards, services Demos in ~6 SGSs; ~$80K subcontracts Demos in ~6 SGSs; ~$80K subcontracts

40. “Circuit Riders” Part trainer, part management consultant, part computer expert Part trainer, part management consultant, part computer expert Write GeoSciML “wrappers” Write GeoSciML “wrappers” Guide server configurations Guide server configurations Training, short courses Training, short courses $80K for demos across AASG $80K for demos across AASG

42. ADOPTION & DEPLOYMENT US Dept. of Energy (May, 2009) US Dept. of Energy (May, 2009) National Geothermal Data System (NGDS)National Geothermal Data System (NGDS) GIN architecture, standardsGIN architecture, standards $5M, 5 years$5M, 5 years Adopted by US Geothermal Technologies ProgramAdopted by US Geothermal Technologies Program

43. Discovery, access, exchange (GIN) National Geothermal Data System Distributed data sources Legacy data repository Desktop applications (GeoSciNet) Portals (GeoSciNet, SciScope) NGDS Ontologies, vocabularies

44. National Geothermal Data System Data discovery, access, exchange: GIN Data discovery, access, exchange: GIN Distributed content: geothermal community Distributed content: geothermal community Legacy data repository: NGDS Legacy data repository: NGDS Desktop applications (economic modeling tool, etc): GeoSciNet Desktop applications (economic modeling tool, etc): GeoSciNet Portals: GeoSciNet, SciScope Portals: GeoSciNet, SciScope

45. NATIONAL DEPLOYMENT US DOE “Geothermal Data Development, Collection, and Maintenance” US DOE “Geothermal Data Development, Collection, and Maintenance” $20M, 1-5 awards $20M, 1-5 awards AASG proposal submitted AASG proposal submitted

46. 106 nations

49. 29 countries and European organizations are committed to create a geological map at 1:1.000.000 scale, integrated with metadata initially available in the following languages: English, French, Italian, Spanish, Swedish, Czech and Norwegian.

50. Network sustainability tipping point at which users and providers will see the network as critical to their basic functions tipping point at which users and providers will see the network as critical to their basic functions populating and using the network becomes a necessary cost of doing business populating and using the network becomes a necessary cost of doing business how do we maintain network functions? how do we maintain network functions?

51. How do we get there? NSF to the Solid Earth Sciences: how do you build a community system? - 2-year community engagement process underway Geological Surveys as drivers? - USGS, 51 state surveys, 21 European surveys, 106+ nations Linkage with other communities and natural science domains - MMI, OOS, CUAHSI-HIS, Geoscience Australia, iPlant, GBIF, ESIP, Energistics,…..

52. ‘TIPPING POINT’ Energy Industry Metadata Standards Working Group Energy Industry Metadata Standards Working Group End-to-end discovery, access, and exchange of upstream petroleum dataEnd-to-end discovery, access, and exchange of upstream petroleum data

53. 97 members 97 members American Geological Institute (AGI)American Geological Institute (AGI) Baker HughesBaker Hughes BPBP British Geological Survey (BGS)British Geological Survey (BGS) ChevronChevron ConocoPhillipsConocoPhillips Department of Interior (U.S. DOI-BLM-MMS)Department of Interior (U.S. DOI-BLM-MMS) Directorate General of Hydrocarbons (India) (DGH)Directorate General of Hydrocarbons (India) (DGH) ExxonMobilExxonMobil Ground Water Protection CouncilGround Water Protection Council HalliburtonHalliburton IBM CorporationIBM Corporation IFP - Institut Francais du PetroleIFP - Institut Francais du Petrole Norwegian Petroleum Directorate (NPD)Norwegian Petroleum Directorate (NPD) Open Geospatial Consortium (OGC)Open Geospatial Consortium (OGC) Pioneer Natural ResourcesPioneer Natural Resources SAIC-Science Applications Intl. Corp.SAIC-Science Applications Intl. Corp. Saudi AramcoSaudi Aramco SchlumbergerSchlumberger ShellShell Smith InternationalSmith International StatoilHydro ASAStatoilHydro ASA TOTALTOTAL Woodside Energy Inc.Woodside Energy Inc.

54. Geoscience Information Network http://usgin.org