1. www.geogrid.org 1 For understanding the earth - Concept and System to integrate Global Earth Observation data - GEO Grid Forum on 5 th TIDES PROGRAM May 18 th, 2007 地球資訊格網論壇 – 台湾如何参与 GEO Grid 発展 Center Director: Satoshi Sekiguchi Team Leader: Satoshi Tsuchida Scientific Researchers: Ryosuke Nakamura, Naotaka Yamamoto, Shinsuke Kodama, Hirokazu Yamamoto, Grid Advisors: Yoshio Tanaka, Isao Kojima

2. www.geogrid.org 2 Contents GEO Grid Objectives and Concept GEO Grid Requirements Data federation Access control (security) Computing Resources Workflow management GEO Grid IT Architecture Sample application scenarios Summary

3. www.geogrid.org 3 Understanding the Earth Understanding the Earth become to be more important. The 10-Year Implementation Plan for GEOSS (Global Earth Observation System of Systems) agreed upon at the Earth Observation Summit The Earth Observation Promotion Strategy of the Council for Technology and Science Policy in Japan. Necessary to integrate Global Earth Observation data for understanding the Earth. The GEO Grid is proposed as an E-Science infrastructure for understanding the Earth.

4. www.geogrid.org 4 What is the GEO Grid ? The GEO (Global Earth Observation) Grid is an E-Infrastructure to accelerate GEO sciences based on the concept that whole data related to earth observation are virtually integrated with a certain access management and easy to handle by the end- users those are enabled by a set of Grid and Web service technologies. Geo* Contents Applications Satellite Data Map Geology GIS data Field data Environment Resources Grid Technologies Grid Technologies Disaster management Disaster management

5. www.geogrid.org 5 Contents GEO Grid Objectives and Concept GEO Grid Requirements Data federation Access control (security) Computing Resources Workflow management GEO Grid IT Architecture Sample application scenarios Summary

6. www.geogrid.org 6 Geo* ContentsIT InfrastructureApplications Satellite Data Map Geology Grid Technologies Resources Grid meets the needs Geo meets the vehicle GIS data Field data Environment It is a little story of the GEO Grid Differences in data format and access method Geographical distribution and ownership issues Ensure the security of resources and data Over incoherent security policies Complex workflow and capacity of resources Computing heterogeneity and Networking unreliability Scalability for larger capacity etc.

7. www.geogrid.org 7 High resolution DEM provided from ASTER In-situ observations by CCOP members Simulation of lava and/or pyroclastic flow on GEO Grid Hazard Map for Evacuation planning Monitoring of crustal deformation by PALSAR A Workflow example “ Disaster prevention and mitigation (Volcano) ” ASTER GEO

8. www.geogrid.org 8 High resolution DEM provided from ASTER Rain fall (AMEDAS/Fieldserver) Large scale Computer simulation using actual landslide DB Early warning system based on Susceptibility map Geology map (GSJ) A Workflow example “ Disaster prevention and mitigation (Landslide) ” ASTER GEO MET

9. www.geogrid.org 9 GEO Grid Contents Software Support Satellite Imagery Geology archives Basic service Web service S/W packaging VO support Full L0 ASTER on disk Japan, SE Asia Security, Resource management, Job, data/storage, information, WSRF/-N GEO Grid full/light MODIS on disk (East Asia) Sensors AsiaFlux, Field server Web GIS, Workflow, U/I Portal User account, Operation support, Cap building

10. www.geogrid.org 10 ① end user (application) ② Project manager ③ Data Provider ④ Op.Support GOC Who is “ users ” of GEO Grid

11. 11 example: Scene search

12. Data Federation for Satellite Imagery ASTER AIST MODIS JP,TH AIST NIES UofT others MODIS @NASA MODIS GEO Grid Meta Data Catalogue ASTERothers Storage File Meta Data Virtual DB 1. simple query 2. Fetch Meta Data info 3. Data Access with appropriate method PALSAR AIST PRISM GSI NIED MODIS JP,TH User A User B User C X WFS access granted WMS access granted Not granted Y http granted Not granted Access Control

13. Contents GEO Grid Objectives and Concept GEO Grid Requirements Data federation Access control (security) Computing Resources Workflow management GEO Grid IT Architecture Sample application scenarios

14. www.geogrid.org 14 Why “ GRID ” ? Data Grid capability large (>100TB) satellite imagery data storage design, networking design loosely couple of a wide variety of geographically distributed data meta data (access method, server location,), ontology, Computing Grid capability on-demand generation of high level data products adopt the most accurate geometric-, radiometric- and atmospheric-correction methods on-the-fly simulation jobs may consume computing resources a “ common ” requirement of computing grid Grid Basic Service compliance with owners ’ access control policy of data/service Grid Security Infrastructure – AuthN, AuthZ, Accounting complex workflow support in portals incl. data access, simulation execution, visualization, etc.

15. 15 FOUR categories of Data Access Attribute ALLMany OPEN CLOSE Cat. 3 Close to Many (Project) Cat. 4 Close to All (Private) Cat. 2 Open to Many (Common) Cat. 1 Open to All (Public)

16. 16 Internet You might need to have like this Private Cat. 1 Public Virtual Organization (VO) enabled by GRID Cat 3 Project/Community Cat 2 Domain Common ASTER Cluster PEN In-Situ local

17. 17 XXX Grid More precisely … PJ owner creates a project VO identify host (common) VO to get help must have VOMS, portal may have DB registry, information service, and policy Common VO provides “ common ” services tools for project VO management Information service at common VO level Data access service with (group) security PJ: Volcano GEO Grid PJ: PEN PJ: Flood BIO Grid HEP Grid ASTERClusterSearch VO registry xx GEO Grid Trust federation VO GEON

18. 18 PJ: Flooding GEO Grid ASTERClusterSearch VO registry login Access with VO’s credential DB 1. Order scenes 2. 3 rd party data xfer to process

19. www.geogrid.org 19 AIST GEO Grid Architecture (IT Infrastructure) Std Web Service I/F incl. basic grid service Data Grid Computing Grid VO hosting services Base Map ASTERMODIS ASTER & MODIS L0 or L1 L1A data will not be in public NASA (USA) AIST DSM/DEM PALSAR MAP on Demand AIST Supercluster (11TFlops) 210TB /P4 3.5TB(raid5)/node x 60C Application hosting engine Interoperable i GEON Disaster prevention EcologyAgriculture Geology GSJ dataGIS data USGS data Field Sensors Applications Overlayable GIS data GML/G-XML/OGC Tiled Wall Display Visualization service gfarm PALSAR AIT (Thailand) Geometric, Radiometric & Atmospheric Correction Mosaic & Composite, Image Processing Tsukuba (Japan) HATOYAMA (Japan) ASTER MODIS PALSAR VO management

20. www.geogrid.org 20 Current Status of GEO Grid Contents Whole imagery of ASTER to date (Apr. 07) MODIS (Japan & Thailand) Geology Maps in WMS (by GSJ, AIST) Services ASTER scene search Typical Applications incl. Volcano, Env. Monitoring IT System H/W (storage & CPU) are ready! Redesigning support Virtual Organization with certain security level tools to implement data owner ’ s policy Data federation with AuthZ

21. www.geogrid.org 21 Plans of GEO Grid Contents global DEM for land with 15m res. (by E of 2007) and PALSAR/ALOS … expected more contributions from partners Services on-demand image processing Grid-aware WMS/WFS/WCS Sample of workflow templates make your own ONE-STOP Service IT System Software packages to enroll data provider, end user, project (VO) manager International Cooperation PRAGMA, OGF, OGC, +IT institutes

22. www.geogrid.org 22 Contents GEO Grid Objectives and Concept GEO Grid Requirements Data federation Access control (security) Computing Resources Workflow management GEO Grid IT Architecture Sample application scenarios Summary

23. www.geogrid.org 23 Available Satellite Data Sensor CharacteristicHigher Level data Original Data ASTER Global DEM generation (stereo pair), Excellent geo-location accuracy, Powerful spectral analysis. ○ JPEG images (Full resolution) 、 Land- cover/Land-use map, Many kinds of Land Surface Map (Seamless DEM ?) △ Only for Research Collaboration MODIS Daily Global observation. VIS-TIR 32bands for ocean, atmosphere and land ○○ PALSAR JERS/SAR Synthetic Aperture Radar ○？○？△？△？ JERS/OPS DEM generation, VIS- SWIR spectral bands ○？○？△？△？

24. www.geogrid.org 24 Available Geological Data (GIS data) Characteristic Web browse WebGISWMSWFS Geological Database on RIO-DB Active fault map, Geochemical Map, and etc. ○ ××× G-INDEX Total index web site for all Geological Data Base in AIST ○○ ？？ GeoMapDB Seamless Geological Map, many kinds of integrated map ○○ ？？

25. www.geogrid.org 25 Available Environmental in-situ Data Characteristi c Web browse WebGISWMSWFS AsiaFlux (AIST operated sites) CO2, H2O, Heat Flux ○ now planning －－ ○?(Text) now planning PEN (Phenological Eyes Network for the validation of Remote Sensing data) Phenology, Atmospheric and Vegetation Parameter, Spectral Information ○ now developing － ○ now planning ○ (Images and Text) now planning

26. www.geogrid.org 26 ASTER : Main content of AIST GEO Grid system ASTER was developed by METI with AIST scientific & engineering supports Global land coverage of Digital Elevation Model of 15m spatial resolution Excellent geo-location accuracy Easy to mosaic (or make a seamless image/DEM) Easy to overlay to GIS data Powerful spectral analysis VNIR 3 bands (+backward 1band)/SWIR 6 bands/TIR 5 bands 2000~

27. www.geogrid.org 27 ASTER DEM (15m spatial resolution) SRTM 90m ASTER 15m Shiretoko, Japan

28. 2000/11/02 2002/07/03 2004/10/28 2006/02/04 Suvarnabnumi Airport ASTER time series 2007/03/11

29. Temporal change of land coverage 2002/12/162004/12/31 ASTER time series

30. Temporal change of land coverage 2002/12/162004/12/31 ASTER time series

31. www.geogrid.org 31 DEM L0 Standard Service Date Region Cloud LATLON ASTERMODISGIS VoCityGUI Scene Search Window

32. www.geogrid.org 32 Details Thumbnails Download

33. www.geogrid.org 33 TILED WALL DISPLAY (VizWall) Mark III TWD に表示された写真 8000 x 4800=(1600x5) x (1200x4) 120km x 72km (resolution15m)

34. 34 AP photo Energy Cone Simulation GEO Grid use case scenario Volcano monitoring Melapi ← ３ D+Temp ASTER

35. 35 火砕流シミュレーションのアプリケーションポータル

36. 36 火砕流 メラピ山オルソ パラメータ設定

37. 37 火砕流 メラピ山オルソ 処理結果

38. 38 GEO Grid use case scenario #2 Environment monitoring with multiple data Daily Global observation by MODIS Link through ASTER high resolution images (Scale up/down for land-cover, cloud contamination, and etc.) ASTER MODIS Satellite TERRA by PEN by BEAMS In-situ data for validation/assimilation Modeled Net Primary Production

39. 39

40. 40

41. 41 TWD に表示された写真 data mashup

42. www.geogrid.org 42 A sample of ASTER DEM image on Tiled Display

43. 43 Contents GEO Grid Objectives and Concept GEO Grid Requirements Data federation Access control (security) Computing Resources Workflow management GEO Grid IT Architecture Sample application scenarios Summary

44. www.geogrid.org 44 Summary GEO Grid is underway: ASTER in storage as primary satellite remote sensing data, also, lessens for future (larger) data As a prototype of E-Science Infrastructure A set of Standard / Interoperable services IT mechanism to compose your own service and workflow Plan to provide software packages to participate from Data provide to End-user GEO Grid is delighted to host “ Sentinel Asia ” virtual organization Your inputs are always valuable

45. www.geogrid.org 45 Possible Collaboration area Grid architecture Overall design of architecture Packaging software Basic grid services info service, data xfer service, portal GUI, workflow Security mechanism implementation VO management Database federation meta data management publish/collect services scene search service Computing grid programming model, job submission, on-demand processing / Geo-ASP GIS Develop grid security-aware OGC (WMS/WFS, … ) Data exchange format (sensors) Applications – early adopters Many, many

46. www.geogrid.org 46