Presentation is loading. Please wait.

Presentation is loading. Please wait.

JAXA GRID Update September 2005 JAXA/EORC Kengo Aizawa KEIO UNIVHiromichi Fukui.

Similar presentations


Presentation on theme: "JAXA GRID Update September 2005 JAXA/EORC Kengo Aizawa KEIO UNIVHiromichi Fukui."— Presentation transcript:

1 JAXA GRID Update September 2005 JAXA/EORC Kengo Aizawa KEIO UNIVHiromichi Fukui

2 Background JAXA and KEIO Univ start to try establishing Digital Asia system In Digital Asia, it required to - semi-real time data processing, analyzing JAXA and Keio Univ had computing GRID experiments as a data processing part.

3 Purpose Accumulate knowledge, know-how to process remote sensing data by GRID Computing. To study technology elements to realize near realtime system on developing Digital Asia.

4 Image processing Geometric rectify process Composit process Raidometric rectify process NDVI process ComputationalGRIDComputationalGRID Trial Area

5 Test Environment Computing Server GLI250m processing program LTSK10_250m Composite LTSK1_250m Radiometric GRID middleware CyberGRIP GLI250m processing program LTSK10_250m Composite LTSK1_250m Radiometric GRID middleware CyberGRIP GigabitEthernet Software System Hardware Management Server categoryserverCPU memo ry OS Managem ent Server PRIMER GY TX200 Xeon 3.06G Hz 2.0GB Linu RedHat ES V3 Computing Server PRIMERG Y BX600 Xeon 3.06GH z 512MB Linu RedHat ES V3 User

6 Computing node Management server Processing program sceine 1 2 11 12 1 2 11 12 1 2 11 12 1 2 11 12 1 2 11 12 Systemwalker CyberGRIP Master Systemwalker CyberGRIP Master Systemwalker CyberGRIP Agent Systemwalker CyberGRIP Agent Systemwalker CyberGRIP Agent Systemwalker CyberGRIP Agent Systemwalker CyberGRIP Agent Systemwalker CyberGRIP Agent Systemwalker CyberGRIP Agent Systemwalker CyberGRIP Agent Processed image [Windows] Windows SV 2003SE/EE Windows 2000 SV/AS/Pro Windows XP Professional [Linux] Red Hat Enterprise Linux AS(v. 3)/ES(v. 3) Red Hat Linux 9 Disk MB memory MB [Windows] Windows SV 2003SE/EE Windows 2000 SV/AS/Pro Windows XP Professional [Linux] Red Hat Enterprise Linux AS(v. 3)/ES(v. 3) Red Hat Linux 9 Disk MB memory MB Red Hat Enterprise Linux AS(v. 3)/ES(v. 3) Disk MB memory MB + User X 13MB) Red Hat Enterprise Linux AS(v. 3)/ES(v. 3) Disk MB memory MB + User X 13MB) Required spec of node Required spec of server Computing GRID Overview image processing image processing Image processing Image processing Image processing Image processing image processing image processing

7

8 Hours -> hours 66% reduction ( + ) × 5 Estimation of scalability 51.94 17.20 0 10 20 30 40 50 60 Non Grid Grid env Processing ours 5 machines

9 200 /11

10 Cyber GRIP Fujitsu is making efforts to standardize to OGSA,JDSL …

11 Next step For semi-realtime data processing Satellite Processing flow Alignment among the process Automatic flow control data Data processing A A X X data preservation data preservation Data GRID Computing GRID Computing GRID Exec multiple job pallarelly Realize by JGES function Realize by OJC function Receiving Station Recording system Data GRID data preservation data preservation

12 Next step management of flow control Geo rectify composit Radio rectify NDVI Parameter file Parameter file Parameter file Processing flow control by OJC dynamic feedback by the results and resubmit jobs Processing flow control by OJC dynamic feedback by the results and resubmit jobs Parameter File Automatic parameter generation Data acquisition or submit job after complete previous job

13 Thank you


Download ppt "JAXA GRID Update September 2005 JAXA/EORC Kengo Aizawa KEIO UNIVHiromichi Fukui."

Similar presentations


Ads by Google