Presentation is loading. Please wait.

Presentation is loading. Please wait.

May 9, 2007Astro-RG, OGF201 Japanese Virtual Observatory and NaReGi Masatoshi Ohishi / NAOJ, Sokendai & NII /, &

Similar presentations


Presentation on theme: "May 9, 2007Astro-RG, OGF201 Japanese Virtual Observatory and NaReGi Masatoshi Ohishi / NAOJ, Sokendai & NII /, &"— Presentation transcript:

1 May 9, 2007Astro-RG, OGF201 Japanese Virtual Observatory and NaReGi Masatoshi Ohishi / NAOJ, Sokendai & NII /, & masatoshi.ohishi@nao.ac.jp

2 May 9, 2007Astro-RG, OGF20 2 Supported by JSPS, Core to Core Program MEXT, Kakenhi NII, CSI project NAOJ

3 May 9, 2007Astro-RG, OGF20 3 Accessible from anywhere at any time Even for educational use Accelerate astronomical research, and sufficient time for research itself !! Virtual Observatory Too hard to collect and analyze whole data. Need Cats help Nobeyam Radio Obs. SUBARU telescope ALMA Data Rate ~ 1 TB/yr ~ 20 TB/yr ~ 1 PB/yr

4 May 9, 2007Astro-RG, OGF20 4 SkyNode 1.0 SDSSQSO …2MASS Portal P. Reg. S. Reg. LDAP SkyNode 0.7.4 SIAP/SSAP Analysis Servers MDS P. Reg. User Storage Web Service HTTP Get FTP LDAP Other VOs User Request Invoke Service Discovery Auth. Metadata Harvesting JVO Subaru Grid System Registry Data Service Overview of the JVO Portal Service

5 May 9, 2007Astro-RG, OGF20 5 MAG_B Log(F_IR)

6 May 9, 2007Astro-RG, OGF20 6 Spectral Data from Subaru queries display Baseline estimate Line detection VOSpec High Dispersion Spectrometer

7 May 9, 2007Astro-RG, OGF20 7 Interconnected VO Data services in the World Canada VO More than 600 data resources are available

8 May 9, 2007Astro-RG, OGF20 8 Improvement of Work Flow system Items in FY2006 Improvement of WFDL –Shorten the volume of DL –Array definition –Awk-like description (loop description in a single line) –and so on Built-in functions –Available to register and use built-in functions Status and Log system WF Editor Execution monitor

9 May 9, 2007Astro-RG, OGF20 9 SkyNode 1.0 SDSSQSO …2MASS Portal P. Reg. S. Reg. LDAP SkyNode 0.7.4 SIAP/SSAP Analysis Servers MDS P. Reg. User Storage Web Service HTTP Get FTP LDAP Other VOs User Request Invoke Service Discovery Auth. Metadata Harvesting JVO Subaru Grid System Registry Data Service Overview of the JVO Portal Service

10 May 9, 2007Astro-RG, OGF20 10 Subaru Grid Pipeline Arch. Data Storage Service Data Analysis Service MDS Server Data Search Service 3. query a location of data 2. submit a job 1. search an available server 4. get data report status query status 7. retrieve the result 5. result URL 6. Submit data transfer job Client

11 May 9, 2007Astro-RG, OGF20 11 Grid Service on VO Subaru data reduction pipeline system –Web service based GRID –Generates calibration data (Super-Flat) for all the SuprimeCam data in a week –On-the-fly data reduction with the pre-prepared Super-Flat –Users can access to the data reduced with the most recent algorithm –Also support the older version of pipeline Backend computing system of the JVO –catalog generation –photo-z calculation –Image arithmetic –…

12 May 9, 2007Astro-RG, OGF20 12 – Reduction 10s (Bias+Flat+Distortion+ Astrometory) – Transfer 30s Data Reduction: ~24 hours ~1 hour

13 May 9, 2007Astro-RG, OGF20 13 Study on Environment around QSOs Present Past

14 May 9, 2007Astro-RG, OGF2014 Cyber Science Infrastructure toward Petascale Computing (planned 2006-2011) Cyber-Science Infrastructure IT Infra. for Academic Research and Education) Operation/ Maintenance Middleware Networking Contents NII Collaborative Operation Center Delivyer Delivery Networking Infrastructure (Super-SINET/SINET3 Univ./National Supercomputing VO Domain Specific VOs Feedback R&D Collaboration Operaontional Collaborati Middleware CA NAREGI Site Research Dev. βver. V1.0 V2.0 International Collaboration - EGEE - UNIGRIDS -Teragrid -GGF etc. Feedback Delivery Project- Oriented VO Delivery Domain Specific VOs Customization Operation/Maintenance Nano Proof of al.Concept Eval. IMS Nano Proof, Eval. IMS Joint Project Bio Osaka-U Joint Project AIST R&D Collaboration Industrial Projects Project-oriented VO Note: names of VO are tentative Peta-scale System VO Core Site R&D Collaboration Operation/ Maintenance UPKI,CA IMS,AIST,KEK,NAO,etc.

15 May 9, 2007Astro-RG, OGF20 15 Introduction of the NaReGi middleware into JVO NaReGi middleware version 1.0.2 Trial introduction into the Subaru Grid pipeline –A part of middleware deployment program by the NII To evaluate how easy it is to use the middleware To find which components may be used for Virtual Observatories –SSO, Apps interface, and so on

16 May 9, 2007Astro-RG, OGF20 16 NAREGI Grid environment Registration of User Applications Generation of WF Issue CAs Keep proxy certif. Computation Node Job monitor at each site Job monitor at each node Monitor Job Execution Display Information Find Computation Resources Job Scheduling Data Flow

17 May 9, 2007Astro-RG, OGF20 17 Requests to Improve Items to be improved toward version 1.0 –Make it easier to install –Make it much faster to install –Need to support OSs other than RHEL –and so on These requests were reflected to the modified road map of NaReGi.

18 May 9, 2007Astro-RG, OGF20 18 Good Findings Good Graphical WF builder –Plan to import to the JVO system –Maybe referred to by the IVOA


Download ppt "May 9, 2007Astro-RG, OGF201 Japanese Virtual Observatory and NaReGi Masatoshi Ohishi / NAOJ, Sokendai & NII /, &"

Similar presentations


Ads by Google