May 9, 2007Astro-RG, OGF201 Japanese Virtual Observatory and NaReGi Masatoshi Ohishi / NAOJ, Sokendai & NII /, &

May 9, 2007Astro-RG, OGF20 2 Supported by JSPS, Core to Core Program MEXT, Kakenhi NII, CSI project NAOJ

May 9, 2007Astro-RG, OGF20 3 Accessible from anywhere at any time Even for educational use Accelerate astronomical research, and sufficient time for research itself !! Virtual Observatory Too hard to collect and analyze whole data. Need Cats help Nobeyam Radio Obs. SUBARU telescope ALMA Data Rate ~ 1 TB/yr ~ 20 TB/yr ~ 1 PB/yr

May 9, 2007Astro-RG, OGF20 4 SkyNode 1.0 SDSSQSO …2MASS Portal P. Reg. S. Reg. LDAP SkyNode SIAP/SSAP Analysis Servers MDS P. Reg. User Storage Web Service HTTP Get FTP LDAP Other VOs User Request Invoke Service Discovery Auth. Metadata Harvesting JVO Subaru Grid System Registry Data Service Overview of the JVO Portal Service

May 9, 2007Astro-RG, OGF20 5 MAG_B Log(F_IR)

May 9, 2007Astro-RG, OGF20 6 Spectral Data from Subaru queries display Baseline estimate Line detection VOSpec High Dispersion Spectrometer

May 9, 2007Astro-RG, OGF20 7 Interconnected VO Data services in the World Canada VO More than 600 data resources are available

May 9, 2007Astro-RG, OGF20 8 Improvement of Work Flow system Items in FY2006 Improvement of WFDL –Shorten the volume of DL –Array definition –Awk-like description (loop description in a single line) –and so on Built-in functions –Available to register and use built-in functions Status and Log system WF Editor Execution monitor

May 9, 2007Astro-RG, OGF20 9 SkyNode 1.0 SDSSQSO …2MASS Portal P. Reg. S. Reg. LDAP SkyNode SIAP/SSAP Analysis Servers MDS P. Reg. User Storage Web Service HTTP Get FTP LDAP Other VOs User Request Invoke Service Discovery Auth. Metadata Harvesting JVO Subaru Grid System Registry Data Service Overview of the JVO Portal Service

May 9, 2007Astro-RG, OGF20 10 Subaru Grid Pipeline Arch. Data Storage Service Data Analysis Service MDS Server Data Search Service 3. query a location of data 2. submit a job 1. search an available server 4. get data report status query status 7. retrieve the result 5. result URL 6. Submit data transfer job Client

May 9, 2007Astro-RG, OGF20 11 Grid Service on VO Subaru data reduction pipeline system –Web service based GRID –Generates calibration data (Super-Flat) for all the SuprimeCam data in a week –On-the-fly data reduction with the pre-prepared Super-Flat –Users can access to the data reduced with the most recent algorithm –Also support the older version of pipeline Backend computing system of the JVO –catalog generation –photo-z calculation –Image arithmetic –…

May 9, 2007Astro-RG, OGF20 12 – Reduction 10s (Bias+Flat+Distortion+ Astrometory) – Transfer 30s Data Reduction: ~24 hours ~1 hour

May 9, 2007Astro-RG, OGF20 13 Study on Environment around QSOs Present Past

May 9, 2007Astro-RG, OGF2014 Cyber Science Infrastructure toward Petascale Computing (planned ) Cyber-Science Infrastructure IT Infra. for Academic Research and Education) Operation/ Maintenance Middleware Networking Contents NII Collaborative Operation Center Delivyer Delivery Networking Infrastructure (Super-SINET/SINET3 Univ./National Supercomputing VO Domain Specific VOs Feedback R&D Collaboration Operaontional Collaborati Middleware CA NAREGI Site Research Dev. βver. V1.0 V2.0 International Collaboration - EGEE - UNIGRIDS -Teragrid -GGF etc. Feedback Delivery Project- Oriented VO Delivery Domain Specific VOs Customization Operation/Maintenance Nano Proof of al.Concept Eval. IMS Nano Proof, Eval. IMS Joint Project Bio Osaka-U Joint Project AIST R&D Collaboration Industrial Projects Project-oriented VO Note: names of VO are tentative Peta-scale System VO Core Site R&D Collaboration Operation/ Maintenance UPKI,CA IMS,AIST,KEK,NAO,etc.

May 9, 2007Astro-RG, OGF20 15 Introduction of the NaReGi middleware into JVO NaReGi middleware version Trial introduction into the Subaru Grid pipeline –A part of middleware deployment program by the NII To evaluate how easy it is to use the middleware To find which components may be used for Virtual Observatories –SSO, Apps interface, and so on

May 9, 2007Astro-RG, OGF20 16 NAREGI Grid environment Registration of User Applications Generation of WF Issue CAs Keep proxy certif. Computation Node Job monitor at each site Job monitor at each node Monitor Job Execution Display Information Find Computation Resources Job Scheduling Data Flow

May 9, 2007Astro-RG, OGF20 17 Requests to Improve Items to be improved toward version 1.0 –Make it easier to install –Make it much faster to install –Need to support OSs other than RHEL –and so on These requests were reflected to the modified road map of NaReGi.

May 9, 2007Astro-RG, OGF20 18 Good Findings Good Graphical WF builder –Plan to import to the JVO system –Maybe referred to by the IVOA