Construction of the Japanese Virtual Observatory (JVO) Abstract : The National Astronomical Observatory of Japan (NAOJ) has been operating several large.

Slides:



Advertisements
Similar presentations
IVOA Interoperablity meeting KyotoMasahiro Tanaka (NAOJ) 1 JVO use of Globus Toolkit Masahiro Tanaka (NAOJ)
Advertisements

LEAD Portal: a TeraGrid Gateway and Application Service Architecture Marcus Christie and Suresh Marru Indiana University LEAD Project (
May 9, 2007Astro-RG, OGF201 Japanese Virtual Observatory and NaReGi Masatoshi Ohishi / NAOJ, Sokendai & NII /, &
Aus-VO Workshop 2003 International Virtual Observatory Alliance effort on Virtual Observatory Query Language Naoki Yasuda (JVO), VOQL WG.
Remote Visualisation System (RVS) By: Anil Chandra.
The Australian Virtual Observatory e-Science Meeting School of Physics, March 2003 David Barnes.
Legacy code support for commercial production Grids G.Terstyanszky, T. Kiss, T. Delaitre, S. Winter School of Informatics, University.
Grid Resource Allocation Management (GRAM) GRAM provides the user to access the grid in order to run, terminate and monitor jobs remotely. The job request.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Design and Implementation of JVO SkyNode Yuji SHIRASAKI National Astronomical Observatory of Japan IVOA Small Projects Meeting, 2004 Oct 1.
SXDS database and Japanese Virtual Observatory Yuji Shirasaki and JVO collaborations National Astronomical Observatory of Japan.
Milos Kobliha Alejandro Cimadevilla Luis de Alba Parallel Computing Seminar GROUP 12.
IT:Network:Applications VIRTUAL DESKTOP INFRASTRUCTURE.
SiS Technical Training Development Track Technical Training(s) Day 1 – Day 2.
Chapter 11 ASP.NET JavaScript, Third Edition. 2 Objectives Learn about client/server architecture Study server-side scripting Create ASP.NET applications.
Globus Computing Infrustructure Software Globus Toolkit 11-2.
February Semantion Privately owned, founded in 2000 First commercial implementation of OASIS ebXML Registry and Repository.
Grid Information Systems. Two grid information problems Two problems  Monitoring  Discovery We can use similar techniques for both.
A long tradition. e-science, Data Centres, and the Virtual Observatory why is e-science important ? what is the structure of the VO ? what then must we.
CPS120: Introduction to Computer Science The World Wide Web Nell Dale John Lewis.
Supported by the National Science Foundation’s Information Technology Research Program under Cooperative Agreement AST with The Johns Hopkins University.
Jaeki Song ISQS6337 JAVA Lecture 16 Other Issues in Java.
The Japanese Virtual Observatory (JVO) Yuji Shirasaki National Astronomical Observatory of Japan.
Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.
Yuji SHIRASAKI National Astronomical Observatory of Japan Current Status of Japanese Virtual Observatory (JVO)
1 INTRODUCTION TO DATABASE MANAGEMENT SYSTEM L E C T U R E
Jan Storage Resource Broker Managing Distributed Data in a Grid A discussion of a paper published by a group of researchers at the San Diego Supercomputer.
POAD Distributed System Case Study: A Medical Informatics System Instructor: Dr. Hany H. Ammar Dept. of Computer Science and Electrical Engineering, WVU.
DISTRIBUTED COMPUTING
EA ARC Ken Tatematsu East-Asian ARC Manager. ARC organization Difference between ARCS: NA: concentrated in Charlottesville Europe: distributed in different.
Prototype system of the Japanese Virtual Observatory The Japanese Virtual Observatory (JVO) aims at providing easy access to federated astronomical databases.
Data GRID Activity in Japan Yoshiyuki WATASE KEK (High energy Accelerator Research Organization) Tsukuba, Japan
JVO JVO Portal Japanese Virtual Observatory (JVO) Prototype 2 Masahiro Tanaka, Yuji Shirasaki, Satoshi Honda, Yoshihiko Mizumoto, Masatoshi Ohishi (NAOJ),
May 10, 2006IVOA-GGF Astro-RG WS1 Welcome and Workshop Goal Masatoshi Ohishi / NAOJ & Sokendai Chairman, IVOA 大石雅寿 / 国立天文台 & 総合研究大学院大学
Database Design and Management CPTG /23/2015Chapter 12 of 38 Functions of a Database Store data Store data School: student records, class schedules,
P Structured Query Language for Virtual Observatory Yuji Shirasaki National Astronomical Observatory of Japan, and Masahiro Tanaka (NAOJ), Satoshi.
1 4/23/2007 Introduction to Grid computing Sunil Avutu Graduate Student Dept.of Computer Science.
1 MSCS 237 Overview of web technologies (A specific type of distributed systems)
IVOA Interoperalibity JVO Query Language Naoki Yasuda (NAOJ/Japanese VO)
February 20, 2006JVO-AstroGrid Collaboration1 Current Status of JVO, and Goal of Collaboration between JVO and AstroGrid Masatoshi Ohishi / NAOJ & Sokendai.
Oct. 1, 2004IVOA Small Projects Meeting1 Development of JVO prototype system and its application to Astrophysics Portal System : M. Tanaka Data Service.
Solar and space physics datasets within a Virtual Observatory: the AstroGrid experience Silvia Dalla * and Nicholas A Walton  * School of Physics & Astronomy,
What is SAM-Grid? Job Handling Data Handling Monitoring and Information.
Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.
State Key Laboratory of Resources and Environmental Information System China Integration of Grid Service and Web Processing Service Gao Ang State Key Laboratory.
2003/03/25天文学会春季年会 JVO の研究開発 (2) 全体進捗 大石雅寿 国立天文台 & 総研大
Progress Report of VOQL WG May 15 (Thu) Masatoshi Ohishi (Japan)
The International Virtual Observatory Alliance (IVOA) interoperability in action.
Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.
May 17, 2005Maria Nieto-Santisteban, JHU / IVOA - Kyoto1 VO JHU Open SkyQuery and more … T. Budavari, S. Carliles, L. Dobos, G. Fekete,
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
2003/11/27CVO Meeting in Beijing Current Status of Japanese Virtual Observatory Masatoshi Ohishi National Astronomical Observatory of Japan and Sokendai.
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
Japanese Virtual Observatory (JVO) National Astronomical Observatory of Japan (NAOJ) Contact Address: Demo 1: GRID-based database federation.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
JVO portal service Yuji Shirasaki National Astronomical Observatory of Japan.
Three color composite image Color-Color diagram SED SED relative to R-band Download FITS Searching for a cosmic string through the gravitational lens effect:
IVOA Small Projects Meeting Application to the science S. Honda, Y. Shirasaki, M. Tanaka and JVO team National Astronomical Observatory of Japan.
2004/03/08Japan-France Grid Computing Workshop in Paris Japanese Virtual Observatory Project Masatoshi Ohishi National Astronomical Observatory of Japan.
Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.
Grid Services for Digital Archive Tao-Sheng Chen Academia Sinica Computing Centre
April 29, 2005ISGC Taipei1 Recent Progress of the Japanese Virtual Observatory Project Masatoshi Ohishi / NAOJ 大石雅寿 / 国立天文台
PHP / MySQL Introduction
University of Technology
May 14 (Wed) Masatoshi Ohishi (Japan)
2018/11/23 An Application for the Data Grid : A Prototype of the Japanese Virtual Observatory System Masatoshi Ohishi National Astronomical Observatory.
Current Status of Japanese Virtual Observatory
2018/11/27 An Application for the Data Grid : A Prototype of the Japanese Virtual Observatory System Masatoshi Ohishi National Astronomical Observatory.
Progress Report of VOQL WG
Google Sky.
Presentation transcript:

Construction of the Japanese Virtual Observatory (JVO) Abstract : The National Astronomical Observatory of Japan (NAOJ) has been operating several large astronomical facilities, such as the SUBARU telescop, the 45 m radio telescope and the Nobeyama Millimeter Array, and plans to construct the ALMA under close collaborations with the US and the EU. Since January 2002, the NAOJ has been connected to the SuperSINET with 10 Gbps, and it has become possible to provide huge amount of observed multi-color data and analyses facilities to other astronomical institutions. Thus we have started the Japanese Virtual Observatory (JVO) project since April JVO utilizes the Grid technology to combine several remote computational facilities. We have completed to define the query language for the JVO, and have been designing on the deployment of JVO components. We plan to construct a JVO-prototype by the end of More information is provided at: Yoshihiko MIZUMOTO, Masatoshi OHISHI, Naoki YASUDA, Yuji SHIRASAKI, Masahiro TANAKA (NAOJ), Yoshifumi MASUNAGA (Ochanomizu Univ. and NAOJ), Ken MIURA, Hirokuni MONZEN, Kenji KAWARAI, Yasuhide ISHIHARA, Yasushi YAMAGUCHI and Hiroshi YANAKA (Fujitsu Ltd.) Contact Address: User’s own service User’s own service Security mngmt Resource mngmt MVC MVCMVC JVO Portal JVO Portal Astronomical Catalog Query Service Astronomical Catalog Query Service Globus Toolkit Catalog DB Service Registry Service Registry Researcher Browser for JVO Browser for JVO Viewer for JVO Viewer for JVO Data Archive Service Data Archive Service Data manage DB Data Virtual Observation execution service Virtual Observation execution service Data Analysis service Data Analysis service Service Registry Service Registry Other VO services Other Catalog services Other Catalog services Globus Toolkit JVO GRID Environment Other GRID Environment UDDI server (FreeSoft) Web Browser Web ブラウザ Commands callable from GT2 Globus Toolkit V2 Data management skycat Security mngmt Resource mngmt Data management Super SINET is an ultrahigh-speed network intended to develop and promote Japanese academic researches by strengthening collaboration among leading academic research institutes. The National Institute of Informatics has been operating the network since January 4, The Internet backbone connects research institutes at 10 Gbps and the leading research facilities in the research institutes are directly connected at 1 Gbps. Ultrahigh-speed network and JVO Chile Radio Nobeyama Subaru Hawaii NAOJ Subaru 0.3  m~20  m ~20TB/yr Nobeyama10GHz~230GHz~1TB/yr ALMA (plan)30GHz~950GHz~PB/yr Properties of the astronomical data base utilized by JVO Registry = Inter- national VO Schematic diagram of JVO system Distributed computing system Distributed data base system Users 10Gbps Super SINET, linked with GRID technology GRID NAOJ - JVO consists of a distributed computing system (DCS) which is deployed over the GRID technology and a registry which provides information required for DCS to query the distributed DB system. - All the computers of the DCS have an equivalent function and any of them can takes place of another machine, which is important for robustness of JVO system. - Selection of a machine for servicing the JVO users is automatically performed by GRID system based on the system load average. - JVO has inter-operability with the other VOs. The JVO Query Language JVOQL has an ability to query image data without referring to catalogs. This ability is useful for multi-color or multi-epoch analyses. The above JVOQL example shows how to obtain R-band select s.a, t.a,... from SUBARU.R s, 2MASS.K t,... where (s.AREA() OVERLAP t.AREA()) as a Federate with more data Data of SUBARU open use/Nobeyama Radio Observatory Interoperability with other VOs Toward International VO CPU intensive image analysis tools Deconvolution, image subtraction,... Run on PC cluster via GRID Data mining / visualization tools Manage huge amount of data Future Plan First of all, researchers provide the JVO with simple instructions how they plan to use their own ''Virtual Observation''. The JVO portal interprets them and generates a work flow through consulting the UDDI servers, where available JVO services are registered. Based on the work flow, built-in or user-defined services are called. The GRID framework is used for dynamical assignment of distributed resources according to their availabilities. Execution results of the work flow are transferred through GridFTP and presented to the researchers with the skycat, etc. Three-Tiered Design of the JVO Prototype The JVO prototype is now under development. The design of the JVO prototype is shown as a schematic diagram. We adopted to use the Globus Toolkit V2 for our prototype. However we also take into account the Web service concept which will be included in the Globus Toolkit V3. The JVO, the distributed data base systems of Subaru and Nobeyama observatories, and astronomers in the research institutes are linked over create view myEROtable as select s.Bmag, s.Rmag, t.Hmag, t.Kmag,..., sr.BOX(POINT(s.ra,s.dec),w,h) as Rimage, tk.BOX(POINT(s.ra,s.dec),w,h) as Kimage,... from SUBARU s, 2MASS t,..., SUBARU.R sr, 2MASS.K tk,... where XMATCH(s,b,...) < 3 arcsec and (s.Rmag-t.Kmag) > 6 mag and BOX(POINT(ra0,dec0), w0, h0) and... Specify search area with the same syntax as cutout image specification. Create view with the user specified name in JVO system. Select attributes from each catalog server. Column names can be expressed in UCD. Select the catalog server. Select the image data server. Cross-match distributed catalogs. Query condition based on distributed catalog. Select cutout images from each image data server. Image area can be specified by BOX or CIRCLE operand. The JVO Query Language (JVOQL) is used in JVO as a language to specify a variety of user queries. The JVOQL has been designed to keep upward-compatibility with the standard relational database language, Structured Query Language (SQL), to enable in handling image data and cross-matching among distributed databases. The interpreter of JVOQL communicates with the registry of available databases and issues query sequences to distributed databases. SUBARU.R s2MASS.K t s.AREA()t.AREA() AREA table cutout request OVERLAP s t a1 a2 a3 Partition to small segment the GRID technology through the 10Gbps Super SINET ( images taken by SUBARU and K-band images by 2MASS in an area where both SUBARU and 2MASS observed. The operand “OVERLAP” returns overlapped area of the two data. Similarly the operand “X.AREA()” returns the observed area of server X.