Prototype system of the Japanese Virtual Observatory The Japanese Virtual Observatory (JVO) aims at providing easy access to federated astronomical databases.

Slides:



Advertisements
Similar presentations
IVOA Interoperablity meeting KyotoMasahiro Tanaka (NAOJ) 1 JVO use of Globus Toolkit Masahiro Tanaka (NAOJ)
Advertisements

September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
May 9, 2007Astro-RG, OGF201 Japanese Virtual Observatory and NaReGi Masatoshi Ohishi / NAOJ, Sokendai & NII /, &
Aus-VO Workshop 2003 International Virtual Observatory Alliance effort on Virtual Observatory Query Language Naoki Yasuda (JVO), VOQL WG.
The Australian Virtual Observatory e-Science Meeting School of Physics, March 2003 David Barnes.
VO-DAS Chenzhou CUI Chao LIU, Haijun TIAN, Yang YANG, etc National Astronomical Observatories, CAS.
Development of China-VO ZHAO Yongheng NAOC, Beijing Nov
Construction of the Japanese Virtual Observatory (JVO) Abstract : The National Astronomical Observatory of Japan (NAOJ) has been operating several large.
Design and Implementation of JVO SkyNode Yuji SHIRASAKI National Astronomical Observatory of Japan IVOA Small Projects Meeting, 2004 Oct 1.
SXDS database and Japanese Virtual Observatory Yuji Shirasaki and JVO collaborations National Astronomical Observatory of Japan.
Interpret Application Specifications
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Talend 5.4 Architecture Adam Pemble Talend Professional Services.
Overview of SQL Server Alka Arora.
Virtual Observatory --Architecture and Specifications Chenzhou Cui Chinese Virtual Observatory (China-VO) National Astronomical Observatory of China.
Supported by the National Science Foundation’s Information Technology Research Program under Cooperative Agreement AST with The Johns Hopkins University.
CIS 375—Web App Dev II Microsoft’s.NET. 2 Introduction to.NET Steve Ballmer (January 2000): Steve Ballmer "Delivering an Internet-based platform of Next.
11/27/2003IVOA Small Projects Meeting China-VO Data Access Service Based on OGSA Jian Sang National Astronomical Observatory of China Chinese Virtual.
The Japanese Virtual Observatory (JVO) Yuji Shirasaki National Astronomical Observatory of Japan.
Data Management Kelly Clynes Caitlin Minteer. Agenda Globus Toolkit Basic Data Management Systems Overview of Data Management Data Movement Grid FTP Reliable.
Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.
The GAVO Cross-Matcher Application Hans-Martin Adorf, Gerard Lemson, Wolfgang Voges GAVO, Max-Planck-Institut für extraterrestrische Physik, Garching b.
COMPUTER MODELS FOR SKY IMAGE ANALYSIS OF THE INASAN ZVENIGOROD OBSERVATORY Sergei Pirogov ( Institute of Astronomy, Russian Academy of Sciences) VIIth.
Yuji SHIRASAKI National Astronomical Observatory of Japan Current Status of Japanese Virtual Observatory (JVO)
Database System Concepts and Architecture
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
ESP workshop, Sept 2003 the Earth System Grid data portal presented by Luca Cinquini (NCAR/SCD/VETS) Acknowledgments: ESG.
Configuration Management (CM)
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
JVO JVO Portal Japanese Virtual Observatory (JVO) Prototype 2 Masahiro Tanaka, Yuji Shirasaki, Satoshi Honda, Yoshihiko Mizumoto, Masatoshi Ohishi (NAOJ),
May 10, 2006IVOA-GGF Astro-RG WS1 Welcome and Workshop Goal Masatoshi Ohishi / NAOJ & Sokendai Chairman, IVOA 大石雅寿 / 国立天文台 & 総合研究大学院大学
RELATIONAL FAULT TOLERANT INTERFACE TO HETEROGENEOUS DISTRIBUTED DATABASES Prof. Osama Abulnaja Afraa Khalifah
ILDG Middleware Status Chip Watson ILDG-6 Workshop May 12, 2005.
Fisheries Oceanography Collaboration Software Donald Denbo NOAA/PMEL-UW/JISAO Presented by Nancy Soreide NOAA/PMEL AMS 2002/IIPS 10.3.
Database Design and Management CPTG /23/2015Chapter 12 of 38 Functions of a Database Store data Store data School: student records, class schedules,
P Structured Query Language for Virtual Observatory Yuji Shirasaki National Astronomical Observatory of Japan, and Masahiro Tanaka (NAOJ), Satoshi.
Federated Discovery and Access in Astronomy Robert Hanisch (NIST), Ray Plante (NCSA)
“curator” DB design Curator meeting, GFDL, Sep 20.
Workshop Garching, June 27 – July Statistical Cross-Matching Across Distributed Archives H.-M. Adorf & GAVO Team MPI f. extraterrestrische Physik.
Large Scale Nuclear Physics Calculations in a Workflow Environment and Data Provenance Capturing Fang Liu and Masha Sosonkina Scalable Computing Lab, USDOE.
1 Computing Challenges for the Square Kilometre Array Mathai Joseph & Harrick Vin Tata Research Development & Design Centre Pune, India CHEP Mumbai 16.
IVOA Interoperalibity JVO Query Language Naoki Yasuda (NAOJ/Japanese VO)
February 20, 2006JVO-AstroGrid Collaboration1 Current Status of JVO, and Goal of Collaboration between JVO and AstroGrid Masatoshi Ohishi / NAOJ & Sokendai.
Oct. 1, 2004IVOA Small Projects Meeting1 Development of JVO prototype system and its application to Astrophysics Portal System : M. Tanaka Data Service.
Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.
Progress Report of VOQL WG May 15 (Thu) Masatoshi Ohishi (Japan)
Grid Based Chinese Virtual Observatory System Design Chenzhou CUI, Yongheng ZHAO National Astronomical Observatories, Chinese Academy of Sciences
AstroGrid-D and GAVO AstroGrid-D: Infrastructure Network, Computing Resources Grid-Technology, Middleware GAVO: Interoperability of archives.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.
May 17, 2005Maria Nieto-Santisteban, JHU / IVOA - Kyoto1 VO JHU Open SkyQuery and more … T. Budavari, S. Carliles, L. Dobos, G. Fekete,
2003/11/27CVO Meeting in Beijing Current Status of Japanese Virtual Observatory Masatoshi Ohishi National Astronomical Observatory of Japan and Sokendai.
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
Japanese Virtual Observatory (JVO) National Astronomical Observatory of Japan (NAOJ) Contact Address: Demo 1: GRID-based database federation.
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
JVO portal service Yuji Shirasaki National Astronomical Observatory of Japan.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
Three color composite image Color-Color diagram SED SED relative to R-band Download FITS Searching for a cosmic string through the gravitational lens effect:
IVOA Small Projects Meeting Application to the science S. Honda, Y. Shirasaki, M. Tanaka and JVO team National Astronomical Observatory of Japan.
2004/03/08Japan-France Grid Computing Workshop in Paris Japanese Virtual Observatory Project Masatoshi Ohishi National Astronomical Observatory of Japan.
Enterprise Database Systems Introduction to SQL Server Dr. Georgia Garani Dr. Theodoros Mitakos Technological.
Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.
April 29, 2005ISGC Taipei1 Recent Progress of the Japanese Virtual Observatory Project Masatoshi Ohishi / NAOJ 大石雅寿 / 国立天文台
May 14 (Wed) Masatoshi Ohishi (Japan)
2018/11/23 An Application for the Data Grid : A Prototype of the Japanese Virtual Observatory System Masatoshi Ohishi National Astronomical Observatory.
Current Status of Japanese Virtual Observatory
2018/11/27 An Application for the Data Grid : A Prototype of the Japanese Virtual Observatory System Masatoshi Ohishi National Astronomical Observatory.
Progress Report of VOQL WG
Google Sky.
Presentation transcript:

Prototype system of the Japanese Virtual Observatory The Japanese Virtual Observatory (JVO) aims at providing easy access to federated astronomical databases (especially SUBARU, Nobeyama and ALMA) and data analysis environment using the Grid technology. JVOQL (JVO Query Language) is defined in order to write request conditions for federated databases. The JVO prototype system is developed for the purpose of technical feasibility study, including functionality of JVOQL, remote operations using Globus toolkit, and automatic search for services. The prototype consists of several components: JVO portal where users can look up astronomical catalogs and build a query request easily, distributed data servers containing data of Subaru Suprime-Cam and 2MASS, and JVO controller to decompose a request written in JVOQL into individual queries for data servers. We confirm that this prototype actually works as federated databases and that the Grid service of the Globus toolkit version 3 has adequate performance for the federation of distributed databases. Masahiro Tanaka, Yuji Shirasaki, Satoshi Honda, Masatoshi Ohishi, Yoshihiko Mizumoto (NAOJ), Naoki Yasuda (U. Tokyo), Yoshifumi Masunaga (Ochanomizu U.) JVO Prototype Introduction Development of JVO To be used by general education, amateur astronomers and families as well as researchers. Nobeyama : ~1 TB/yr Subaru : ~ 20TB/yr ALMA : ~? PB/yr etc. Increasing amount of Astronomical Data Conventional methods are inadequate. Cumbersome task for every instrument: Data retrieval, transfer, analysis, etc... Enables observation regardless of time and place. Internal data analysis reduces data transfer. Make multi-wavelength research easy due to unified data manipulation regardless of observational instruments. VO is a system to observe “the Universe in computers”, which is constructed by employing these information technologies. The main purpose of the development of JVO prototype is to test functionality of employed technologies. JVO prototype version 2 has currently been developed. As an example of research using JVO, here exhibits a series of processes for searching gravitational lens object in data obtained with Subaru telescope. 1. Retrieve Subaru catalog data in a specified region. ↓ 2. Calculate brightness ↓ 3. Define condition to select quasars. ↓ 4. Make a list of pair quasar objects. ↓ 5. Retrieve image data of the pair objects ↓ 6. Narrow candidates by analyzing the image data. Work flow for Gravitational lens search Several-hour task in conventional ways. Five-minute task with JVO ! Benefit of VO... After authentication, choose catalogs and specify retrieval condition using JVOQL editor. Retrieval condition is reflected in JVOQL Editor. User Operation Windows Result Display Windows Registry is used to find available data in JVO and to construct work flow of remote procedure calls. JVOQL parser decomposes JVOQL, Scheduler generates work flow, and Executer performs remote procedure calls. It is easy to add new analysis tools for conducting particular science. Search result is obtained in the form of VOTable, which is international standard to express table data in the XML form, and displayed on WWW browser. Combination of Information technologies and Astronomy Web service Grid technology Data Mining Database technology Visualization etc… Information science takes important roles in Astronomy. ↑ Retrieve SDSS QSO and display spectra ← ↑ Retrieve and display SXDS data JVO features 1. Grid environment using Globus Toolkit Globus Toolkit ver.3 is employed for JVO Prototype ver.2. “Grid Service” of GTK3 is used for remote operation. RFT (Reliable File Transfer) and SFS is used for file transfer between portal and remote servers. 2. JVOQL (JVO Query Language) for database federation We defined JVOQL to write search condition to federate distributed database. JVOQL is based on SQL, widely used as a language for a relational database, and provides functionalities of cross match and retrieval of image and spectrum. 3. Multi-user and multi-task JVO includes authentication system. It certifies users, permits access to JVO system, and manages users’ processes and storage areas. 4. Metadata management Metadata is information on remote servers, services and observational data. We defined XML expressions of metadata and stored them into Registry, which is constructed using XML DB. That enables automated federation of distributed database and analysis servers, and contents of available observational data in JVO.