JVO portal service Yuji Shirasaki National Astronomical Observatory of Japan.

Slides:



Advertisements
Similar presentations
VOQL WG Plenary Session Sept 27, 2004 William OMullane for Masatoshi Ohishi.
Advertisements

May. 2004IVOA Meeting / Boston1 OpenSkyQuery,SkyNodes and ADQL William OMullane Johns Hopkins University T HE US N ATIONAL V IRTUAL O BSERVATORY.
Yuji Shirasaki National Astronomical Observatory of Japan JVO JVO Publishing/Searchable Registry Implementation Experience IVOA Interoperability Meeting.
IVOA Interoperablity meeting KyotoMasahiro Tanaka (NAOJ) 1 JVO use of Globus Toolkit Masahiro Tanaka (NAOJ)
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
9 September 2005NVO Summer School Aspen Astronomical Dataset Query Language (ADQL) Ray Plante T HE US N ATIONAL V IRTUAL O BSERVATORY.
Building Portals to access Grid Middleware National Technical University of Athens Konstantinos Dolkas, On behalf of Andreas Menychtas.
Aus-VO Workshop 2003 International Virtual Observatory Alliance effort on Virtual Observatory Query Language Naoki Yasuda (JVO), VOQL WG.
Remote Visualisation System (RVS) By: Anil Chandra.
A PPARC funded project AstroGrid Framework Consortium meeting, Dec 14-15, 2004 Edinburgh Tony Linde Programme Manager.
Construction of the Japanese Virtual Observatory (JVO) Abstract : The National Astronomical Observatory of Japan (NAOJ) has been operating several large.
László Dobos 1,2, Tamás Budavári 2, Nolan Li 2, Alex Szalay 2, István Csabai 1 1 Eötvös Loránd University, Budapest,
Design and Implementation of JVO SkyNode Yuji SHIRASAKI National Astronomical Observatory of Japan IVOA Small Projects Meeting, 2004 Oct 1.
Multiple Tiers in Action
Cloud based linked data platform for Structural Engineering Experiment Xiaohui Zhang
TAP service at ESAC - VOTAP Carlos Rios Diaz Science Archives Team (SAT) ESA-ESAC, Madrid, Spain VOTAP.
- 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)
Supported by the National Science Foundation’s Information Technology Research Program under Cooperative Agreement AST with The Johns Hopkins University.
The Japanese Virtual Observatory (JVO) Yuji Shirasaki National Astronomical Observatory of Japan.
Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.
Yuji SHIRASAKI National Astronomical Observatory of Japan Current Status of Japanese Virtual Observatory (JVO)
VOQL WG Progress Report May 28, 2004 Masatoshi Ohishi.
WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
AstroGrid AstroGrid increases scientific research possibilities by : enabling access to distributed astronomical data and information resources. providing.
Last News of and
Prototype system of the Japanese Virtual Observatory The Japanese Virtual Observatory (JVO) aims at providing easy access to federated astronomical databases.
JVO JVO Portal Japanese Virtual Observatory (JVO) Prototype 2 Masahiro Tanaka, Yuji Shirasaki, Satoshi Honda, Yoshihiko Mizumoto, Masatoshi Ohishi (NAOJ),
May 10, 2006IVOA-GGF Astro-RG WS1 Welcome and Workshop Goal Masatoshi Ohishi / NAOJ & Sokendai Chairman, IVOA 大石雅寿 / 国立天文台 & 総合研究大学院大学
A PPARC funded project AstroGrid Intro & Demo John Taylor Institute for Astronomy, Edinburgh.
Using a LDAP Directory Server for Environmental Data Discovery Donald Denbo NOAA-PMEL/UW-JISAO Presented by Eugene Burger NOAA-PMEL/UW-JISAO
P Structured Query Language for Virtual Observatory Yuji Shirasaki National Astronomical Observatory of Japan, and Masahiro Tanaka (NAOJ), Satoshi.
October 7, 2005VOQL-Madrid1 IVOA – VOQL WG session ESAC Villafranca del Castillo Madrid, Spain Friday, October 7th, 9: :00 Yuji Shirasaki Maria Nieto-Santisteban.
Federated Discovery and Access in Astronomy Robert Hanisch (NIST), Ray Plante (NCSA)
IVOA Interoperalibity JVO Query Language Naoki Yasuda (NAOJ/Japanese VO)
February 20, 2006JVO-AstroGrid Collaboration1 Current Status of JVO, and Goal of Collaboration between JVO and AstroGrid Masatoshi Ohishi / NAOJ & Sokendai.
Oct. 1, 2004IVOA Small Projects Meeting1 Development of JVO prototype system and its application to Astrophysics Portal System : M. Tanaka Data Service.
Crossmatch: the NRAO Cross-identifcation Service Jared Crossley Data Archive Access Meeting - Socorro, NM - 5 April 2010.
Solar and space physics datasets within a Virtual Observatory: the AstroGrid experience Silvia Dalla * and Nicholas A Walton  * School of Physics & Astronomy,
Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.
Progress Report of VOQL WG May 15 (Thu) Masatoshi Ohishi (Japan)
16 October 2003Registry Interface CallsIVOA Interoperability, Strasbourg IVOA Interoperability Elizabeth Auden & Registry Workgroup 16 – 17 October 2003.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
1 8-Jun-2004Andy Lawrence : PharmaGrid talk, Diessenhofen The Virtual Observatory The VObs concept The structure of the VObs Standards, Standards, Standards.
ADQL/s Syntax (Proposal) -- towards unification of ADQL, SIAP, SSAP, SXAP Yuji SHIRASAKI National Astronomical Observatory.
Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.
May 17, 2005Maria Nieto-Santisteban, JHU / IVOA - Kyoto1 VO JHU Open SkyQuery and more … T. Budavari, S. Carliles, L. Dobos, G. Fekete,
AstroGrid How to make your data famous OR One-click PhD creation.
Japanese Virtual Observatory (JVO) National Astronomical Observatory of Japan (NAOJ) Contact Address: Demo 1: GRID-based database federation.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
1 Data Architecture Strawman - Grimshaw Important points Everything is a service (object) >All have a name (EPR) and an interface (type) One or more base.
May 2006IVOA Victoria, Canada1 VOQL Where do we stand? What is left? Yuji Shirasaki JVO Maria A. Nieto-Santisteban JHU T HE US N ATIONAL V IRTUAL O BSERVATORY.
IVOA Small Projects Meeting Application to the science S. Honda, Y. Shirasaki, M. Tanaka and JVO team National Astronomical Observatory of Japan.
1 Case Study: Business Intelligence & Customer Data Customer Support Web-based Dashboard VP Marketing SQL XSLT XML Data Grid Customer Data Customer Order.
End of the Beginning for IVOA is now Roy Williams IVOA Technical Lead.
Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.
REMI Database Antall Fernandes. REMI ● A relational database to facilitate data - metadata organization of various research studies. ● Interface into.
How to use the GALEX SkyNode*
Cloud based linked data platform for Structural Engineering Experiment
Standard Query Language for VO
Cross-health enterprises Medical Data Management on the EGEE grid
Sarang Nazari California State University, Los Angeles
May 14 (Wed) Masatoshi Ohishi (Japan)
2018/11/23 An Application for the Data Grid : A Prototype of the Japanese Virtual Observatory System Masatoshi Ohishi National Astronomical Observatory.
2018/11/27 An Application for the Data Grid : A Prototype of the Japanese Virtual Observatory System Masatoshi Ohishi National Astronomical Observatory.
Progress Report of VOQL WG
Google Sky.
IVOA – VOQL WG session ESAC Villafranca del Castillo Madrid, Spain Friday, October 7th, 9: :00 Yuji Shirasaki Maria Nieto-Santisteban VOQL-Madrid.
SDMX IT Tools SDMX Registry
Presentation transcript:

JVO portal service Yuji Shirasaki National Astronomical Observatory of Japan

Objectives Provide a seamless access to the distributed astronomical data services. Provide a seamless access to the distributed astronomical data services. Easy access to the hundreds of astronomical data service over the VO. Easy access to the hundreds of astronomical data service over the VO. User friendly data analysis environment User friendly data analysis environment Federation of the data access and data analysis. Federation of the data access and data analysis. Graphical user interface for data analysis. Graphical user interface for data analysis. Promote multi-wavelength study. Promote multi-wavelength study.

Functionalities Registry service Registry service Find data resources in the VO Find data resources in the VO Data service Data service Access to the multiple data services. Access to the multiple data services. Analysis service Analysis service Server side web application Server side web application Storage service Storage service Workflow service Workflow service Building your own web service Building your own web service

JVO Portal Architecture Web Browser IF Account DB Registry User Data Storage Authentication Query Planner Data Service Analysis Service User Info Data Query Workflow Reg. Query DataReq. HTML (JSP) User Data Manager Registry Search Workflow Executer LDAP WS NFS

Authentication Tomcat authentication system Tomcat authentication system Form-Based Authentication Form-Based Authentication JNDIRealm & OpenLDAP JNDIRealm & OpenLDAP Access control based on the role property. Access control based on the role property. TODO TODO Secure authentication Secure authentication Access to the protected services Access to the protected services Single sign-on. Single sign-on.

Registry Service Publishing & Searchable Publishing & Searchable XML native database (Karearea) for searchable registry XML native database (Karearea) for searchable registry Harvest resource metadata from the publishing registries Harvest resource metadata from the publishing registries Harvest table & column metadata from skynode Harvest table & column metadata from skynode Harvest query parameter from SIAP/SSAP services. Harvest query parameter from SIAP/SSAP services. Web service IF Web service IF IVOA standard IF (keyword & ADQL search, getResource by identifier) IVOA standard IF (keyword & ADQL search, getResource by identifier) JVO specific IF (getTable, getColumn, getResource by table name … ) JVO specific IF (getTable, getColumn, getResource by table name … )

Data Service Query methods Query methods Form-based query for non-SQL users Form-based query for non-SQL users JVOQL query JVOQL query Query to the multiple data services. Query to the multiple data services. sequential (union) & cross match (join) sequential (union) & cross match (join) Query planner decompose the JVOQL into appropriate query protocols (ADQL/SIAP/SSAP) of each service. Query planner decompose the JVOQL into appropriate query protocols (ADQL/SIAP/SSAP) of each service.

JVO Query Language Extended ADQL-s Extended ADQL-s Catalog and Image xmatch Catalog and Image xmatch SELECT ir.object, ir.flux_iso_45, opt.number, opt.mag_auto_B, opt.mag_auto_V, opt.mag_auto_R, opt.mag_auto_I, opt.mag_auto_Z, x.number, x.rate2300, img.object, img.filter_id, img.access_ref, img.format FROM ivo://jvo/sxds:sxdsr1 AS opt, jvo://jvo/sxds:swire_xmm AS ir, ivo://jvo/sxds:xmm_epic_sxds AS x, ivo://jvo/subaru:spcam_mos_view AS img WHERE Region(‘Circle ’) AND opt.mag_auto_R < 24 AND distance((ir.ra, ir.dec), (opt.ra, opt.dec)) < 2 [arcsec] AND distance((ir.ra, ir.dec), (x.ra, x.dec)) < 2 [arcsec] AND distance((x.ra, x.dec), (opt.ra, opt.dec)) < 2 [arcsec] AND img.region = BOX((opt.ra, opt.dec), 0.02, 0.02) AND img.filter_id = 'W-C-RC'

Query Planner 1. Decompose JVOQL into ADQL (Skynode) or parameter query (SIAP/SSAP) for each service. 2. Check xmatch support 3. Execute query to the non-xmatch services 4. Request a query cost for each xmatch service 5. Execute query to the service of the lowest cost. 6. Execute xmatch query according to the order of the cost. 7. Join all the query results.

User Data Management Result of query and workflow execution can be stored on the user storage area (UNIX file system). Result of query and workflow execution can be stored on the user storage area (UNIX file system). Download to the local machine Download to the local machine TODO TODO Upload from the local machine Upload from the local machine Query on the user data Query on the user data VOStore interface ? VOStore interface ?

Workflow Masahiro Tanaka ’ s talk. Masahiro Tanaka ’ s talk.