2003/11/27CVO Meeting in Beijing Current Status of Japanese Virtual Observatory Masatoshi Ohishi National Astronomical Observatory of Japan and Sokendai.

Slides:



Advertisements
Similar presentations
IVOA Interoperablity meeting KyotoMasahiro Tanaka (NAOJ) 1 JVO use of Globus Toolkit Masahiro Tanaka (NAOJ)
Advertisements

May 9, 2007Astro-RG, OGF201 Japanese Virtual Observatory and NaReGi Masatoshi Ohishi / NAOJ, Sokendai & NII /, &
JAXA GRID Activity JAXA/EORC Kengo Aizawa KEIO UNIVHiromichi Fukui.
Aus-VO Workshop 2003 International Virtual Observatory Alliance effort on Virtual Observatory Query Language Naoki Yasuda (JVO), VOQL WG.
What does LOFAR have to do with the Virtual Observatory (VO)? LOFAR Science Day 16 December 2003 Melbourne David Barnes The University of Melbourne.
Construction of the Japanese Virtual Observatory (JVO) Abstract : The National Astronomical Observatory of Japan (NAOJ) has been operating several large.
Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.
Design and Implementation of JVO SkyNode Yuji SHIRASAKI National Astronomical Observatory of Japan IVOA Small Projects Meeting, 2004 Oct 1.
実装の流れと 今後のスケジュール 03k0014 岸原 大祐. システム概要 天気データをもとに、前向き推論をし ていき、親の代わりに子供に服装、持 ち物、気をつけることなどを教える。
SXDS database and Japanese Virtual Observatory Yuji Shirasaki and JVO collaborations National Astronomical Observatory of Japan.
Li 系化合物の結晶育成と電気的性質の測定 - LabVIEW を用いた計測制御システムの開発 - 矢萩研究室 ソ 佐藤 蓉子
子供の判断支援システム 03k0014 岸原大祐. システム概要 天気データと個人データの二つから、 条件に応じて服装、行動等に対し、親 の代わりに子供に対してアドバイスを 行う。
最近の ICD の動向について (WHO 公表資料より抜粋). HIS および IT を用いた WHO 分類 国の保健業務 出生 死亡 疾病 障害 リスク要因 電子保健 記録システム ICD ICF ICHI 分類 マッピング 専門用語 臨床業務 意思決定支援 ケアの統合 結果 管理業務 日程計画.
Planning for the Virtual Observatory Tara Murphy … with input from other Aus-VO members …
Requirements from astronomy in the Virtual Observatory era Bob Mann Institute for Astronomy & NeSC University of Edinburgh.
Aus-VO: Progress in the Australian Virtual Observatory Tara Murphy Australia Telescope National Facility.
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
Virtual Observatory --Architecture and Specifications Chenzhou Cui Chinese Virtual Observatory (China-VO) National Astronomical Observatory of China.
A long tradition. e-science, Data Centres, and the Virtual Observatory why is e-science important ? what is the structure of the VO ? what then must we.
Supported by the National Science Foundation’s Information Technology Research Program under Cooperative Agreement AST with The Johns Hopkins University.
11/27/2003IVOA Small Projects Meeting China-VO Data Access Service Based on OGSA Jian Sang National Astronomical Observatory of China Chinese Virtual.
The Japanese Virtual Observatory (JVO) Yuji Shirasaki National Astronomical Observatory of Japan.
Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.
How Grid Security works in GEO Sciences N. Yamamoto, Y. Tanaka, I. Kojima, S. Sekiguchi AIST Oct. 28, 2009.
Yuji SHIRASAKI National Astronomical Observatory of Japan Current Status of Japanese Virtual Observatory (JVO)
WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
Prototype system of the Japanese Virtual Observatory The Japanese Virtual Observatory (JVO) aims at providing easy access to federated astronomical databases.
AstroGrid Overview AG-SAG Cambridge IoA 19 th June 2003 Tony Linde AstroGrid Project Manager University of Leicester, Dept. Physics & Astronomy.
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
JVO JVO Portal Japanese Virtual Observatory (JVO) Prototype 2 Masahiro Tanaka, Yuji Shirasaki, Satoshi Honda, Yoshihiko Mizumoto, Masatoshi Ohishi (NAOJ),
May 10, 2006IVOA-GGF Astro-RG WS1 Welcome and Workshop Goal Masatoshi Ohishi / NAOJ & Sokendai Chairman, IVOA 大石雅寿 / 国立天文台 & 総合研究大学院大学
1 For understanding the earth - Concept and System to integrate Global Earth Observation data - The 4 th ADC meeting May 14 th, 2007 National.
P Structured Query Language for Virtual Observatory Yuji Shirasaki National Astronomical Observatory of Japan, and Masahiro Tanaka (NAOJ), Satoshi.
Mar. 01, 2005DEWS20051 バーチャル天文台を実現する 分散データベース・計算資源 の国際連携機構 大石雅寿 ( 国立天文台 )
Understand how the future will work exchange information on key projects understand PPARC priorities debate (conclude?) community approach to the PPARC.
The Project The Virtual Observatory Technical Progress Andy Lawrence Nottingham All-Hands meeting Sept 2003 AstroGrid
IVOA Interoperalibity JVO Query Language Naoki Yasuda (NAOJ/Japanese VO)
February 20, 2006JVO-AstroGrid Collaboration1 Current Status of JVO, and Goal of Collaboration between JVO and AstroGrid Masatoshi Ohishi / NAOJ & Sokendai.
Grid Security: Authentication Most Grids rely on a Public Key Infrastructure system for issuing credentials. Users are issued long term public and private.
Oct. 1, 2004IVOA Small Projects Meeting1 Development of JVO prototype system and its application to Astrophysics Portal System : M. Tanaka Data Service.
Small Projects Bridging IVO Standards and Best Practice Bridging IVOA and Domestic Community Chenzhou Cui, Yongheng Zhao Chinese Virtual Observatory National.
Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.
CMU-CS lunch talk, Gerard Lemson1 Computational and statistical problems for the Virtual Observatory With contributions from/thanks to: GAVO.
Who are we ? what is a VO ? what is a Grid ? how do we get there ? Andy Lawrence S.P.I.E. Hawaii Aug 2002 AstroGrid
2003/03/25天文学会春季年会 JVO の研究開発 (2) 全体進捗 大石雅寿 国立天文台 & 総研大
Progress Report of VOQL WG May 15 (Thu) Masatoshi Ohishi (Japan)
The International Virtual Observatory Alliance (IVOA) interoperability in action.
Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
Japanese Virtual Observatory (JVO) National Astronomical Observatory of Japan (NAOJ) Contact Address: Demo 1: GRID-based database federation.
JVO portal service Yuji Shirasaki National Astronomical Observatory of Japan.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
F. Genova, AstroNET meeting, Poitiers The Astrophysical Virtual Observatory.
EA-ARC Status Summary ALMAJ-ARC A-REP East Asian ALMA Regional Center.
Three color composite image Color-Color diagram SED SED relative to R-band Download FITS Searching for a cosmic string through the gravitational lens effect:
IVOA Small Projects Meeting Application to the science S. Honda, Y. Shirasaki, M. Tanaka and JVO team National Astronomical Observatory of Japan.
OGSA-DAI 简介及其它在 China-VO DAS 系统中的应用 杨阳 中国虚拟天文台研发团队 Chinese Virtual Observatory.
2004/03/08Japan-France Grid Computing Workshop in Paris Japanese Virtual Observatory Project Masatoshi Ohishi National Astronomical Observatory of Japan.
Enabling Grids for E-sciencE INFSO-RI When databases met the Grid A New Data Source Oriented CE for GRID G. Taffoni (2,3), E. Ambrosi (1), A. Barisani.
Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.
April 29, 2005ISGC Taipei1 Recent Progress of the Japanese Virtual Observatory Project Masatoshi Ohishi / NAOJ 大石雅寿 / 国立天文台
May 14 (Wed) Masatoshi Ohishi (Japan)
VO Registry & China VO DAS
2018/11/23 An Application for the Data Grid : A Prototype of the Japanese Virtual Observatory System Masatoshi Ohishi National Astronomical Observatory.
Current Status of Japanese Virtual Observatory
2018/11/27 An Application for the Data Grid : A Prototype of the Japanese Virtual Observatory System Masatoshi Ohishi National Astronomical Observatory.
Progress Report of VOQL WG
Google Sky.
Presentation transcript:

2003/11/27CVO Meeting in Beijing Current Status of Japanese Virtual Observatory Masatoshi Ohishi National Astronomical Observatory of Japan and Sokendai

2003/11/27CVO Meeting in Beijing Collaborators NAOJ s Y. Mizumoto s N. Yasuda s Y. Shirasaki s M. Tanaka s S. Honda Ochanomizu U. s Y. Masunaga Osaka U. S. Shimojo & his team Titech S. Matsuoka & his team Fujitsu Ltd. s K. Monzen s K. Kawarai s Y. Ishihara s H. Yanaka s Y. Yamaguchi s M. Ishida s N. Saito s K. Abe s J. Tsutsumi s H. Nakamoto s Y. Morita Ken Miura

2003/11/27CVO Meeting in Beijing Large Telescopes of NAOJ s Subaru (optical & Hawaii s Nobeyama (Radio) single dish :  45-m interferometer : 6 x  10-m solar interferometer : 84 x  75-cm  HALCA – in orbit  8-m

2003/11/27CVO Meeting in Beijing Subaru

2003/11/27CVO Meeting in Beijing Subaru Telescope

2003/11/27CVO Meeting in Beijing

2003/11/27CVO Meeting in Beijing

2003/11/27CVO Meeting in Beijing 45m Radio Telescope

2003/11/27CVO Meeting in Beijing

2003/11/27CVO Meeting in Beijing VSOP

2003/11/27CVO Meeting in Beijing Infrared Satellite by JAXA Launch : 2005 ? JAXA is going to join JVO !!

2003/11/27CVO Meeting in Beijing Data Productivity s Nobeyama Radio : ~1TB/yr s : ~20TB/yr s ALMA ( planned ) : ~PB/yr Flood of excellent data (survey data) Digitized & Archived

2003/11/27CVO Meeting in Beijing 10 Gbps

2003/11/27CVO Meeting in Beijing HPC + High Speed NETWORK +GRID Technology → it is possible to federate multi- wavelength-DBs and computing facilities for data analyses → Virtual Observatory

2003/11/27CVO Meeting in Beijing JVO prototype : Ver. 1 s Establish seamless access to federated DBs by using the Grid technology s Define JVO Query Language, and implement its parser s Test environment is in a closed subnet

2003/11/27CVO Meeting in Beijing

2003/11/27CVO Meeting in Beijing Query Files can be stored in a local PC (WS)

2003/11/27CVO Meeting in Beijing Monitor Window: Refreshed automatically in every 15 seconds Dynamical creation of a workflow

2003/11/27CVO Meeting in Beijing Sample Outputs

2003/11/27CVO Meeting in Beijing

2003/11/27CVO Meeting in Beijing JVO Query Language

2003/11/27CVO Meeting in Beijing SkyQL & ADQL s JVOQL has been adopted as one of the basis for SkyQL (standard query language in IVOA) s XML description of SkyQL = ADQL Astronomical Data Query Language

2003/11/27CVO Meeting in Beijing Serious Issue Q) GT2 has too large overhead before starting actual jobs !! They are several seconds. A) For batch jobs, such as database accesses, the overhead could be negligible. However users can never wait for several second for interactive data analyses. Request) Overheads must be < 0.1 seconds excluding the network delays.

2003/11/27CVO Meeting in Beijing Partially solved !! s Introduction of NMI -- authentication module : binary s Analysis of the source codes of GTK2 -- polling interval : 30 sec -> 3 sec s Elapsed time was halved ! But …, still very slow.

2003/11/27CVO Meeting in Beijing Improvement of U.I. Need to know about SQL to use JVOQL → An editor to create JVOQL from GUI Edittable on screen → more flexibility for advanced users

2003/11/27CVO Meeting in Beijing

2003/11/27CVO Meeting in Beijing Search for Gravitational Lenses caused (?) by Cosmic Strings s SXDS data observed by Subaru s Query results were obtained less than 5 min., displaying SEDs s It has been proven that VO can accelerate researches.

2003/11/27CVO Meeting in Beijing Cosmic Strings? s Theoretical origin of the elementary particles which existed (?) at t ~ s , T ~ GeV s Not a POINT, has its SIZE s Width < m, Length ~ size of the Universe. s Mass of 10km string ~ the Earth

2003/11/27CVO Meeting in Beijing Gravitational Lens s A phenomenon that the space-time is distorted by a huge mass object, and multiple images of another object behind the massive object are observed around it.

2003/11/27CVO Meeting in Beijing

2003/11/27CVO Meeting in Beijing Gravitational Lens by Cosmic Strings

2003/11/27CVO Meeting in Beijing Development of Prototype2 For preparation of Operational System s User registration : single sign-on s User area over Firewall : GSI-SFS s Adoption of OGSA s Implementation of several analysis tools

2003/11/27CVO Meeting in Beijing Linux クロスマッチ処理 データ検索処理 データ数 count PostgreSQL 画像管理 DB WSDL データベースサーバ2 SUBARU SupCam i-band Globus Toolkit V3 OGSA-DAI 解析処理 検索依頼 Gb Ether Solaris8 Web ブラウザ 利用者操作画面 Windows, Solaris8, Linux Globus Toolkit V3 スケジュール作 成 Ⅰ JVO-QL 翻訳サーバ ポータルサーバ Solaris8 クロスマッチ処理 分散情報管理 OGSA -DAI DAISGR 検索結果画面 条件指定画面 分散処理制御 ・ DAISGR 検索 ・ GWDSL 解釈 ・準備、実行、結果確認 Web Server スケジュール 作成 Ⅱ データ検索処理 Globus Toolkit V3 データ数 count PostgreSQL 画像管理 DB Linux データ検索処理 データ数 count ORACLE 画像管理 DB セキュリティ 管理 資源管理 Globus Tk ポータルサーブレット GWSDL WSDL データベースサーバ N データベースサーバ1 SUBARU SupCam z-band 2MASS 統合検索指示 登録情報検索機能 統合検索結果表示機能 検索状況モニター画面 統合検索状況モニター Registry 利用者管理機能 状況表示 データ保存 Globus Toolkit V3 OGSA-DAI Globus Toolkit V3 OGSA-DAI 解析処理 検索依頼 GT3 利用者 データ 結果サーバ GSI-SFS Linux 解析処理 解析サーバ Gb Ether 解析指示 GT3 利用者 データ Local disk GSI-SFS FW GT3 利用者 データ Local disk GSI-SFS GT3 利用者 データ Local disk GSI-SFS

2003/11/27CVO Meeting in Beijing Road Map 2003 Prototype 2 → development of components for operation 2004 start to develop operational system late 2004 ?? trial use trial use & upgrade 2007 prepare for partial operation of ALMA

2003/11/27CVO Meeting in Beijing ALMA in Chile (sub-mm wave)

2003/11/27CVO Meeting in Beijing VO Projects in the world s NVO (USA), AVO (EU),AstroGrid (UK) s Germany, Canada, Russia, Australia s India, China, Italy, France, Korea, JAPAN Interoperability : International Virtual Observatory Alliance (IVOA)

2003/11/27CVO Meeting in Beijing

2003/11/27CVO Meeting in Beijing WGs in IVOA s Registry, Data model, Data Access Layer, VOtable, VOQL, Grid, UCD, Standard Documents s Executive Committee s Interoperability meetings were held twice

2003/11/27CVO Meeting in Beijing サービス 他システム 処理 データ管理 資源管理 セキュリティ管理 研究者 VO 用 ブラウザ VO 用 ブラウザ Web サーバ Web サーバ JVO ポータル JVO ポータル 天体カタログ 天体カタログ DB ワーク フロー データ管理 資源管理 セキュリティ管理 サービス 利用者独自 サービス 利用者独自 サービス 天体カタログ サービス 天体カタログ サービス GRID 環境 A サービス レジストリ A サービス レジストリ A サービス レジストリ C サービス レジストリ C DB DA/DB Data サービス DB/DA サービス DB/DA サービス レジストリ B サービス レジストリ B 仮想観測実行 サービス 仮想観測実行 サービス M VC MVCMVC GRID 環境 B GRID 環境 C VO 用 Viewer VO 用 Viewer データ管理 資源管理 セキュリティ管理 データ管理 資源管理 セキュリティ管理 天文台殿 サービス 他システム pipeline 処理 データ管理 資源管理 セキュリティ管理 サービス 他システム 処理 データ管理 資源管理 セキュリティ管理 サービス 他システム 処理 データ管理 資源管理 セキュリティ管理 研究者 VO 用 ブラウザ VO 用 ブラウザ Web サーバ Web サーバ VO ポータル VO ポータル VO 用 Viewer VO 用 Viewer 仮想観測 指示