Presentation is loading. Please wait.

Presentation is loading. Please wait.

Current Status of Japanese Virtual Observatory

Published byRandell McDowell Modified over 6 years ago

Similar presentations

Presentation on theme: "Current Status of Japanese Virtual Observatory"— Presentation transcript:

1 Current Status of Japanese Virtual Observatory
2018/11/23 Current Status of Japanese Virtual Observatory Masatoshi Ohishi National Astronomical Observatory of Japan 　　　　　　and Sokendai 2003/11/27 CVO Meeting in Beijing

2 Collaborators Fujitsu Ltd. NAOJ K. Monzen Y. Mizumoto Ken Miura
K. Kawarai Y. Ishihara H. Yanaka Y. Yamaguchi M. Ishida N. Saito K. Abe J. Tsutsumi H. Nakamoto Y. Morita NAOJ Y. Mizumoto N. Yasuda Y. Shirasaki M. Tanaka S. Honda Ochanomizu U. Y. Masunaga Osaka U. S. Shimojo & his team Titech S. Matsuoka & his team Ken Miura 2003/11/27 CVO Meeting in Beijing

3 Large Telescopes of NAOJ
Subaru (optical & Hawaii Nobeyama (Radio) single dish : f 45-m interferometer : 6 x f 10-m solar interferometer : 84 x f 75-cm HALCA – in orbit f 8-m 2003/11/27 CVO Meeting in Beijing

4 Subaru 2003/11/27 CVO Meeting in Beijing

5 Subaru Telescope 2003/11/27 CVO Meeting in Beijing

6 2003/11/27 CVO Meeting in Beijing

7 2003/11/27 CVO Meeting in Beijing

8 45m Radio Telescope 2003/11/27 CVO Meeting in Beijing

9 2003/11/27 CVO Meeting in Beijing

10 VSOP 2003/11/27 CVO Meeting in Beijing

11 JAXA is going to join JVO !!
Infrared Satellite by JAXA Launch : 2005 ? 2003/11/27 CVO Meeting in Beijing

12 Data Productivity Nobeyama Radio ：~1TB/yr Subaru@Hawaii ：~20TB/yr
ALMA（planned）　 ：~PB/yr Flood of excellent data (survey data) Digitized & Archived 2003/11/27 CVO Meeting in Beijing

13 10 Gbps 2003/11/27 CVO Meeting in Beijing

14 HPC + High Speed NETWORK
+GRID Technology → it is possible to federate multi-wavelength-DBs and computing facilities for data analyses → Virtual Observatory 2003/11/27 CVO Meeting in Beijing

15 JVO prototype : Ver. 1 Establish seamless access to federated DBs by using the Grid technology Define JVO Query Language, and implement its parser Test environment is in a closed subnet 2003/11/27 CVO Meeting in Beijing

16 2003/11/27 CVO Meeting in Beijing

17 Refreshed automatically in every 15 seconds
Monitor Window: Refreshed automatically in every 15 seconds Dynamical creation of a workflow 2003/11/27 CVO Meeting in Beijing

18 Sample Outputs 2003/11/27 CVO Meeting in Beijing

19 UDDI Registory / Servlet Engine
JVO Prototype System Architecture Redhat Linux 2Mass DataBase Redhat Linux JVO Service JVO Controller Solaris8 (Possible at Linux) Gb Ether GSDL UDDI Registory / Servlet Engine UDDI Maintenance Tool Java2SE 1.4 Globus Toolkit (Server) Java2SE 1.4 Hypertext contents Apache Tomcat Maintenance Tool JVO Service (X match) soapuddi UDDI4J Netscape Communicator Java2 Plugin JVO Client (applet) Apache ＳＯＡＰ ① Applet DownLoad JDBC register update delete JVO Service (select) SQL library ③ Find Service ② Request Observation JVO Controller DB Service Image Data (copy) DB Service Java2SE 1.4 PostgreSQL (DBMS) PostgreSQL JVO Server Monitoring UDDI4J UDDI Data SUBARU SupCam z-band Image Data 2Mass DB get & parse GSDL pre condition check execute Service post condition check Redhat Linux SUBARU DataBase ⑦ issue SQL JVO Service ⑤ execute Service ③ get GSDL GSDL (copy) ④’ Get GSDL by GridFTP GSDL ⑤’ execute Service Check status Globus Toolkit (Client) Internet Globus Toolkit (Server) ⑥’ spawn Service ④ Get GSDL by GridFTP JVO Service (image) AVO JVO Service JVO Service (X match) SUBARU DataBase Globus Toolkit Globus Toolkit (Server) GridFTP GSDL JVO Service (select) SQL library NVO ⑥ spawn Service Globus Toolkit JVO Service (count) SQL library JVO Service (select) SQL library JVO Service (image) JVO Service (X match) JVO Service (count) SQL library ⑦’ issue SQL Image Data Image Data (copy) Copy imate data by GridFTP Image Data (copy) DB Service ORACLE 2003/11/27 CVO Meeting in Beijing The following free software is included by globus toolkit. OpenSSL (Secure Socket Library) OpenLDAP (LDAP Server) wu-ftpd (ftp server) Copy imate data by GridFTP SUBARU SupCam i-band Free Software In House Software Image Data Commercial Software Function

20 JVO Query Language 2003/11/27 CVO Meeting in Beijing

21 SkyQL & ADQL JVOQL has been adopted as one of the basis for SkyQL (standard query language in IVOA) XML description of SkyQL = ADQL Astronomical Data Query Language 2003/11/27 CVO Meeting in Beijing

22 Serious Issue Q) GT2 has too large overhead before starting actual jobs !! They are several seconds. A) For batch jobs, such as database accesses, the overhead could be negligible. However users can never wait for several second for interactive data analyses. Request) Overheads must be < 0.1 seconds excluding the network delays. 2003/11/27 CVO Meeting in Beijing

23 Partially solved !! Introduction of NMI
-- authentication module : binary Analysis of the source codes of GTK2 -- polling interval : 30 sec -> 3 sec Elapsed time was halved ! But …, still very slow. 2003/11/27 CVO Meeting in Beijing

24 Improvement of U.I. Need to know about SQL to use JVOQL →
An editor to create JVOQL from GUI Edittable on screen →　more flexibility for advanced users 2003/11/27 CVO Meeting in Beijing

25 2003/11/27 CVO Meeting in Beijing

26 Search for Gravitational Lenses caused (?) by Cosmic Strings
SXDS data observed by Subaru Query results were obtained less than 5 min., displaying SEDs It has been proven that VO can accelerate researches. 2003/11/27 CVO Meeting in Beijing

27 Cosmic Strings? Theoretical origin of the elementary particles which existed (?) at t ~ s，T ~ 1015 GeV Not a POINT, has its SIZE Width < 10-22m, Length ~ size of the Universe. Mass of 10km string ~ the Earth 2003/11/27 CVO Meeting in Beijing

28 Gravitational Lens A phenomenon that the space-time is distorted by a huge mass object, and multiple images of another object behind the massive object are observed around it. 2003/11/27 CVO Meeting in Beijing

29 2003/11/27 CVO Meeting in Beijing

30 Development of Prototype2
For preparation of Operational System User registration : single sign-on User area over Firewall : GSI-SFS Adoption of OGSA Implementation of several analysis tools 2003/11/27 CVO Meeting in Beijing

31 2003/11/27 CVO Meeting in Beijing データベースサーバ１ 分散情報管理 データベースサーバ２
データ検索処理 ORACLE Linux クロスマッチ処理 データ検索処理 データ数count PostgreSQL 画像管理 　　DB WSDL データベースサーバ２ SUBARU SupCam i-band Globus Toolkit V3 OGSA-DAI 解析処理 検索依頼 GWSDL ｾｷｭﾘﾃｨ 管理 OGSA -DAI Gb Ether データ数count 画像管理 　　DB Gb Ether Registry Globus Toolkit V3 OGSA-DAI 2MASS 利用者操作画面 資源管理 GT3 利用者 データ Local disk GSI-SFS DAISGR Globus Tk Linux ポータルサーバ 統合検索指示 統　合　検　索　実　行　制　御　機　能　 ﾎﾟｰﾀﾙｻｰﾌﾞﾚｯﾄ 登録情報検索機能 利用者管理機能 GT3 利用者 データ Local disk GSI-SFS 状況表示 条件指定画面 分散処理制御 解析サーバ 統合検索状況モニター ・DAISGR検索 ・GWDSL解釈 ・準備、実行、結果確認 解析処理 Linux データ保存 検索状況モニター画面 Web Server データベースサーバ N 統合検索結果表示機能 Globus Toolkit V3 データ検索処理 PostgreSQL WSDL ｽｹｼﾞｭｰﾙ作成　Ⅰ ｽｹｼﾞｭｰﾙ 作成　Ⅱ 画像管理 　　DB 解析指示 FW データ数count クロスマッチ処理 Globus Toolkit V3 検索結果画面 JVO-QL翻訳ｻｰﾊﾞ Globus Toolkit V3 OGSA-DAI SUBARU SupCam z-band Webブラウザ Solaris8 GT3 利用者 データ 結果サーバ GSI-SFS 解析処理 Windows, Solaris8, Linux GT3 利用者 データ Local disk GSI-SFS 検索依頼 2003/11/27 CVO Meeting in Beijing Solaris8

32 Road Map 2003 Prototype 2 → development of components for operation
2004　start to develop operational system 　late 2004 ?? trial use　 trial use & upgrade 2007　prepare for partial operation of ALMA 2003/11/27 CVO Meeting in Beijing

33 ALMA in Chile (sub-mm wave)
2003/11/27 CVO Meeting in Beijing

Download ppt "Current Status of Japanese Virtual Observatory"

Similar presentations

2005-5-18IVOA Interoperablity meeting KyotoMasahiro Tanaka (NAOJ) 1 JVO use of Globus Toolkit Masahiro Tanaka (NAOJ)

IVOA Interoperablity meeting KyotoMasahiro Tanaka (NAOJ) 1 JVO use of Globus Toolkit Masahiro Tanaka (NAOJ)
May 9, 2007Astro-RG, OGF201 Japanese Virtual Observatory and NaReGi Masatoshi Ohishi / NAOJ, Sokendai & NII /, &

May 9, 2007Astro-RG, OGF201 Japanese Virtual Observatory and NaReGi Masatoshi Ohishi / NAOJ, Sokendai & NII /, &
JAXA GRID Activity JAXA/EORC Kengo Aizawa KEIO UNIVHiromichi Fukui.

JAXA GRID Activity JAXA/EORC Kengo Aizawa KEIO UNIVHiromichi Fukui.
Abstraction Layers Why do we need them? –Protection against change Where in the hourglass do we put them? –Computer Scientist perspective Expose low-level.

Abstraction Layers Why do we need them? –Protection against change Where in the hourglass do we put them? –Computer Scientist perspective Expose low-level.
Construction of the Japanese Virtual Observatory (JVO) Abstract : The National Astronomical Observatory of Japan (NAOJ) has been operating several large.

Construction of the Japanese Virtual Observatory (JVO) Abstract : The National Astronomical Observatory of Japan (NAOJ) has been operating several large.
Design and Implementation of JVO SkyNode Yuji SHIRASAKI National Astronomical Observatory of Japan IVOA Small Projects Meeting, 2004 Oct 1.

Design and Implementation of JVO SkyNode Yuji SHIRASAKI National Astronomical Observatory of Japan IVOA Small Projects Meeting, 2004 Oct 1.
Distributed Heterogeneous Data Warehouse For Grid Analysis

Distributed Heterogeneous Data Warehouse For Grid Analysis
SXDS database and Japanese Virtual Observatory Yuji Shirasaki and JVO collaborations National Astronomical Observatory of Japan.

SXDS database and Japanese Virtual Observatory Yuji Shirasaki and JVO collaborations National Astronomical Observatory of Japan.
Jun Peng Stanford University – Department of Civil and Environmental Engineering Nov 17, 2000 DISSERTATION PROPOSAL A Software Framework for Collaborative.

Jun Peng Stanford University – Department of Civil and Environmental Engineering Nov 17, 2000 DISSERTATION PROPOSAL A Software Framework for Collaborative.
Web-Enabling the Warehouse Chapter 16. Benefits of Web-Enabling a Data Warehouse Better-informed decision making Lower costs of deployment and management.

Web-Enabling the Warehouse Chapter 16. Benefits of Web-Enabling a Data Warehouse Better-informed decision making Lower costs of deployment and management.
Web-based Software Development - An introduction.

Web-based Software Development - An introduction.
A long tradition. e-science, Data Centres, and the Virtual Observatory why is e-science important ? what is the structure of the VO ? what then must we.

A long tradition. e-science, Data Centres, and the Virtual Observatory why is e-science important ? what is the structure of the VO ? what then must we.
Zhonghua Qu and Ovidiu Daescu December 24, 2009 University of Texas at Dallas.

Zhonghua Qu and Ovidiu Daescu December 24, 2009 University of Texas at Dallas.
The Japanese Virtual Observatory (JVO) Yuji Shirasaki National Astronomical Observatory of Japan.

The Japanese Virtual Observatory (JVO) Yuji Shirasaki National Astronomical Observatory of Japan.
NAREGI WP4 (Data Grid Environment) Hideo Matsuda Osaka University.

NAREGI WP4 (Data Grid Environment) Hideo Matsuda Osaka University.
Data Management Kelly Clynes Caitlin Minteer. Agenda Globus Toolkit Basic Data Management Systems Overview of Data Management Data Movement Grid FTP Reliable.

Data Management Kelly Clynes Caitlin Minteer. Agenda Globus Toolkit Basic Data Management Systems Overview of Data Management Data Movement Grid FTP Reliable.
Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.

Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.
Yuji SHIRASAKI National Astronomical Observatory of Japan Current Status of Japanese Virtual Observatory (JVO)

Yuji SHIRASAKI National Astronomical Observatory of Japan Current Status of Japanese Virtual Observatory (JVO)
WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.

WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.

Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.

Similar presentations

Ads by Google