Chinese activity on inter-Grid test between SRB and SIG Guoqing Li, RSGS/NRSCC & Carol Song, RCAC/Purdue University Presented at WGISS-23, Hanoi 23 May.

Slides:



Advertisements
Similar presentations
National University Community Research Institute (NUCRI) NU Community Research Institute (NUCRI) HASTAC (higher education)/HASS grid National School Board.
Advertisements

National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Data Grids for Collection Federation Reagan W. Moore University.
CHINA REMOTE SENSING SATELLITE GROUND STATION, CHINESE ACADEMY OF SCIENCES China Grid Research Update Li Guoqing, RSGS, CAS, China.
ESA Data Integration Application Open Grid Services for Earth Observation Luigi Fusco, Pedro Gonçalves.
Overview of China Spatial Information Gird (SIG) Research Works Presentation to WGISS-16 Chiang Mai, Thailand September 15, 2003 Pro. Liu Dingsheng, Dr.
Peter Berrisford RAL – Data Management Group SRB Services.
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE SAN DIEGO SUPERCOMPUTER CENTER Particle Physics Data Grid PPDG Data Handling System Reagan.
San Diego Supercomputer CenterNational Partnership for Advanced Computational Infrastructure1 Grid Based Solutions for Distributed Data Management Reagan.
Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.
Need for SOA database for storing SOA data Divya Gade Rejitha Rajasekhar.
Complex Systems Engineering for the Global information Grid Bob Marcus
VL-e PoC Introduction Maurice Bouwhuis VL-e work shop, April 7 th, 2006.
Chronopolis: Preserving Our Digital Heritage David Minor UC San Diego San Diego Supercomputer Center.
Applying Data Grids to Support Distributed Data Management Storage Resource Broker Reagan W. Moore Ian Fisk Bing Zhu University of California, San Diego.
Guided Conversational Agents and Knowledge Trees for Natural Language Interfaces to Relational Databases Mr. Majdi Owda, Dr. Zuhair Bandar, Dr. Keeley.
Stanford University / PEER K.H. Law and J. Peng Law, Peng 2000 A Software Platform for Collaborative Development of OpenSees Jun Peng and Kincho H. Law.
GMD German National Research Center for Information Technology Innovation through Research Jörg M. Haake Applying Collaborative Open Hypermedia.
New Generation SDI and Cyber-Infrastructure Prof. Guoqing Li CEODE/CAS March 29, 2009, Newport Beach, USA Presented to 4th China-US Roundtable Meeting.
TeraGrid Gateway User Concept – Supporting Users V. E. Lynch, M. L. Chen, J. W. Cobb, J. A. Kohl, S. D. Miller, S. S. Vazhkudai Oak Ridge National Laboratory.
- 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)
1 Dr. Markus Hillenbrand, ICSY Lab, University of Kaiserslautern, Germany A Generic Database Web Service for the Venice Service Grid Michael Koch, Markus.
1 Web Server Administration Chapter 1 The Basics of Server and Web Server Administration.
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
Scientific Data Grid on NGI Kai Nan Computer Network Information Center Chinese Academy of Sciences CANS 2004, Miami.
CEOS Grid TT Session Summery Discussion Li Guoqing 13 Sept Kiev.
National Center for Supercomputing Applications NCSA OPIE Presentation November 2000.
China Grid Activity on SIG Presented by Guoqing Li At WGISS-21, Budapest 8 May, 2006.
Adaptive Hypermedia Tutorial System Based on AHA Jing Zhai Dublin City University.
Design of a Search Engine for Metadata Search Based on Metalogy Ing-Xiang Chen, Che-Min Chen,and Cheng-Zen Yang Dept. of Computer Engineering and Science.
Mainframe (Host) - Communications - User Interface - Business Logic - DBMS - Operating System - Storage (DB Files) Terminal (Display/Keyboard) Terminal.
Application portlets within the PROGRESS HPC Portal Michał Kosiedowski
San Diego Supercomputer Center National Partnership for Advanced Computational Infrastructure SRB + Web Services = Datagrid Management System (DGMS) Arcot.
Kurt Mueller San Diego Supercomputer Center NPACI HotPage Updates.
Grid Architecture William E. Johnston Lawrence Berkeley National Lab and NASA Ames Research Center (These slides are available at grid.lbl.gov/~wej/Grids)
National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Persistent Management of Distributed Data Reagan W. Moore.
National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Persistent Archive for the NSDL Reagan W. Moore Charlie Cowart.
Wenchuan Earthquake International EO Data Assistance Grid Prof. Guoqing Li, CEODE, CAS Present to WGISS26 , Boulder, 23rd, Spet, 2008.
Institute For Digital Research and Education Implementation of the UCLA Grid Using the Globus Toolkit Grid Center’s 2005 Community Workshop University.
Future directions Chip Casanave Data Access Worldwide Miami, Florida.
The Global Land Cover Facility is sponsored by NASA and the University of Maryland.The GLCF is a founding member of the Federation of Earth Science Information.
A Data Access Framework for ESMF Model Outputs Roland Schweitzer Steve Hankin Jonathan Callahan Kevin O’Brien Ansley Manke.
ICalendar Compatible Collaborative Calendar- Server (CCS) Web Services Ahmet Fatih Mustacoglu Indiana University Computer Science Department Community.
EGEE User Forum Data Management session Development of gLite Web Service Based Security Components for the ATLAS Metadata Interface Thomas Doherty GridPP.
Michael Doherty RAL UK e-Science AHM 2-4 September 2003 SRB in Action.
Ch. 101 Database Management An Introduction to Databases.
1 e-Science AHM st Aug – 3 rd Sept 2004 Nottingham Distributed Storage management using SRB on UK National Grid Service Manandhar A, Haines K,
Introduction to The Storage Resource.
TeraGrid Gateway User Concept – Supporting Users V. E. Lynch, M. L. Chen, J. W. Cobb, J. A. Kohl, S. D. Miller, S. S. Vazhkudai Oak Ridge National Laboratory.
China SIG activities update Guoqing Li, Zhenchun Huang Presented in WGISS24, Munich
SDSC Storage Resource Broker & Meta-data Catalog SRB Archives HPSS, ADSM, UniTree, DMF Databases DB2, Oracle, Sybase File Systems Unix, NT, Mac OSX Application.
Chinese Grid Activities Update Guoqing Li NRSCC/CEODE Present to WGISS-27, Toulouse, France May, 2009.
Grid Task Team Activity Update on WGISS-21 Guoqing Li RSGS,NRSCC WGISS-21, Budapest,
China Grid Activities update Li Guoqing NRSCC, China 13,Sept, 2005 Present for WGISS-20, Kiev.
The Storage Resource Broker and.
The ECOST Web-based platform for data providers and for data users.
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
Preservation Data Services Persistent Archive Research Group Reagan W. Moore October 1, 2003.
Data Infrastructure in the TeraGrid Chris Jordan Campus Champions Presentation May 6, 2009.
DataGrid France 12 Feb – WP9 – n° 1 WP9 Earth Observation Applications.
Grid Services for Digital Archive Tao-Sheng Chen Academia Sinica Computing Centre
Towards a High Performance Extensible Grid Architecture Klaus Krauter Muthucumaru Maheswaran {krauter,
Problem: Ecological data needed to address critical questions are dispersed, heterogeneous, and complex Solution: An internet-based mechanism to discover,
Architecture Components
GSAF Grid Storage Access Framework
WGISS-22 Update of Grid TT
Knowledge Based Workflow Building Architecture
Arcot Rajasekar Michael Wan Reagan Moore (sekar, mwan,
Interlib Technology Integration
Enterprise Infrastructure
Presentation transcript:

Chinese activity on inter-Grid test between SRB and SIG Guoqing Li, RSGS/NRSCC & Carol Song, RCAC/Purdue University Presented at WGISS-23, Hanoi 23 May 2007

2 Contents Background Cooperation archtiture from the view of Inter-Grid Experiment and Result Preliminary conclusion

3 Collaboration Mode There are three modes on grid data resources collaboration. Mode I: Making one resource node cooperated with another node Mode II Making one node of Grid A as a node of Grid B Mode III Making Grid A as a node of Grid B

4 Mode I node Cooperation Mechanism Grid One of the mechanism is Grid

5 Mode II Node Grid Register Grid A Node resource Node Grid Register Grid B This resource is not a special one. Both Grid A and Grid B cannot cooperate each other with the two nodes of this resource.

6 Mode III Node Grid Register Grid A Node resource Node Grid Register Grid B This resource is a special one. Two Grids can cooperate with the service nodes on this resource. Broker mechanism is active. broker

7 Background of SRB/SIG Target of the research (Why Inter-Grid?) To connect the EO data resources between two independent grid systems. To find the way of inter-grid operation. Participants in this case RCAC (Rosen Center for Advanced Computing) of Purdue university RSGS/NRSCC

8 GIG NCSA TACC UC NCAR SDSCORNL Purdue PSC IU TeraGrid RSGS Tsinghua CAF SIG InterGrid

9 RCAC Data services resource

10

11 SIG Data services resource

12 Data Nodes (resource) SIG Container Query Service (eWCS) Access Service (eWFS) WMS Service Uniform interface Uniform interface Uniform interface Adaptor Develop Tools LAN Operate SQL+API Daemon How does SIG organize its data resource?

13 Principles Gird user of both sides can find and access the whole data resources. Keeping the original resource organization structure. (Black Box) For most data resources, Need not to be registered into second Grid Need not to add new service interface for second Grid

14 Cooperation archtiture from the view of Inter-Grid SIG SRB SIG MCAT SIG Data Register SIG SRB SIG InterGrid Broker

15 From SRB to SIG SIG Broker SRB Data Source SRB Data Source SIG Data Register SIG Data Source MCAT User Portal

16 Service Interface XML query sentence Adaptor SRB database B.prop Of B Meta Query Query Engine Sql sentence SIG Adapter A SRB Adapter B SIG database A Example: the implementation of SRB2SIG data query service.prop Of A

17 From SIG to SRB SIG Data Source SRB SIG Data Source SRB MCAT SRB Data Source SIG data Register SRB Client

18 The implementation of SRB data query service SRB SERVER Adapter sig database MCAT SRB core SIG Adapter File Systems Unix, NT,Mac OSX Databases DB2, Oracle Sybase Archives HPSS, ADSM, UniTree, DMF SIG SRB Client

19 Experiment and Result At present, we have implemented the broker from SRB to SIG service It means that with SIG Portal, the user can search and access the data stored in SRB data source. With the help of SRB MCAT mechanism, there is only one SRB2SIG broker service should be set within the certain SRB domain. All data in this domain will be available for SIG user. SRB  SIG ( ok ) SIG  SRB ( under going )

20

21

22

23

24

25 Following works Negotiating with Purdue about the registering of SRB2SIG broker into Purdue’s SRB domain, with their experiment partner - certification control. Working with Purdue’s SRB experts to implement SIG2SRB broker, which work needs the knowledge of SRB intramural technology. Bringing out a web-service based framework of inter- grid broker mechanism. Applying them in the following project to check its adapting capability.

26 Other Works The inter-grid between ESA G-POD and China SIG is ongoing. This work is also located at the level of EUChinaGrid. There steps (data level/ task level/ application level) Now at data level …… A report will be given at WGISS-24 New Chinese EO Grid Plan National wide EO data grid and processing grid Not very clear Also will be reported at next WGISS meeting

27 Thank you.