The GRelC Project: architecture, history and a use case in the environmental domain G. Aloisio - S. Fiore The Climate-G testbed is an interdisciplinary.

Slides:



Advertisements
Similar presentations
Project Overview Daniel Mallmann, Research Centre Juelich Alistair Dunlop, University of Southampton.
Advertisements

XtreemOS IP project is funded by the European Commission under contract IST-FP XtreemOS: Building and Promoting a Linux-based Operating System.
Current status of grids: the need for standards Mike Mineter TOE-NeSC, Edinburgh.
DELOS Highlights COSTANTINO THANOS ITALIAN NATIONAL RESEARCH COUNCIL.
Earth System Curator Spanning the Gap Between Models and Datasets.
FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.
Towards a Virtual European Supercomputing Infrastructure Vision & issues Sanzio Bassini
High Performance Computing Course Notes Grid Computing.
An overview of the EGEE project Bob Jones EGEE Technical Director DTI International Technology Service-GlobalWatch Mission CERN – June 2004.
1 On Death, Taxes, & the Convergence of Peer-to-Peer & Grid Computing Adriana Iamnitchi Duke University “Our Constitution is in actual operation; everything.
Intelligent Grid Solutions 1 / 18 Convergence of Grid and Web technologies Alexander Wöhrer und Peter Brezany Institute for Software.
Massimo Cafaro GridLab Review GridLab WP10 Information Services Massimo Cafaro CACT/ISUFI University of Lecce, Italy.
Data Grids: Globus vs SRB. Maturity SRB  Older code base  Widely accepted across multiple communities  Core components are tightly integrated Globus.
12006/9/26 Emerging Grid Standards Mark Baker, Amy Apon, Clayton Ferner, Jeff Brown. IEEE Computer Society,Vol. 38, Issue 4, pp , Year of Publication:
Porto, January Grid Computing Course Summary of day 2.
The OMII Position At the University of Southampton.
Institute for Scientific Computing – University of ViennaP.Brezany 1 Databases and the Grid Peter Brezany Institute für Scientific Computing University.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Client/Server Grid applications to manage complex workflows Filippo Spiga* on behalf of CRAB development team * INFN Milano Bicocca (IT)
An easy way to manage Relational Databases in the Globus Community Sandro Fiore ISUFI/ Center for Advanced Computational Technologies Director: prof. Giovanni.
GRACE Project IST EGAAP meeting – Den Haag, 25/11/2004 Giuseppe Sisto – Telecom Italia Lab.
Presenter: Dipesh Gautam.  Introduction  Why Data Grid?  High Level View  Design Considerations  Data Grid Services  Topology  Grids and Cloud.
1 School of Computer, National University of Defense Technology A Profile on the Grid Data Engine (GridDaEn) Xiao Nong
Grid Security Issues Shelestov Andrii Space Research Institute NASU-NSAU, Ukraine.
2005 © SWITCH Perspectives of Integrating AAI with Grid in EGEE-2 Christoph Witzig Amsterdam, October 17, 2005.
DataTAG Research and Technological Development for a Transatlantic Grid Abstract Several major international Grid development projects are underway at.
Enabling Grids for E-sciencE EGEE-III INFSO-RI I. AMGA Overview What is AMGA Metadata Catalogue of EGEE’s gLite 3.1 Middleware Main Feature of.
Service - Oriented Middleware for Distributed Data Mining on the Grid ,劉妘鑏 Antonio C., Domenico T., and Paolo T. Journal of Parallel and Distributed.
Middleware for Grid Computing and the relationship to Middleware at large ECE 1770 : Middleware Systems By: Sepehr (Sep) Seyedi Date: Thurs. January 23,
The Climate-G testbed towards a large scale data sharing environment for climate change S. Fiore Scientific Computing and Operations Division, CMCC, Italy.
Commodity Grid Kits Gregor von Laszewski (ANL), Keith Jackson (LBL) Many state-of-the-art scientific applications, such as climate modeling, astrophysics,
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
GO-ESSP Workshop, LLNL, Livermore, CA, Jun 19-21, 2006, Center for ATmosphere sciences and Earthquake Researches Construction of e-science Environment.
CEOS WGISS-21 CNES GRID related R&D activities Anne JEAN-ANTOINE PICCOLO CEOS WGISS-21 – Budapest – 2006, 8-12 May.
The Earth System Grid (ESG) Computer Science and Technologies DOE SciDAC ESG Project Review Argonne National Laboratory, Illinois May 8-9, 2003.
MTA SZTAKI Hungarian Academy of Sciences Introduction to Grid portals Gergely Sipos
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
The Climate-G testbed towards a large scale data sharing environment for climate change S. Fiore Scientific Computing and Operations Division, CMCC, Italy.
GCRC Meeting 2004 BIRN Coordinating Center Software Development Vicky Rowley.
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
August 3, March, The AC3 GRID An investment in the future of Atlantic Canadian R&D Infrastructure Dr. Virendra C. Bhavsar UNB, Fredericton.
INFSO-RI Enabling Grids for E-sciencE Experience of using gLite for analysis of ATLAS combined test beam data A. Zalite / PNPI.
Enabling e-Research in Combustion Research Community T.V Pham 1, P.M. Dew 1, L.M.S. Lau 1 and M.J. Pilling 2 1 School of Computing 2 School of Chemistry.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGI Operations Tiziana Ferrari EGEE User.
NeuroLOG ANR-06-TLOG-024 Software technologies for integration of process and data in medical imaging A transitional.
7. Grid Computing Systems and Resource Management
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Earth System Curator and Model Metadata Discovery and Display for CMIP5 Sylvia Murphy and Cecelia Deluca (NOAA/CIRES) Hannah Wilcox (NCAR/CISL) Metafor.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Robin McConnell NA3 Activity Manager 02.
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
Super Computing 2000 DOE SCIENCE ON THE GRID Storage Resource Management For the Earth Science Grid Scientific Data Management Research Group NERSC, LBNL.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE: Enabling grids for E-Science Bob Jones.
Towards ‘Ubiquitous’ Ubiquitous Computing: an alliance with ‘the Grid’ Oliver Storz, Adrian Friday, and Nigel Davies Computing Department, Lancaster University,
ETICS An Environment for Distributed Software Development in Aerospace Applications SpaceTransfer09 Hannover Messe, April 2009.
Cyberinfrastructure Overview of Demos Townsville, AU 28 – 31 March 2006 CREON/GLEON.
OGSA-DAI.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
EGI-InSPIRE EGI-InSPIRE RI Services for Earth Sciences Services for the EGI Heavy User Communities – EGITF 2010 Horst Schwichtenberg.
November 2, 2009 NOAA Climate Services Portal Prototype A collaborative, NOAA-wide prototyping effort featuring CPC, CPO, CSC, and NCDC A collaborative,
Grid Colombia Workshop with OSG Week 2 Startup Rob Gardner University of Chicago October 26, 2009.
Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.
Grid Services for Digital Archive Tao-Sheng Chen Academia Sinica Computing Centre
System Software Laboratory Databases and the Grid by Paul Watson University of Newcastle Grid Computing: Making the Global Infrastructure a Reality June.
Bob Jones EGEE Technical Director
GEOSS Component and Service Registry (CSR)
Regional Operations Centres Core infrastructure Centres
Un sistema avanzato per la gestione di immagini biomedicali in ambiente GRID G. Aloisio, S. Fiore SPACI Consortium & University of Salento, Italy, Lecce.
SuperComputing 2003 “The Great Academia / Industry Grid Debate” ?
Grid Training done in/by the Italian Federation in 2007 Roberto Barbera Univ. of Catania and INFN NA3 Partner Review Meeting at EGEE’07 Budapest,
University of Technology
Presentation transcript:

The GRelC Project: architecture, history and a use case in the environmental domain G. Aloisio - S. Fiore The Climate-G testbed is an interdisciplinary effort involving partners from several institutions and joining expertise in the field of climate change and computational science. Its main goal is to allow scientists carrying out geographical and cross-institutional data discovery, access, analysis, visualization and sharing of climate data. The Climate-G partners involved into the testbed are: the Centro Euro-Mediterraneo per i Cambiamenti Climatici (CMCC, Italy), the Institut Pierre-Simon Laplace (IPSL/CNRS, France), the Fraunhofer Institut für Algorithmen und Wissenschaftliches Rechnen (SCAI, Germany), the National Center for Atmospheric Research (NCAR, USA) and Rensselaer Polytechnic Institute (RPI, USA), the University of Reading (Reading, UK), the University of Cantabria (UC, Spain) and the University of Salento (UniSalento, Italy). The Climate-G Portal is the access point to the entire testbed infrastructure. It represents the scientific gateway of the testbed and it is intended for scientists and researchers that easily and transparently want to manage the available climate change experiments and datasets. Basically, all of the activities related to the testbed infrastructure must be carried out exploiting high level web interfaces available through the Climate-G Portal. This means that all of the involved actors in the scene (system/portal administrators, scientists, guest users, data and metadata providers, etc.) have to perform most/all of their activities through the portal. Fig.4 shows the central role of the portal in the Climate-G infrastructure. The GRelC DAIS is a general purpose data grid service for database access, query and management. This service acts as a standard front-end for database access on the grid. It provides both basic and advanced primitives to transparently access, query, manage and interact with different data sources, concealing the back-end heterogeneity, Globus GSI and VOMS, security details, connection and other low level issues. It currently (i) exploits the Web-Services paradigm (WS-I based), (ii) it is compatible with Globus and gLite grid middleware/environments and (iii) it provides grid-enabled query mechanisms leveraging compression, chunking, pre-fetching and streaming to enhance performance on a wide area network/grid environment. Moreover, it supports both global (by means of VOMS) and local (on the GRelC DAS side) authorization levels, increasing flexibility, manageability and scalability in role and policy management. The main goal of this data grid service is to efficiently, securely and transparently manage databases on the grid, across virtual organizations, with regard to modern grid standards and specifications (OGSA and WSRF compliant) as well as existing middleware such as Globus, gLite, etc. The GRelC project started in 2001 as a research effort at the University of Salento with a Ph.D. thesis. The initial goal was both simple and ambitious: to provide a set of data grid services to transparently, securely and efficiently manage relational databases in a grid environment. Until 2004, the GRelC releases exploited a client-server architecture, a proprietary communication protocol and the Grid Security Infrastructure. In 2006 the GRelC service was completely re-engineered to address interoperability through a WS-based approach. Instead of moving towards OGSI (which seemed to be too heavy), the GRelC service was implemented as a web service WS-I compliant and GSI enabled, that is a very light implementation. The gLite-based release (2007) was a crucial step to meet the EGEE community, their use cases and needs. This community provided new important requirements, particulary in the Earth Science context (EGEE NA4). That release was also available for training and dissemination purposes through the GILDA t-infrastructure. From 2008, the GRelC software has been included into the Italian grid release (gLite-based) and distributed into the Worker nodes and User Interfaces components across the Italian country. This way, several performance tests based on the gLite middleware were also carried out to stress the system and prove its stability. In the same year, GRelC was included into the EGEE RESPECT Program due to its compatibility with the gLite middleware and its added value with regard to new database-oriented functionalities that were not available in the gLite release at that time. From 2009 to 2010 new GRelC releases (server and portal) addressing stability, management and monitoring were made available to the user community. In 2011, the GRelC team will face new challenges. The most relevant one will be related to the EGI Database of Databases (a global registry hosting the list of DB resources available in the EGI context). The registry will complement the EGI Application Database allowing scientists to know more about existing DBs, their location, main purpose, available data, etc. This will help the co-operation and interaction among research groups, promoting a more effective publishing and sharing of grid-enabled data sources.