Data Grid Management (WP2) W. H. Bell Grid Data Management (WP2) William Bell University of Glasgow.

Slides:

Advertisements

Similar presentations

Experiences of the Grid… Gavin McCance University of Glasgow NeSC Meeting, 24 October 2001.

Advertisements

1 WP2: Data Management Paul Millar eScience All Hands Meeting September

WP2: Data Management Gavin McCance University of Glasgow November 5, 2001.

WP2: Data Management Gavin McCance University of Glasgow.

EU DataGrid TestBed 2 Component Review Paul Millar (University of Glasgow) (slides based on a presentation by Erwin Laure)

OptorSim: A Replica Optimisation Simulator for the EU DataGrid W. H. Bell, D. G. Cameron, R. Carvajal, A. P. Millar, C.Nicholson, K. Stockinger, F. Zini.

Dynamic Grid Optimisation TERENA Conference, Lijmerick 5/6/02 A. P. Millar University of Glasgow.

Metadata Progress GridPP18 20 March 2007 Mike Kenyon.

WP2 and GridPP UK Simulation W. H. Bell University of Glasgow EDG – WP2.

Enterprise Java and Data Services Designing for Broadly Available Grid Data Access Services.

Eldas 1.0 Enterprise Level Data Access Services Design Issues, Implementation and Future Development Davy Virdee.

Data Management Expert Panel - WP2. WP2 Overview.

Data Management Expert Panel. RLS Globus-EDG Replica Location Service u Joint Design in the form of the Giggle architecture u Reference Implementation.

EU 2nd Year Review – Jan – Title – n° 1 WP1 Speaker name (Speaker function and WP ) Presentation address e.g.

1 G2 and ActiveSheets Paul Roe QUT Yes Australia!

GGF Toronto Spitfire A Relational DB Service for the Grid Peter Z. Kunszt European DataGrid Data Management CERN Database Group.

1 Lecture 13: Database Heterogeneity Debriefing Project Phase 2.

DataGrid Kimmo Soikkeli Ilkka Sormunen. What is DataGrid? DataGrid is a project that aims to enable access to geographically distributed computing power.

1 Application Specific Module for P-GRADE Portal 2.7 Application Specific Module overview Akos Balasko MTA-SZTAKI LPDS

GridPP9 – 5 February 2004 – Data Management DataGrid is a project funded by the European Union GridPP is funded by PPARC WP2+5: Data and Storage Management.

The LCG File Catalog (LFC) Jean-Philippe Baud – Sophie Lemaitre IT-GD, CERN May 2005.

1 Dr. Markus Hillenbrand, ICSY Lab, University of Kaiserslautern, Germany A Generic Database Web Service for the Venice Service Grid Michael Koch, Markus.

5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)

Module 14: WCF Send Adapters. Overview Lesson 1: Introduction to WCF Send Adapters Lesson 2: Consuming a Web Service Lesson 3: Consuming Services from.

DataGrid is a project funded by the European Union CHEP 2003 – March 2003 – Next Generation Data Mgmt... – n° 1 James Casey CERN

Ajou University, South Korea GCC 2003 Presentation Dynamic Data Grid Replication Strategy based on Internet Hierarchy Sang Min Park , Jai-Hoon Kim, and.

1 WP2: Data Management Gavin McCance RAL Middleware Workshop 24 February 2003.

Tony Doyle & Gavin McCance - University of Glasgow ATLAS MetaData AMI and Spitfire: Starting Point.

Author - Title- Date - n° 1 Partner Logo EU DataGrid, Work Package 5 The Storage Element.

INFSO-RI Enabling Grids for E-sciencE AMGA Metadata Server - Metadata Services in gLite (+ ARDA DB Deployment Plans with Experiments)

Enabling Grids for E-sciencE EGEE-III INFSO-RI I. AMGA Overview What is AMGA Metadata Catalogue of EGEE’s gLite 3.1 Middleware Main Feature of.

Giuseppe Codispoti INFN - Bologna Egee User ForumMarch 2th BOSS: the CMS interface for job summission, monitoring and bookkeeping W. Bacchi, P.

EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks AMGA PHP API Claudio Cherubino INFN - Catania.

3 Copyright © 2009, Oracle. All rights reserved. Accessing Non-Oracle Sources.

INFSO-RI Enabling Grids for E-sciencE OGSA DAI Data Access and Integration Marek Ciglan Institute of Informatics, Slovac Academy.

Replica Management Services in the European DataGrid Project Work Package 2 European DataGrid.

Caitriana Nicholson, CHEP 2006, Mumbai Caitriana Nicholson University of Glasgow Grid Data Management: Simulations of LCG 2008.

Metadata Mòrag Burgon-Lyon University of Glasgow.

Amy Krause EPCC OGSA-DAI An Overview OGSA-DAI Technology Update GGF17, Tokyo (Japan)

EGEE User Forum Data Management session Development of gLite Web Service Based Security Components for the ATLAS Metadata Interface Thomas Doherty GridPP.

Data Management GridPP and EDG Gavin McCance University of Glasgow May 9, 2002

DGC Paris WP2 Summary of Discussions and Plans Peter Z. Kunszt And the WP2 team.

1 Service Creation, Advertisement and Discovery Including caCORE SDK and ISO21090 William Stephens Operations Manager caGrid Knowledge Center February.

INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.

D. Duellmann - IT/DB LCG - POOL Project1 The LCG Pool Project and ROOT I/O Dirk Duellmann What is Pool? Component Breakdown Status and Plans.

Data Manipulation with Globus Toolkit Ivan Ivanovski TU München,

Overview of C/C++ DB APIs Dirk Düllmann, IT-ADC Database Workshop for LHC developers 27 January, 2005.

Matthew Farrellee Computer Sciences Department University of Wisconsin-Madison Condor and Web Services.

CERN – European Organization for Nuclear Research Administrative Support - Internet Development Services EDH from User Point of View Rostislav Titov, James.

DGC Paris Spitfire A Relational DB Service for the Grid Leanne Guy Peter Z. Kunszt Gavin McCance William Bell European DataGrid Data Management.

1 P.Kunszt C EU DataGrid Data Management Workpackage : WP2 Status and Plans Peter Z Kunszt IT/DB

User requirements and use-cases JRA4 Face-to-Face Meeting – CERN 16 June 2004 Paul Mealor, UCL.

Copyright 2007, Information Builders. Slide 1 iWay Web Services and WebFOCUS Consumption Michael Florkowski Information Builders.

Enabling Grids for E-sciencE CMS/ARDA activity within the CMS distributed system Julia Andreeva, CERN On behalf of ARDA group CHEP06.

Overview of the New Security Model Akos Frohner (CERN) WP8 Meeting VI DataGRID Conference Barcelone, May 2003.

INFSO-RI Enabling Grids for E-sciencE Padova site report Massimo Sgaravatto On behalf of the JRA1 IT-CZ Padova group.

WP2: Data Management Gavin McCance University of Glasgow.

Amy Krause EPCC OGSA-DAI An Overview OGSA-DAI on OMII 2.0 OMII The Open Middleware Infrastructure Institute NeSC,

October 2014 HYBRIS ARCHITECTURE & TECHNOLOGY 01 OVERVIEW.

Database Replication and Monitoring

Gavin McCance University of Glasgow GridPP2 Workshop, UCL

(on behalf of the POOL team)

The Work Package 2 experience

Spitfire Overview Gavin McCance.

BOSS: the CMS interface for job summission, monitoring and bookkeeping

Dirk Düllmann CERN Openlab storage workshop 17th March 2003

NA4 Test Team Status Test meeting, 07/09/04

Stephen Burke, PPARC/RAL Jeff Templon, NIKHEF

The Tropos visual modeling language A meta-model.

Gridifying the LHCb Monte Carlo production system

Presentation transcript:

Data Grid Management (WP2) W. H. Bell Grid Data Management (WP2) William Bell University of Glasgow

Data Grid Management (WP2) W. H. Bell Overview Introducing WP2 Query Optimisation Meta Data Services Statements and Future Work

Data Grid Management (WP2) W. H. Bell EU Data Grid

Data Grid Management (WP2) W. H. Bell Query Optimisation W. H. Bell 1, D. G. Cameron 1, L. Capozza 2, M. Carman 2, G. McCance 1, P. Millar 1, L. Serafini 2, K. Stockinger 3, F. Zini 2 1 University of Glasgow, Glasgow, G12 8QQ, Scotland 2 ITC-irst, Via Sommarive 18, Povo (Trento), Italy 3 CERN, Geneva, Switzerland

Data Grid Management (WP2) W. H. Bell Query Optimisation Local minimisation of execution time by replica selection. Two phase minimisation 1.RB selects CE based speculative cost 2.Job contacts RM (RO), and pins file

Data Grid Management (WP2) W. H. Bell Query Optimisation

Data Grid Management (WP2) W. H. Bell Economic Model

Data Grid Management (WP2) W. H. Bell Meta Data Service W. H. Bell 1, L. Guy 2, P. Kunszt 2, G. McCance 1 1 University of Glasgow, Glasgow, G12 8QQ, Scotland 2 CERN, Geneva, Switzerland

Data Grid Management (WP2) W. H. Bell Meta Data Service Different from Existing Spitfire –Scrap XSQL, allow administrator access –No templates needed Implementation –Compartmentalised: Servlets (Use in WP3) –Provide generic support for RDBs –Pickup security concepts from Spitfire

Data Grid Management (WP2) W. H. Bell Meta Data Service Provide Generic RDB Access User Access via HTTPS Decode XML with WSDL/Soap Security Servlet Maps Roles Command Translator From generic to specific Backend Types Oracle, PostgreSQL, MySQL

Data Grid Management (WP2) W. H. Bell Statments and Future Work Query Optimisation –API document in final stages of discussion First release of code in May. –Simulation platform under construction Meta Data Services –API document nearing completion –Coding starts soon.