Antony WilsonGridPP - November 2001 The Data Grid DIT & Schema.

Slides:

Advertisements

Similar presentations

1 Grid networking in EU DataGRID TERENA conference Limerick - 5 th of June 2002 Pascale PRIMET Manager of the workpackage Network of the DataGRID project.

Advertisements

All Hands MeetingD. Colling, Imperial College London, for the GridPP Project 1 Hans Hoffman has described the scale of the problems that we are facing,

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Networking Paul Mealor.

Andrew McNab - Manchester HEP - 17 September 2002 Putting Existing Farms on the Testbed Manchester DZero/Atlas and BaBar farms are available via the Testbed.

Jens G Jensen Atlas Petabyte store Supporting Multiple Interfaces to Mass Storage Providing Tape and Mass Storage to Diverse Scientific Communities.

PPARCAntony WilsonGlobal Grid Forum - October 2001 European Data Grid DIT & Schema.

Submitting Jobs to the Grid from UCL Ben West Overview The Logging and Bookkeeping Service The User Interface Submitting a job The Resource Broker RB Master.

R-GMA Producers and Archiver Paul Mealor. edg-pinger-timeping edg-netmon-rgma-info Producer API edg-gridftplog2rgma Producer API Log Here be servlets.

Data services on the NGS.

Bob Jones – Project Architecture - 1 March n° 1 Information & Monitoring Services Antony Wilson WP3, RAL

For(int i = 1; i

Job Submission and Resource Brokering WP 1. Contents: The components What (should) works now and configuration How to submit jobs … the UI and JDL Planned.

Grid Application Builders Teach In31/01/02Antony Wilson Information & Monitoring Services WP3.

FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.

EU 2nd Year Review – Feb – WP2/WP7 demonstration – n° 1 WP7 Report Status on Release 2.0 and plans CNRS/UREC.

F.Pacini - Milan - 7 maggio, n° 1 UI Interactions and Interfaces with the Workload Manager Components DataGrid WP1 F. Pacini

Job Submission The European DataGrid Project Team

Hands-on on Information System Antonio Fuentes Bermejo Oviedo, 20 de Noviembre de 2006.

LNL M.Biasotto, Bologna, 20 novembre Providing the Grid Information Service with information of local farms Massimo Biasotto – INFN LNL Massimo.

1 SLAC Internet Measurement Data Les Cottrell, Jerrod Williams, Connie Logg, Paola Grosso SLAC, for the ISMA Workshop, SDSC June,

GridPP meeting Feb 03 R. Hughes-Jones Manchester WP7 Networking Richard Hughes-Jones.

Computer Networks Fall, 2007 Prof Peterson. CIS 235: Networks Fall, 2007 Western State College  What is “store and forward”?  What is a buffer / queue?

Workload Management Massimo Sgaravatto INFN Padova.

Hands-on on Information System Antonio Fuentes Bermejo Oviedo, 20 de Noviembre de 2006.

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Etienne Dublé - CNRS/UREC Alfredo Pagano – GARR NetJobs: Network Monitoring.

OSG End User Tools Overview OSG Grid school – March 19, 2009 Marco Mambelli - University of Chicago A brief summary about the system.

The EU DataGrid – Information and Monitoring Services The European DataGrid Project Team

The EDG Middleware User Interface Flavia Donno for IT and WPs

A Java Based Prototype Grid User Interface Janice Drohan Project Supervisor: Prof. Peter Clarke.

WP3 RGMA Deployment Laurence Field / RAL Steve Fisher / RAL.

Introduction to the current EDG Testbed Software Krak ó w, December 2002 Steve Fisher – on behalf of The European.

INFSO-RI Enabling Grids for E-sciencE Information System : a detailed overview Giuseppe La Rocca INFN – Catania ICTP/INFM-Democritos.

Tiziana FerrariNetwork metrics usage for optimization of the Grid1 DataGrid Project Work Package 7 Written by Tiziana Ferrari Presented by Richard Hughes-Jones.

EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Middleware: gLite Information Systems (IS) EGEE Tutorial 23 rd APAN Meeting,

DataGrid is a project funded by the European Union CHEP March 2003 R-GMA 1 R-GMA: First results after deployment Steve Fisher (EDG - WP3)

Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.

Grid Resource Allocation and Management (GRAM) Execution management Execution management –Deployment, scheduling and monitoring Community Scheduler Framework.

C. Loomis – Integration Status- October 31, n° 1 Integration Status October 31, 2001

CLRC and the European DataGrid Middleware Information and Monitoring Services The current information service is built on the hierarchical database OpenLDAP.

Proposal for a IS schema Massimo Sgaravatto INFN Padova.

Distributed FutureGrid Clouds for Scalable Collaborative Sensor-Centric Grid Applications For AMSA TO 4 Sensor Grid Technical Interchange Meeting March.

gLite Information System UNIANDES OOD Team Daniel Alberto Burbano Sefair, Michael Angel.

DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 1 UDPmon Measuring Throughput with UDP  Send a burst of UDP frames spaced at regular.

R-GMA – an Update A reminder of R-GMA The need for a mediator Work with WP7 Release 1.2 and beyond Some Implications of OGSA.

LCG workshop on Operational Issues CERN November, EGEE CIC activities (SA1) Accounting: current status

BNL Service Challenge 3 Status Report Xin Zhao, Zhenping Liu, Wensheng Deng, Razvan Popescu, Dantong Yu and Bruce Gibbard USATLAS Computing Facility Brookhaven.

EGEE-0 / LCG-2 middleware Practical.

DataTAG: Glue schema test C.Vistoli DataTAG Wp4 Meeting 23/5/2002.

WP7 Middleware Status and Plans Paul Mealor. Contents GridFTP monitoring Network monitoring information in RGMA UK network monitoring.

DataTAG is a project funded by the European Union CERN, 8 May 2003 – n o 1 / 29 GridICE The eyes of the grid A monitoring tool for a Grid Operation Center.

1 QoS monitoring activities TF-STREAM November 127 th, 2000 Victor Reijs

The EU DataGrid – Information and Monitoring Services The European DataGrid Project Team

EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical: The Information Systems.

Data Management The European DataGrid Project Team

NMWG GGF7 Tokyo March 2003 Paul Mealor UCL EDG WP7 Network Monitoring Schema Paul Mealor NM-WG GGF7 Presented by Richard Hughes-Jones.

EGEE is a project funded by the European Union under contract IST Information Systems Flavia Donno Section Leader for LCG Experiment Integration.

An approach to Web services Management in OGSA environment By Shobhana Kirtane.

DataGrid WP7 Network Monitoring Robin Tasker, Daresbury Laboratory, 8 March 2001 Network Monitoring Requirements document produced,

INFSO-RI Enabling Grids for E-sciencE The Information System: GRIS, GIIS, BDII, information providers, Installation,Configuration,

FILE TRANSFER SPEEDS OVER HTTP AND FTP Yibiao Li 06/01/2009 Christmas Meeting 2008/09.

Massimo Sgaravatto INFN Padova

Which network parameters are interesting

The Information System in gLite middleware

Data services on the NGS

The EU DataGrid – Information and Monitoring Services

The Information System in gLite

Networking for grid Network capacity Network throughput

WP7 Network Monitoring Schemata

gLite Information System Overview

Information System in gLite

Presentation transcript:

Antony WilsonGridPP - November 2001 The Data Grid DIT & Schema

Antony WilsonGridPP - November 2001 The European Data Grid supportedFileSystem - multi-valued, ces batchSystem - multi-valued, ces massStorageDescription - cis experimentalSoftware - multi-valued, ces siteName - cis sysAdminContact - cis userSupportContact - cis dataGridVersion - ces installationDate - time cpuResourceDescription - cis diskResourceDescription - cis objectclass=siteinfo

Antony WilsonGridPP - November 2001 Data Grid Site

Antony WilsonGridPP - November 2001 The Computing Element objectclass=ComputingElement CEId - cis GlobusResourceContactString - cis GRAMVersion - cis Architecture - cis OpSys - cis MinPhysicalMemory - int MinLocalDiskSpace - int TotalCPUs - int FreeCPUs - int NumSMPs - int MinSPUProcessors - int MaxSPUProcessors - int TotalJobs - int RunningJobs – int IdleJobs - int MaxTotalJobs - int MaxRunningJobs - int WorstTraversalTime - float

Antony WilsonGridPP - November 2001 EstimatedTraversalTime - float Active - boolean Priority - int MaxCPUTime - float MaxWallClockTime - float AverageSI00 - float MinSI00 - float MaxSI00 - float AuthorizedUsersList - multi-valued cis RunTimeEnvironmentsList - multi-valued cis AFSAvailable - boolean OutboundIP - boolean InboundIP - boolean QueueName - cis LRMSType - cis LRMSVersion - cis The Computing Element objectclass=ComputingElement

Antony WilsonGridPP - November 2001 Close Storage Element objectclass=CloseSE CloseSE - cis Mountpoint - cis

Antony WilsonGridPP - November 2001 The Storage Element objectclass=StorageElement SEid - cis CloseCE - mutli-valued cis SEtypearchitecture - cis SEsize - int SEResourceContactString - cis SEmaxfilesize - int SEmaxdata - int SEmaxnumfile - int

Antony WilsonGridPP - November 2001 Storage Element Protocols objectclass=StorageElementProtocol SEProtocol - cis SEid - cis Port - int

Antony WilsonGridPP - November 2001 Storage Element Status objectclass=StorageElementStatus SEfreespace - int SEsccesstime - int Sefilequeuelength - int

Antony WilsonGridPP - November 2001 The File Element objectclass=FileElement localfilename - ces filecreatedate - cis filemodifydate - cis fileaccessdate - cis filesize - int filelatency - int filelifetime - int fileownname - cis

Antony WilsonGridPP - November 2001 Network Monitoring

Antony WilsonGridPP - November 2001 Remote Organisational Units objectclass=NetworkMonitorHost, NetworkMonitorRTT,NetworkMonitorLoss rou - cis rttmax - float rttavg - float rttmin - float rttmdev - float rttlastmodified - float lossmin - cisfloat lossmax - cisfloat lossavg - cisfloat losslastmodified - cis

Antony WilsonGridPP - November 2001 Tools

Antony WilsonGridPP - November 2001 Pinger objectclass= NetworkMonitorTool, NetworkMonitorRTT,NetworkMonitorLoss tool - cis toolname - cis toolversion - cis rttmax - float rttavg - float rttmin - float rttmdev - float rttlastmodified - float lossmin - cisfloat lossmax - cisfloat lossavg - cisfloat losslastmodified - cis

Antony WilsonGridPP - November 2001 RTT Packet Size objectclass= NetworkMonitorRTTPacketSize rttpacketsize - int rttmax - float rttavg - float rttmin - float rttmdev - float rttlastmodified - float

Antony WilsonGridPP - November 2001 Loss Packet Size objectclass= NetworkMonitorLossPacketSize losspacketsize - int lossmin - cisfloat lossmax - cisfloat lossavg - cisfloat losslastmodified - cis

Antony WilsonGridPP - November 2001 Iperf objectclass= NetworkMonitorTool, NetworkMonitorThroughput tool - cis toolname - cis toolversion - cis throughputtransmax - float throughputtransavg - float throughputtransmin - float throughputlastmodified - float

Antony WilsonGridPP - November 2001 Throughput Buffer Size objectclass= NetworkMonitorThroughputBufferSize throughputbuffersize - int throughputtransmax - float throughputtransavg - float throughputtransmin - float throughputlastmodified - float

Antony WilsonGridPP - November 2001 The European Data Grid

Antony WilsonGridPP - November 2001 The European Data Grid in=siteinfo, dc=ph,dc=qmw,dc=ac,dc=uk,o=Grid seId=hepbf1.ph.qmw.ac.uk, dc=ph,dc=qmw,dc=ac,dc=uk,o=Grid ceId=hepbf1.ph.qmw.ac.uk:2119/jobmanager-pbs, dc=ph,dc=qmw,dc=ac,dc=uk,o=Grid closeSE=hepbf1.ph.qmw.ac.uk, ceId=localhost:2119/jobmanager-lsf-grid01, dc=ph,dc=qmw,dc=ac,dc=uk,o=Grid seProtocol=gridftp, seId=hepbf1.ph.qmw.ac.uk, dc=ph,dc=qmw,dc=ac,dc=uk,o=Grid in=files, seId=hepbf1.ph.qmw.ac.uk, dc=ph,dc=qmw,dc=ac,dc=uk,o=Grid in=status, seId=hepbf1.ph.qmw.ac.uk, dc=ph,dc=qmw,dc=ac,dc=uk,o=Grid in=netmon, dc=ph,dc=qmw,dc=ac,dc=uk,o=Grid See next slide dc=ph,dc=qmw,dc=ac,dc=uk,o=Grid

Antony WilsonGridPP - November 2001 in=netmon, dc=ph,dc=qmw,dc=ac,dc=uk,o=Grid rou=hepwww.ph.qmw.ac.uk, in=netmon, dc=ph,dc=qmw,dc=ac,dc=uk,o=Grid tool=pinger, rou=hepwww.ph.qmw.ac.uk, in=netmon, dc=ph,dc=qmw,dc=ac,dc=uk,o=Grid Losspacketsize=1000, tool=pinger, rou=hepwww.ph.qmw.ac.uk, in=netmon, dc=ph,dc=qmw,dc=ac,dc=uk,o=Grid Losspacketsize=100, tool=pinger, rou=hepwww.ph.qmw.ac.uk, in=netmon, dc=ph,dc=qmw,dc=ac,dc=uk,o=Grid rttpacketsize=1000, tool=pinger, rou=hepwww.ph.qmw.ac.uk, in=netmon, dc=ph,dc=qmw,dc=ac,dc=uk,o=Grid rttpacketsize=100, tool=pinger, rou=hepwww.ph.qmw.ac.uk, in=netmon, dc=ph,dc=qmw,dc=ac,dc=uk,o=Grid tool=iperfr, rou=hepwww.ph.qmw.ac.uk, in=netmon, dc=ph,dc=qmw,dc=ac,dc=uk,o=Grid Throughputbuffersize tool=iperfr, rou=hepwww.ph.qmw.ac.uk, in=netmon, dc=ph,dc=qmw,dc=ac,dc=uk,o=Grid