Tiziana FerrariNetwork Metrics Requirements and Usage for WP11 Tiziana Ferrari

Slides:



Advertisements
Similar presentations
1 SIMGRID_Scheduler A Simulated Scheduling System for GRID Environment Marcello CASTELLANO, Giacomo PISCITELLI and Nicola SIMEONE Department of Electrical.
Advertisements

DataTAG WP4 Meeting CNAF Jan 14, 2003 Interfacing AliEn and EDG 1/13 Stefano Bagnasco, INFN Torino Interfacing AliEn to EDG Stefano Bagnasco, INFN Torino.
© 2007 Open Grid Forum Data Management Challenge - The View from OGF OGF22 – February 28, 2008 Cambridge, MA, USA Erwin Laure David E. Martin Data Area.
Workload Management David Colling Imperial College London.
LCG Tiziana Ferrari - SC3: INFN installation status report 1 Service Challenge Phase 3: Status report Tiziana Ferrari on behalf of the INFN SC team INFN.
EU 2nd Year Review – Jan – Title – n° 1 WP1 Speaker name (Speaker function and WP ) Presentation address e.g.
Workload management Owen Maroney, Imperial College London (with a little help from David Colling)
A2 Technology Product Design Systems and Control Notes DT4 - Exam.
DataGrid is a project funded by the European Union 22 September 2003 – n° 1 EDG WP4 Fabric Management: Fabric Monitoring and Fault Tolerance
A conceptual model of grid resources and services Authors: Sergio Andreozzi Massimo Sgaravatto Cristina Vistoli Presenter: Sergio Andreozzi INFN-CNAF Bologna.
Example for Scheduling- Structures: Structured HPC Grids.
Summary. Chapter 9 – Triggers Integrity constraints Enforcing IC with different techniques –Keys –Foreign keys –Attribute-based constraints –Schema-based.
1 Enabling Secure Internet Access with ISA Server.
Tiziana FerrariQuality of Service for Remote Control in the High Energy Physics Experiments CHEP, 07 Feb Quality of Service for Remote Control in.
Quantitative Methodologies for the Scientific Computing: An Introductory Sketch Alberto Ciampa, INFN-Pisa Enrico Mazzoni, INFN-Pisa.
Tiziana Ferrari Overview of INFN-GRID WP5: Network 1
Tiziana Ferrari Quality of Service Support in Packet Networks1 Quality of Service Support in Packet Networks Tiziana Ferrari Italian.
K E Y : SW Service Use Big Data Information Flow SW Tools and Algorithms Transfer Application Provider Visualization Access Analytics Curation Collection.
LBE TF-NGN Budapest October Agenda GÉANT D9.9 deliverable summary Test reports for LBE on GÉANT (Nicolas) Tests for LBE at the edge Limerick.
Polish Infrastructure for Supporting Computational Science in the European Research Space QoS provisioning for data-oriented applications in PL-Grid D.
Tiziana FerrariNetwork metrics usage for optimization of the Grid1 DataGrid Project Work Package 7 Written by Tiziana Ferrari Presented by Richard Hughes-Jones.
Frascati, October 9th, Accounting in DataGrid Initial Architecture Albert Werbrouck Frascati, October 9, 2001.
computer
DataGrid is a project funded by the European Union CHEP 2003 – March 2003 – M. Sgaravatto – n° 1 The EU DataGrid Workload Management System: towards.
Grid Technologies  Slide text. What is Grid?  The World Wide Web provides seamless access to information that is stored in many millions of different.
LCG Service Challenge Phase 4: Piano di attività e impatto sulla infrastruttura di rete 1 Service Challenge Phase 4: Piano di attività e impatto sulla.
Your university or experiment logo here Caitriana Nicholson University of Glasgow Dynamic Data Replication in LCG 2008.
A monitoring tool for a GRID operation center Sergio Andreozzi (INFN CNAF), Sergio Fantinel (INFN Padova), David Rebatto (INFN Milano), Gennaro Tortone.
BESIII Production with Distributed Computing Xiaomei Zhang, Tian Yan, Xianghu Zhao Institute of High Energy Physics, Chinese Academy of Sciences, Beijing.
Scaling Policy Concepts Metrics – Periodically gather usage information about a component e.g. queue length, response time, memory usage Alerts (Conditions)
Jan 31, 2006 SEE-GRID Nis Training Session Hands-on V: Standard Grid Usage Dušan Vudragović SCL and ATLAS group Institute of Physics, Belgrade.
$100 $200 $300 $400 $500 $100 $200 $300 $400 $500 $100 $200 $300 $400 $500 $100 $200 $300 $400 $500 $100 $200 $300 $400 $500 $100 $200 $300.
TERENA 2003, May 21, Zagreb TERENA Networking Conference, 2003 MOBILE WORK ENVIRONMENT FOR GRID USERS. TESTBED Miroslaw Kupczyk Rafal.
K E Y : SW Service Use Big Data Information Flow SW Tools and Algorithms Transfer Transformation Provider Visualization Access Analytics Curation Collection.
CGW 04, Stripped replication for the grid environment as a web service1 Stripped replication for the Grid environment as a web service Marek Ciglan, Ondrej.
Incorporating Scientific Instruments into the Grid Francesco Lelli University of Lugano F. Lelli, Incorporating Scientific Instruments into.
WP1 WMS rel. 2.0 Some issues Massimo Sgaravatto INFN Padova.
EGEE is a project funded by the European Union under contract INFSO-RI Practical approaches to Grid workload management in the EGEE project Massimo.
Modeling In-Network Processing and Aggregation in Sensor Networks Ajay Mahimkar The University of Texas at Austin March 24, 2004.
LCG workshop on Operational Issues CERN November, EGEE CIC activities (SA1) Accounting: current status
USQCD regional grid Report to ILDG /28/09ILDG14, June 5, US Grid Usage  Growing usage of gauge configurations in ILDG file format.  Fermilab.
High-Performance Computing Lab Overview: Job Submission in EDG & Globus November 2002 Wei Xing.
A Grid Approach to Geographically Distributed Data Analysis for Virgo F. Barone, M. de Rosa, R. De Rosa, R. Esposito, P. Mastroserio, L. Milano, F. Taurino,
DataTAG is a project funded by the European Union DataTAG WP4 meeting, Bologna 29/07/2003 – n o 1 GLUE Schema - Status Report DataTAG WP4 meeting Bologna,
Lofar Information System on GRID A.N.Belikov. Lofar Long Term Archive Prototypes: EGEE Astro-WISE Requirements to data storage Tiers Astro-WISE adaptation.
INFSO-RI Enabling Grids for E-sciencE Grid Services for Resource Reservation and Allocation Tiziana Ferrari Istituto Nazionale di.
Data Management The European DataGrid Project Team
1.3 ON ENHANCING GridFTP AND GPFS PERFORMANCES A. Cavalli, C. Ciocca, L. dell’Agnello, T. Ferrari, D. Gregori, B. Martelli, A. Prosperini, P. Ricci, E.
Gennaro Tortone, Sergio Fantinel – Bologna, LCG-EDT Monitoring Service DataTAG WP4 Monitoring Group DataTAG WP4 meeting Bologna –
The Resource Selection Service (ReSS) Activity Gabriele Garzoglio Fermilab, Computing Division March 14, 2006.
TIFR, Mumbai, India, Feb 13-17, GridView - A Grid Monitoring and Visualization Tool Rajesh Kalmady, Digamber Sonvane, Kislay Bhatt, Phool Chand,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI solution for high throughput data analysis Peter Solagna EGI.eu Operations.
Davide Salomoni INFN-CNAF Bologna, Jan 12, 2006
SuperB – INFN-Bari Giacinto DONVITO.
First proposal for a modification of the GIS schema
LCG Service Challenge: Planning and Milestones
Network Services Use Cases GHPN Research Group
Towards GLUE Schema 2.0 Sergio Andreozzi INFN-CNAF Bologna, Italy
lcg-infosites documentation (v2.1, LCG2.3.1) 10/03/05
draft-ietf-teas-yang-te-topo-01
Sergio Fantinel, INFN LNL/PD
T-StoRM: a StoRM testing framework
5. Job Submission Grid Computing.
A conceptual model of grid resources and services
Report on GLUE activities 5th EU-DataGRID Conference
Emerging Security Mechanisms for Medical Cyber Physical Systems
Servizi di Grid e impatto sulla rete
Process/Code Migration and Cloning
California Model School Library Learner Standards
Presentation transcript:

Tiziana FerrariNetwork Metrics Requirements and Usage for WP11 Tiziana Ferrari

Tiziana FerrariNetwork Metrics Requirements and Usage for WP12 Applicability examples Integration of network info into the scheduling policy: –To define the most suitable Storage Element for one or more Computing Elements Triggering of data transfers –To gather in a single Storage Element portions of data sets partioned among several Ses List of applications to be developed further…

Tiziana FerrariNetwork Metrics Requirements and Usage for WP13 Network information CloseSE attribute: –CloseSE = {(closeness 1, SE 1 ), …, (closeness n, SE n )} closeness(CE, SE) = max 0<i<m, 0<j<n {closeness(CE i,SE j )} –Closeness varies in [0,1] –0 = SE unreachable –1 = SE on the same LAN Definitions –r: Round Trip Time, R max : max RTT, –p loss : packet loss frequency; –th: throughput; th max : maximum throughput closeness i, j (p loss,r,th) = 0 if p loss 0 closeness i, j (p loss,r,th) = th / th max r/ rmax where 0 < < 1 otherwise

Tiziana FerrariNetwork Metrics Requirements and Usage for WP14 Closeness function Fig 1: alpha = 2Fig 2: alpha = 10

Tiziana FerrariNetwork Metrics Requirements and Usage for WP15 Triggering of data transfers Initial assumption: all the SEs in a given set SE list = (SE 1, SE 2, …, SE n ) are equally distant from a given CE Definitions: –Inter SE distance: D(SE i ) = 1 j n, j i closeness(SE i, SE j ) – I : data portion stored by each SE i –Optimization function: opt(SE i ) = min j D(SE j ) * i/ max where in [0,1] SE is the selected Storage Element for computing element CE iff: SE = SE i iff opt(SE i ) = min j D(SE j ) * i/ max