Dynamic Grid Optimisation TERENA Conference, Lijmerick 5/6/02 A. P. Millar University of Glasgow.

Slides:

Advertisements

Similar presentations

Motivation 1.Application resources setup – make it easy 2.Transform PRAGMA grid – add on demand –Continue using Grid resources –Add cloud resources Current.

Advertisements

WP2: Data Management Gavin McCance University of Glasgow November 5, 2001.

WP2: Data Management Gavin McCance University of Glasgow.

OptorSim: A Replica Optimisation Simulator for the EU DataGrid W. H. Bell, D. G. Cameron, R. Carvajal, A. P. Millar, C.Nicholson, K. Stockinger, F. Zini.

WP2 and GridPP UK Simulation W. H. Bell University of Glasgow EDG – WP2.

IoP HEPP 2004 Birmingham, 7/4/04 David Cameron, University of Glasgow 1 Simulation of Replica Optimisation Strategies for Data.

Hallway Traffic Simulator Peter Riggs Computer Systems Lab

Sphinx Server Sphinx Client Data Warehouse Submitter Generic Grid Site Monitoring Service Resource Message Interface Current Sphinx Client/Server Multi-threaded.

EU-GRID Work Program Massimo Sgaravatto – INFN Padova Cristina Vistoli – INFN Cnaf as INFN members of the EU-GRID technical team.

Optimizing of data access using replication technique Renata Słota 1, Darin Nikolow 1,Łukasz Skitał 2, Jacek Kitowski 1,2 1 Institute of Computer Science.

Preface Exponential growth of data volume, steady drop in storage costs, and rapid increase in storage capacity Inadequacy of the sequential processing.

Hash History: A Method for Reconciling Mutual Inconsistency in Optimistic Replication Brent ByungHoon Kang, Robert Wilensky and John Kubiatowicz CS Division,

Information Networking Security and Assurance Lab National Chung Cheng University 1 Host-Based Intrusion Detection software TRIPWIRE & MD5.

Investigation of TDMA solution for the hidden terminal problem (With “ Wavion ” ) Final Report Presentation.

On Fairness, Optimizing Replica Selection in Data Grids Husni Hamad E. AL-Mistarihi and Chan Huah Yong IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS,

GRID COMPUTING: REPLICATION CONCEPTS Presented By: Payal Patel.

1 Ekow J. Otoo Frank Olken Arie Shoshani Adaptive File Caching in Distributed Systems.

Online Chinese Character Handwriting Recognition for Linux

Ruel based decision support for the process flow Embedding SIMONE optimisation modules in a Knowledge and rule based process.

CS492: Special Topics on Distributed Algorithms and Systems Fall 2008 Lab 3: Final Term Project.

GridCastUK-Japan N+N October Cambridge Newcastle Edinburgh Oxford Glasgow Manchester Cardiff Soton London Belfast DL RL Hinxton.

Grid Data Management A network of computers forming prototype grids currently operate across Britain and the rest of the world, working on the data challenges.

Introduction to MCMC and BUGS. Computational problems More parameters -> even more parameter combinations Exact computation and grid approximation become.

The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Dataset Caitlin Minteer & Kelly Clynes.

INFSO-RI Enabling Grids for E-sciencE Grid Applications -- Cyprus Contribution to EGEE Organization: HPCL, University Of Cyprus.

A Dynamic Data Grid Replication Strategy to Minimize the Data Missed Ming Lei, Susan Vrbsky, Xiaoyan Hong University of Alabama.

Grid Technologies  Slide text. What is Grid?  The World Wide Web provides seamless access to information that is stored in many millions of different.

Your university or experiment logo here Caitriana Nicholson University of Glasgow Dynamic Data Replication in LCG 2008.

A Survey of Distributed Task Schedulers Kei Takahashi (M1)

Grid Workload Management Massimo Sgaravatto INFN Padova.

EFFECTIVE LOAD-BALANCING VIA MIGRATION AND REPLICATION IN SPATIAL GRIDS ANIRBAN MONDAL KAZUO GODA MASARU KITSUREGAWA INSTITUTE OF INDUSTRIAL SCIENCE UNIVERSITY.

The Owner Share scheduler for a distributed system 2009 International Conference on Parallel Processing Workshops Reporter: 李長霖.

Ajou University, South Korea GCC 2003 Presentation Dynamic Data Grid Replication Strategy based on Internet Hierarchy Sang Min Park , Jai-Hoon Kim, and.

Datasets on the GRID David Adams PPDG All Hands Meeting Catalogs and Datasets session June 11, 2003 BNL.

Advanced Spectrum Management in Multicell OFDMA Networks enabling Cognitive Radio Usage F. Bernardo, J. Pérez-Romero, O. Sallent, R. Agustí Radio Communications.

PHENIX and the data grid >400 collaborators Active on 3 continents + Brazil 100’s of TB of data per year Complex data with multiple disparate physics goals.

Grid Glasgow Outline LHC Computing at a Glance Glasgow Starting Point LHC Computing Challenge CPU Intensive Applications Timeline ScotGRID.

Caitriana Nicholson, CHEP 2006, Mumbai Caitriana Nicholson University of Glasgow Grid Data Management: Simulations of LCG 2008.

Using Information Technology to Reduce Traffic Jam in a Highly Traffic Congested City Sayed Ahmed and Rasit Eskicioglu We propose a cost effective and.

…building the next IT revolution From Web to Grid…

CGW 04, Stripped replication for the grid environment as a web service1 Stripped replication for the Grid environment as a web service Marek Ciglan, Ondrej.

Grid User Interface for ATLAS & LHCb A more recent UK mini production used input data stored on RAL’s tape server, the requirements in JDL and the IC Resource.

Data Management GridPP and EDG Gavin McCance University of Glasgow May 9, 2002

CEDPS Data Services Ann Chervenak USC Information Sciences Institute.

8-Dec-15T.Wildish / Princeton1 CMS analytics A proposal for a pilot project CMS Analytics.

ATLAS Grid Requirements A First Draft Rich Baker Brookhaven National Laboratory.

Grid Glasgow Outline LHC Computing at a Glance Glasgow Starting Point LHC Computing Challenge CPU Intensive Applications Timeline ScotGRID.

Replica Management Kelly Clynes. Agenda Grid Computing Globus Toolkit What is Replica Management Replica Management in Globus Replica Management Catalog.

University of Westminster – Checkpointing Mechanism for the Grid Environment K Sajadah, G Terstyanszky, S Winter, P. Kacsuk University.

Configuring, Managing and Maintaining Windows Server® 2008 Servers Course 6419A.

1 Planning Base Station and Relay Station Locations in IEEE j Multi-hop Relay Networks Yang Yu, Seán Murphy, Liam Murphy Department of Computer Science.

Data Consolidation: A Task Scheduling and Data Migration Technique for Grid Networks Author: P. Kokkinos, K. Christodoulopoulos, A. Kretsis, and E. Varvarigos.

On the Placement of Web Server Replicas Yu Cai. Paper On the Placement of Web Server Replicas Lili Qiu, Venkata N. Padmanabhan, Geoffrey M. Voelker Infocom.

1 IDGF International Desktop Grid Federation ASSESSING THE PERFORMANCE OF DESKTOP GRID APPLICATIONS A. Afanasiev, N. Khrapov, and M. Posypkin DEGISCO is.

Dynamic Data Placement: the ATLAS model Simone Campana (IT-SDC)

Grid Activities in CMS Asad Samar (Caltech) PPDG meeting, Argonne July 13-14, 2000.

WP2: Data Management Gavin McCance University of Glasgow.

Personal Trip Assistance System. Intelligent Transport Systems Increase in traffic intensity  need for intelligent way for road usage.

Grid Account Management: A Case Study GGF 9 PGM-RG Chicago, IL October 5-8, 2003 Doru Marcusiu Assistant Director Grid and Security.

Interaction and Animation on Geolocalization Based Network Topology by Engin Arslan.

ScotGRID is the Scottish prototype Tier 2 Centre for LHCb and ATLAS computing resources. It uses a novel distributed architecture and cutting-edge technology,

1 LCG-France 22 November 2010 Tier2s connectivity requirements 22 Novembre 2010 S. Jézéquel (LAPP-ATLAS)

A Comparison of File System Workloads D. Roselli J. Lorch T. Anderson University of California, Berkeley.

Gavin McCance University of Glasgow GridPP2 Workshop, UCL

Planning a Disaster Recovery System

Author: Ragalatha P, Manoj Challa, Sundeep Kumar. K

Enable computational and experimental scientists to do “more” computational chemistry by providing capability computing resources and services at their.

WP7 objectives, achievements and plans

Distributed P2P File System

Demonstration of STDP based Neural Networks on an FPGA

Presentation transcript:

Dynamic Grid Optimisation TERENA Conference, Lijmerick 5/6/02 A. P. Millar University of Glasgow

Dynamic Grid Optimisation TERENA Conference, Lijmerick 5/6/02 Scheduler The Grid Site 1 Site 2Site 3 User

Dynamic Grid Optimisation TERENA Conference, Lijmerick 5/6/02 Replica Optimisation Programs running at many different sites use files distributed throughout the Grid. Many programs run. File access patterns collected. Introduce controlled intelligent replication to optimise data access on the Grid. Test optimisation algorithms using simulator: Optor.

Dynamic Grid Optimisation TERENA Conference, Lijmerick 5/6/02 Optor – a replica optimiser simulation Simulate prototype particle physics Grid. Input site policies and experiment data files. Introduce replication algorithm: Calculate expected usage. If possible, delete existing file(s) with lower expected usage to allow replication.

Dynamic Grid Optimisation TERENA Conference, Lijmerick 5/6/02 Results Introduction of a replication algorithm significantly reduces network traffic and program running times.