Frascati, October 5th, Accounting in DataGrid Preliminary Proposal and basis for discussion Stefano Barale Frascati, October.

Slides:



Advertisements
Similar presentations
Pricing for Utility-driven Resource Management and Allocation in Clusters Chee Shin Yeo and Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS)
Advertisements

Legacy code support for commercial production Grids G.Terstyanszky, T. Kiss, T. Delaitre, S. Winter School of Informatics, University.
EGEE-II INFSO-RI Enabling Grids for E-sciencE The gLite middleware distribution OSG Consortium Meeting Seattle,
Factors Affecting Wage Determination Part 1. Theory of Labour Markets Definition: labour market is market in which workers compete for work and employers.
DESIGNING A PUBLIC KEY INFRASTRUCTURE
- DataGrid meeting in Catania – 9 th to 11 th of April, 2001 A pre-alpha accounting architecture The.
CoreGRID Workpackage 5 Virtual Institute on Grid Information and Monitoring Services Authorizing Grid Resource Access and Consumption Erik Elmroth, Michał.
First Year Talk: Self-Enforcing Automatic Rational Contracts between Computers Brian Shand Supervisor: Dr Jean Bacon.
©2003 Prentice Hall Business Publishing, Accounting Information Systems, 9/e, Romney/Steinbart 18-1 Accounting Information Systems 9 th Edition Marshall.
Common System Components
UNICORE UNiform Interface to COmputing REsources Olga Alexandrova, TITE 3 Daniela Grudinschi, TITE 3.
Resource Manager for Grid with global job queue and with planning based on local schedules V.N.Kovalenko, E.I.Kovalenko, D.A.Koryagin, E.Z.Ljubimskii,
Introduction to z/OS Basics © 2006 IBM Corporation Chapter 7: Batch processing and the Job Entry Subsystem (JES) Batch processing and JES.
WP6: Grid Authorization Service Review meeting in Berlin, March 8 th 2004 Marcin Adamski Michał Chmielewski Sergiusz Fonrobert Jarek Nabrzyski Tomasz Nowocień.
HeteroPar 2013 Optimization of a Cloud Resource Management Problem from a Consumer Perspective Rafaelli de C. Coutinho, Lucia M. A. Drummond and Yuri Frota.
Cloud MapReduce : a MapReduce Implementation on top of a Cloud Operating System Speaker : 童耀民 MA1G Authors: Huan Liu, Dan Orban Accenture.
Chapter 3: Operating-System Structures System Components Operating System Services System Calls System Programs System Structure Virtual Machines System.
Thinking about Accounting Matteo Melani SLAC Open Science Grid.
1 A pattern language for security models Eduardo B. Fernandez and Rouyi Pan Presented by Liping Cai 03/15/2006.
Assignment 2 Project: Sea Urchin Sporting Goods Team Members: Gwn Hannay, Debbie Carlton, Susan Dalgleish Daniel Barnes, David Cooper.
Frascati, October 9th, Accounting in DataGrid Initial Architecture Albert Werbrouck Frascati, October 9, 2001.
Semantic Interoperability Berlin, 25 March 2008 Semantically Enhanced Resource Allocator Marc de Palol Jorge Ejarque, Iñigo Goiri, Ferran Julià, Jordi.
A.Guarise – F.Rosso 1 Enabling Grids for E-sciencE INFSO-RI Comprehensive Accounting Views on large computing farms. Andrea Guarise & Felice Rosso.
Silberschatz, Galvin and Gagne  Operating System Concepts Chapter 3: Operating-System Structures System Components Operating System Services.
Grid Workload Management Massimo Sgaravatto INFN Padova.
1 OSG Accounting Service Requirements Matteo Melani SLAC for the OSG Accounting Activity.
Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology 1 Wireless Sensor Network Wireless Sensor Network Based.
Job scheduling algorithm based on Berger model in cloud environment Advances in Engineering Software (2011) Baomin Xu,Chunyan Zhao,Enzhao Hua,Bin Hu 2013/1/251.
Virtual Batch Queues A Service Oriented View of “The Fabric” Rich Baker Brookhaven National Laboratory April 4, 2002.
Budapest, September 5th, 2002 DataGrid Accounting System DGAS Current status & plans Stefano Barale INFN Budapest, September.
Authors: Rajkumar Buyya, David Abramson & Jonathan Giddy
Proposal for a IS schema Massimo Sgaravatto INFN Padova.
What’s a mobile app? A mobile app is a software program you can download and access directly using your phone or another mobile device, like a tablet.
LCG Accounting John Gordon Grid Deployment Board 13 th January 2004.
INFSO-RI Enabling Grids for E-sciencE EGEE is a project funded by the European Union under contract INFSO-RI Grid Accounting.
Grid and Cloud Computing Alessandro Usai SWITCH Sergio Maffioletti Grid Computing Competence Centre - UZH/GC3
Federating PL-Grid Computational Resources with the Atmosphere Cloud Platform Piotr Nowakowski, Marek Kasztelnik, Tomasz Bartyński, Tomasz Gubała, Daniel.
LCG workshop on Operational Issues CERN November, EGEE CIC activities (SA1) Accounting: current status
HLRmon accounting portal DGAS (Distributed Grid Accounting System) sensors collect accounting information at site level. Site data are sent to site or.
CoreGRID Workpackage 5 Virtual Institute on Grid Information and Monitoring Services Michał Jankowski, Paweł Wolniewicz, Jiří Denemark, Norbert Meyer,
Recent improvements in HLRmon, an accounting portal suitable for national Grids Enrico Fattibene (speaker), Andrea Cristofori, Luciano Gaido, Paolo Veronesi.
Globus and PlanetLab Resource Management Solutions Compared M. Ripeanu, M. Bowman, J. Chase, I. Foster, M. Milenkovic Presented by Dionysis Logothetis.
 Distributed Database Concepts  Parallel Vs Distributed Technology  Advantages  Additional Functions  Distribution Database Design  Data Fragmentation.
10 May 2001WP6 Testbed Meeting1 WP5 - Mass Storage Management Jean-Philippe Baud PDP/IT/CERN.
INFSO-RI Enabling Grids for E-sciencE Policy management and fair share in gLite Andrea Guarise HPDC 2006 Paris June 19th, 2006.
Accounting in DataGrid HLR software demo Andrea Guarise Milano, September 11, 2001.
HLRmon accounting portal The accounting layout A. Cristofori 1, E. Fattibene 1, L. Gaido 2, P. Veronesi 1 INFN-CNAF Bologna (Italy) 1, INFN-Torino Torino.
INFSO-RI Enabling Grids for E-sciencE DGAS, current status & plans Andrea Guarise EGEE JRA1 All Hands Meeting Plzen July 11th, 2006.
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
Claudio Grandi INFN Bologna Virtual Pools for Interactive Analysis and Software Development through an Integrated Cloud Environment Claudio Grandi (INFN.
DGAS Distributed Grid Accounting System INFN Workshop /05/1009, Palau Giuseppe Patania Andrea Guarise 6/18/20161.
Trusted Virtual Machine Images the HEPiX Point of View Tony Cass October 21 st 2011.
System Components Operating System Services System Calls.
Enabling Grids for E-sciencE Agreement-based Workload and Resource Management Tiziana Ferrari, Elisabetta Ronchieri Mar 30-31, 2006.
Enabling Grids for E-sciencE Claudio Cherubino INFN DGAS (Distributed Grid Accounting System)
DGAS Accounting – toward national grid infrastructures HPDC workshop on Monitoring, Logging and Accounting, (MLA) in production Grids 10/06/2009, Munich.
Grid Account Management: A Case Study GGF 9 PGM-RG Chicago, IL October 5-8, 2003 Doru Marcusiu Assistant Director Grid and Security.
EGEE is a project funded by the European Union under contract INFSO-RI DGAS Grid accounting L.Gaido on behalf of A.Guarise LCG Workshop November.
First proposal for a modification of the GIS schema
DGAS A.Guarise April 19th, Athens
Walter Binder Giovanna Di Marzo Serugendo Jarle Hulaas
Testbed Software Test Plan Status
Economic systems Analysis Who makes the economic decisions?
Chapter 2: Operating-System Structures
Introduction to Operating Systems
Wide Area Workload Management Work Package DATAGRID project
Lecture 3: Main Memory.
A pre-alpha accounting architecture
Chapter 2: Operating-System Structures
Presentation transcript:

Frascati, October 5th, Accounting in DataGrid Preliminary Proposal and basis for discussion Stefano Barale Frascati, October 5th, 2001

Accounting approaches Existing accounting systems follow basically two approaches: passive (the system only reports the resource usage) and active (the system reports the resource usage and actively uses these information to simplify workload management). Advantages of the active approach are: A tighter integration with the resource allocation system that simplifies workload management. An active resource control that can prevent uncontrolled usage and, consequently, system saturation.

Frascati, October 5th, Computational economy In the context of an active accounting system, we chose an economical approach. According to this approach the resource usage is regulated by the exchange of a kind of “virtual money” (Grid Credits) The user “pays” the resource for its usage The resource earns Grid Credits when it is used

Frascati, October 5th, Price-setting policies Different price-setting mechanisms can be adopted in this framework Ranging from a flat model with constant price to pure supply & demand some “pricing authority” can be set up to help reaching and keeping equilibrium A good price-setting policy should avoid “virtual” inflation, speculation and “price wars”

Frascati, October 5th, Job cost computation In an economical approach every job has a “computational cost”. The job cost is computed in three steps: Every resource must have a well defined “value”, depending on its real capabilities. This value should be estimated via a proper benchmark suite. The value is then used to set the resource price according to the price-setting mechanism adopted. The job cost is computed using resource prices and the job resource usage.

Frascati, October 5th, Elements to be charged It is important to define which elements should be charged, a minimum set should be: Priority in a queue (if any) CPU time Memory usage Disk and tape storage usage Network Other elements should be considered too, but the definition of the full set is still an open issue.

Frascati, October 5th, Working scheme Our system has to manage economical interactions between producers and consumers of a service. To address this problem the GSM mobile phone system uses a so-called “Home Location Register” to store info about the user (identity, “resource usage”, policies...). We applied this concept to our accounting model. In this model the HLR of a user pays to the resource HLR the credits due for a job.

Frascati, October 5th, The HLR working scheme Every user and resource belongs to an HLR The User (HLR_A) submits a job The Resource (HLR_B) runs the job HLR_A pays HLR_B for the resource usage HLRs are distributed entities whose number and location and are still to be defined (one per organization, site, experiment) ?

Frascati, October 5th, Open issues In our model HLRs use standalone databases. We have to check whether the SQLDataBaseService approach is a feasible one, too. We have to understand who is in charge for: Developing a system for mapping Grid users onto local Unix accounts. We have been positively impressed by the ‘template accounts’ proposed within GGF Developing per-job sensors to provide the necessary information to the accounting system Is it a need to inject real money into the Grid?

Frascati, October 5th, Conclusions A document covering all the aspects of the problem in full detail is available at: We developed a proof-of-principle prototype of the proposed architecture in preparation for the integration with the project architecture. No show-stoppers found so far. We hope to start a fruitful communication with the other WPs. Feedback is welcome.