Oxana Smirnova (Lund, EPF) 3rd NorduGrid Workshop, May23, 2002

Slides:



Advertisements
Similar presentations
Building Portals to access Grid Middleware National Technical University of Athens Konstantinos Dolkas, On behalf of Andreas Menychtas.
Advertisements

Grid Resource Allocation Management (GRAM) GRAM provides the user to access the grid in order to run, terminate and monitor jobs remotely. The job request.
NorduGrid Grid Manager developed at NorduGrid project.
GRAM: Grid Resource Allocation & Management Globus Toolkit™ Developer Tutorial The Globus Project™ Argonne National Laboratory USC Information Sciences.
A Grid Resource Broker Supporting Advance Reservations and Benchmark- Based Resource Selection Erik Elmroth and Johan Tordsson Reporter : S.Y.Chen.
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition Chapter 2: Operating-System Structures Modified from the text book.
The NorduGrid project: Using Globus toolkit for building Grid infrastructure presented by Aleksandr Konstantinov Mattias Ellert Aleksandr Konstantinov.
Database Management Systems (DBMS)
Resource Management Reading: “A Resource Management Architecture for Metacomputing Systems”
The SAM-Grid Fabric Services Gabriele Garzoglio (for the SAM-Grid team) Computing Division Fermilab.
Grid Computing 7700 Fall 2005 Lecture 10 and 12: Globus V2 Gabrielle Allen
Grid Computing - AAU 14/ Grid Computing Josva Kleist Danish Center for Grid Computing
Bigben Pittsburgh Supercomputing Center J. Ray Scott
:: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :: GridKA School 2009 MPI on Grids 1 MPI On Grids September 3 rd, GridKA School 2009.
August 13, 2003Eric Hjort Getting Started with Grid Computing in STAR Eric Hjort, LBNL STAR Collaboration Meeting August 13, 2003.
Resource Brokering in the PROGRESS Project Juliusz Pukacki Grid Resource Management Workshop, October 2003.
Grid Compute Resources and Job Management. 2 Local Resource Managers (LRM)‏ Compute resources have a local resource manager (LRM) that controls:  Who.
PROGRESS: ICCS'2003 GRID SERVICE PROVIDER: How to improve flexibility of grid user interfaces? Michał Kosiedowski.
Quick Introduction to NorduGrid Oxana Smirnova 4 th Nordic LHC Workshop November 23, 2001, Stockholm.
July 11-15, 2005Lecture3: Grid Job Management1 Grid Compute Resources and Job Management.
Review of Condor,SGE,LSF,PBS
Graphical Enablement In this presentation… –What is graphical enablement? –Introduction to newlook dialogs and tools used to graphical enable System i.
Youngil Kim Awalin Sopan Sonia Ng Zeng.  Introduction  Concept of the Project  System architecture  Implementation – HDFS  Implementation – System.
Proposal for a IS schema Massimo Sgaravatto INFN Padova.
SAN DIEGO SUPERCOMPUTER CENTER Inca Control Infrastructure Shava Smallen Inca Workshop September 4, 2008.
UNIX Unit 1- Architecture of Unix - By Pratima.
Globus Grid Tutorial Part 2: Running Programs Across Multiple Resources.
Aneka Cloud ApplicationPlatform. Introduction Aneka consists of a scalable cloud middleware that can be deployed on top of heterogeneous computing resources.
The NorduGrid toolkit user interface Mattias Ellert Presented at the 3 rd NorduGrid workshop, Helsinki,
Globus: A Report. Introduction What is Globus? Need for Globus. Goal of Globus Approach used by Globus: –Develop High level tools and basic technologies.
STAR Scheduling status Gabriele Carcassi 9 September 2002.
Application examples Oxana Smirnova (Lund, EPF) 3 rd NorduGrid Workshop, May23, 2002.
EGEE 3 rd conference - Athens – 20/04/2005 CREAM JDL vs JSDL Massimo Sgaravatto INFN - Padova.
STAR Scheduler Gabriele Carcassi STAR Collaboration.
Claudio Grandi INFN Bologna Virtual Pools for Interactive Analysis and Software Development through an Integrated Cloud Environment Claudio Grandi (INFN.
1 Chapter 2: Operating-System Structures Services Interface provided to users & programmers –System calls (programmer access) –User level access to system.
IC Status – 29/4/02 Condor BS adaptor –New interface handles JDF`s (condor,fbs,condorG) Multi-process consumers. –In progress (crashes smaster on jobSubmitted())
Introduction to Operating Systems Concepts
Models for Resources and Management
First proposal for a modification of the GIS schema
Oxana Smirnova, Jakob Nielsen (Lund University/CERN)
VOs and ARC Florido Paganelli, Lund University
Duncan MacMichael & Galen Deal CSS 534 – Autumn 2016
Peter Kacsuk – Sipos Gergely MTA SZTAKI
Welcome: Intel Multicore Research Conference
Lecture 4: Operating System Structures
Chapter 2: System Structures
Introduction to Grid Technology
Ruslan Fomkin and Tore Risch Uppsala DataBase Laboratory
UNIX System Overview.
Introduction to Operating System (OS)
NGS computation services: APIs and Parallel Jobs
Globus Job Management. Globus Job Management Globus Job Management A: GRAM B: Globus Job Commands C: Laboratory: globusrun.
A conceptual model of grid resources and services
College of Engineering
MPI-Message Passing Interface
Chapter 2: System Structures
CCR Advanced Seminar: Running CPLEX Computations on the ISE Cluster
Optimize Your Java Code By Tools
CGS 3763 Operating Systems Concepts Spring 2013
Cluster Computing and the Grid, Proceedings
Communications & Computer Networks Resource Notes - Introduction
Chapter 2: Operating-System Structures
Outline Chapter 2 (cont) OS Design OS structure
Wide Area Workload Management Work Package DATAGRID project
Resource and Service Management on the Grid
System calls….. C-program->POSIX call
Quick Tutorial on MPICH for NIC-Cluster
Chapter 2: Operating-System Structures
Presentation transcript:

Oxana Smirnova (Lund, EPF) 3rd NorduGrid Workshop, May23, 2002 ExTENDED RSL Oxana Smirnova (Lund, EPF) 3rd NorduGrid Workshop, May23, 2002

Globus RSL RSL stands for “Resource Specification Language” Introduced to communicate job requirements to the Global Resource Allocation Manager (GRAM) A conjunction of (attribute=value) pairs GRAM understands a well defined set of attributes 22/02/2019

RSL Attributes For GRAM (executable=string) Program to run (directory=string) Directory in which to run (default is $HOME) (arguments=arg1 arg2 arg3...) List of string arguments to program (stdin=string) Stdin for program (stdout=string) Stdout for program (stderr=string) 22/02/2019

RSL Attributes For GRAM (maxTime=integer) Maximum wall clock or cpu runtime (schedulers’s choice) in minutes (maxWallTime=integer) Maximum wall clock runtime in minutes (maxCpuTime=integer) Maximum CPU runtime in minutes (maxMemory=integer) Maximum amount of memory for each process in megabytes (minMemory=integer) Minimum amount of memory for each process in megabytes 22/02/2019

Flexibility RSL allows basic expressions: (&(attribute=value1)(attribute=value2)) (|(attribute=value1)(attribute=value2)) operators: <, <=, =, >=, > , != Unknown attributes are passed through May be handled by subsequent tools globus_rsl: a module for manipulating RSL expressions Parse an RSL string into a data structure Functions to manipulate the data structure Unparse the data structure into a string Can be used to assist in writing brokers or filters which refine an RSL specification 22/02/2019

Making use of it: xRSL NorduGrid comes with own, innovative Grid Manager and User Interface User Interface performs the functions of broker RSL appears to be a very convenient tool Allows introduction of new attributes Can be interpreted at different levels, by the UI and the GM NorduGrid xRSL Many new attributes Unused Globus attributes are ignored User-level xRSL and an internal UI-GM communication level 22/02/2019

New attributes, basic job description (inputFiles=(<file> [<location>])(…)) List of files to be transferred to the computing node from a given location (outputFiles=(<file> [<location>])(…)) List of files to be preserved after the job completion and retrieved or transferred to a given location (executables=<file1> <file2> …) List of files to be given “executable” permissions (jobName=<string>) User-defined job name (notify=<options> <email>) E-mail notification on job status change 22/02/2019

New attributes, brokering hints (runTimeEnvironment=<string>) Application-specific runtime environment (e.g., ATLAS-3.0.1) (middleware=<string>) Required middleware (e.g., NorduGrid-1.0.0) (maxDisk=<number>) Required disk space (cluster=<string>) Specific cluster request 22/02/2019

Other new attributes (rerun=<number>) Number of attempted job re-runs (ftpThreads=<number>) Number of GridFTP threads to be used for file transfers (lifeTime=<number>) Maximum time for the session directory to remain on the execution node (can not override local policy) (startTime=<time>) Specific job start time request 22/02/2019

Conclusion: more to come RSL is a sufficient and convenient way to specify job requirements within the NorduGrid architecture Detailed description of the NorduGrid xRSL can be found at http://www.nordugrid.org/documents/xrsl.pdf For examples of xRSL, see the “Application examples” presentation As experience shows, more new attributes are still to come, following the user requirements 22/02/2019