Scheduling Interactive Tasks in the Grid-based Systems M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa, T. Rajtar, D. Kaliszan, M. Stroiński TERENA Networking.

Slides:

Advertisements

Similar presentations

Building Portals to access Grid Middleware National Technical University of Athens Konstantinos Dolkas, On behalf of Andreas Menychtas.

Advertisements

W w w. h p c - e u r o p a. o r g HPC-Europa Portal: Uniform Access to European HPC Infrastructure Ariel Oleksiak Poznan Supercomputing.

1 Project overview Presented at the Euforia KoM January, 2008 Marcin Płóciennik, PSNC, Poland.

FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.

C. Grimme, A. Papaspyrou Scheduling in C3-Grid AstroGrid-D Workshop Project: C3-Grid Collaborative Climate Community Data and Processing Grid Scheduling.

Grid Resource Allocation Management (GRAM) GRAM provides the user to access the grid in order to run, terminate and monitor jobs remotely. The job request.

Security Daniel Mallmann MWSG meeting Amsterdam December 2005.

DESIGN AND IMPLEMENTATION OF SOFTWARE COMPONENTS FOR A REMOTE LABORATORY J. Fernandez, J. Crespo, R. Barber, J. Carretero University Carlos III of Madrid.

PROGRESS: ICWS'2003 Web Services Communication within the PROGRESS Grid-Portal Environment Michał Kosiedowski.

Universität Dortmund Robotics Research Institute Information Technology Section Grid Metaschedulers An Overview and Up-to-date Solutions Christian.

1 PUNCH PUNCH (Purdue University Network Computing Hubs) is a distributed network-computing infrastructure that allows geographically dispersed users to.

GridFlow: Workflow Management for Grid Computing Kavita Shinde.

David Adams ATLAS DIAL Distributed Interactive Analysis of Large datasets David Adams BNL March 25, 2003 CHEP 2003 Data Analysis Environment and Visualization.

Slides for Grid Computing: Techniques and Applications by Barry Wilkinson, Chapman & Hall/CRC press, © Chapter 1, pp For educational use only.

6/2/20071 Grid Computing Sun Grid Engine (SGE) Manoj Katwal.

Chapter 1: Overview of Workflow Management Dr. Shiyong Lu Department of Computer Science Wayne State University.

Member of the ExperTeam Group Ralf Ratering Pallas GmbH Hermülheimer Straße Brühl, Germany

Slide 1 of 9 Presenting 24x7 Scheduler The art of computer automation Press PageDown key or click to advance.

SUN HPC Consortium, Heidelberg 2004 Grid(Lab) Resource Management System (GRMS) and GridLab Services Krzysztof Kurowski Poznan Supercomputing and Networking.

Polish Infrastructure for Supporting Computational Science in the European Research Space Policy Driven Data Management in PL-Grid Virtual Organizations.

GRID job tracking and monitoring Dmitry Rogozin Laboratory of Particle Physics, JINR 07/08/ /09/2006.

© 2012 WIPRO LTD | 1 Version 1.0a, 23 rd April 2012 TTCN-3 Users Conference Practical integration of TTCN-3 with Robot test automation framework.

Operating Systems.  Operating System Support Operating System Support  OS As User/Computer Interface OS As User/Computer Interface  OS As Resource.

Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture.

Marcin Okoń Pozna ń Supercomputing and Networking Center, Supercomputing Department e-Science 2006, Amsterdam, Dec Virtual Laboratory as a Remote.

Corporate Information Systems Delivery of Infrastructure IT Services.

Input/OUTPUT [I/O Module structure].

Mobile Agent Technology for the Management of Distributed Systems - a Case Study Claudia Raibulet& Claudio Demartini Politecnico di Torino, Dipartimento.

Robert Fourer, Jun Ma, Kipp Martin Copyright 2006 An Enterprise Computational System Built on the Optimization Services (OS) Framework and Standards Jun.

5th GridLab Review, 8 April 2005, Amsterdam WP12: Access for mobile users What's new in mobile user support Piotr Grabowski, Bartek Lewandowski

WP9 Resource Management Current status and plans for future Juliusz Pukacki Krzysztof Kurowski Poznan Supercomputing.

GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.

INFSO-RI Module 01 ETICS Overview Alberto Di Meglio.

Przemysław Rek, Mirosław Kopeć, Zofia Gdaniec, Łukasz Popenda, Ryszard W. Adamiak, Marcin Wolski, Marcin Lawenda, Norbert Meyer, Maciej Stroiński.

INFSO-RI Module 01 ETICS Overview Etics Online Tutorial Marian ŻUREK Baltic Grid II Summer School Vilnius, 2-3 July 2009.

The PROGRESS Grid Service Provider Maciej Bogdański Portals & Portlets 2003 Edinburgh, July 14th-17th.

Resource Brokering in the PROGRESS Project Juliusz Pukacki Grid Resource Management Workshop, October 2003.

Interactive task invocation in the Virtual Laboratory M. Okoń, M. Lawenda, T. Rajtar, D. Stokłosa, D. Kaliszan, P. Mierzyński, N. Meyer, M. Stroiński 4.

PROGRESS: ICCS'2003 GRID SERVICE PROVIDER: How to improve flexibility of grid user interfaces? Michał Kosiedowski.

TeraGrid CTSS Plans and Status Dane Skow for Lee Liming and JP Navarro OSG Consortium Meeting 22 August, 2006.

© 2006 Open Grid Forum Remote Instrumentation Services in Grid Environment Current state of art in terms of the integration of the instrumentation with.

Ames Research CenterDivision 1 Information Power Grid (IPG) Overview Anthony Lisotta Computer Sciences Corporation NASA Ames May 2,

NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.

TERENA 2003, May 21, Zagreb TERENA Networking Conference, 2003 MOBILE WORK ENVIRONMENT FOR GRID USERS. TESTBED Miroslaw Kupczyk Rafal.

GVis: Grid-enabled Interactive Visualization State Key Laboratory. of CAD&CG Zhejiang University, Hangzhou

OSG Tier 3 support Marco Mambelli - OSG Tier 3 Dan Fraser - OSG Tier 3 liaison Tanya Levshina - OSG.

Terena conference, June 2004, Rhodes, Greece Norbert Meyer The effective integration of scientific instruments in the Grid.

Conference name Company name INFSOM-RI Speaker name The ETICS Job management architecture EGEE ‘08 Istanbul, September 25 th 2008 Valerio Venturi.

Connect. Communicate. Collaborate AAI scenario: How AutoBAHN system will use the eduGAIN federation for Authentication and Authorization Simon Muyal,

Grid technology Security issues Andrey Nifatov A hacker.

Marcin Płóciennik Poznan Supercomputing and Networking Center OGF23, Barcelona, Spain, June 3rd, 2008 Use case of NMR spectrometry in Virtual Laboratory.

High-Performance Computing Lab Overview: Job Submission in EDG & Globus November 2002 Wei Xing.

TeraGrid User Portal Eric Roberts. Outline Motivation Vision What’s included? Live Demonstration.

DIRAC Pilot Jobs A. Casajus, R. Graciani, A. Tsaregorodtsev for the LHCb DIRAC team Pilot Framework and the DIRAC WMS DIRAC Workload Management System.

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI How to integrate portals with the EGI monitoring system Dusan Vudragovic.

PROGRESS: GEW'2003 Using Resources of Multiple Grids with the Grid Service Provider Michał Kosiedowski.

1 Porting applications to the NGS, using the P-GRADE portal and GEMLCA Peter Kacsuk MTA SZTAKI Hungarian Academy of Sciences Centre for.

DataTAG is a project funded by the European Union International School on Grid Computing, 23 Jul 2003 – n o 1 GridICE The eyes of the grid PART I. Introduction.

Claudio Grandi INFN Bologna Virtual Pools for Interactive Analysis and Software Development through an Integrated Cloud Environment Claudio Grandi (INFN.

G. Russo, D. Del Prete, S. Pardi Kick Off Meeting - Isola d'Elba, 2011 May 29th–June 01th A proposal for distributed computing monitoring for SuperB G.

ENEA GRID & JPNM WEB PORTAL to create a collaborative development environment Dr. Simonetta Pagnutti JPNM – SP4 Meeting Edinburgh – June 3rd, 2013 Italian.

Enabling Grids for E-sciencE Agreement-based Workload and Resource Management Tiziana Ferrari, Elisabetta Ronchieri Mar 30-31, 2006.

Duncan MacMichael & Galen Deal CSS 534 – Autumn 2016

Design rationale and status of the org.glite.overlay component

Design and Manufacturing in a Distributed Computer Environment

Printer Admin Print Job Manager

Module 01 ETICS Overview ETICS Online Tutorials

Lawson ProcessFlow Overview and Actual ProcessFlow Solutions

Wide Area Workload Management Work Package DATAGRID project

Grid Computing Software Interface

Presentation transcript:

Scheduling Interactive Tasks in the Grid-based Systems M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa, T. Rajtar, D. Kaliszan, M. Stroiński TERENA Networking Conference 2005 June 6-9, 2005 Poznań, Poland

Chosen aspects of interactive tasks scheduling Online user presence at the time of task execution Device operator presence in case of scientific experiments Resource availability (maintenance, etc.) Workload management and resource allocation Interactive connection to graphical user interface Tasks as elements of dynamic measurements scenarios

Remote access to complex and expensive laboratory research equipment User-customized Dynamic Measurement Scenarios Digital Science Library Data storage and management Educational potential Workgroup collaboration tools Virtual Laboratory overview The Virtual Laboratory is a distributed environment, providing its users with the following functionality:

definition of complex, multi-dimensional research experiment scenarios connection of experimental and computational jobs multiple conditions on jobs connections, determining the actual execution path description language for resources and connection dependencies Dynamic Measurement Scenarios Example of a simple measurement scenario

Example of DMS diagram

Batch job scheduling

Interactive tasks: Task submission 1. Task is sent to SMM module 2. Task is added to the DB 3. Task sent to Global Scheduler 4. Grid authorization in GAM 5. Accounting verification 6b, 7. Task submitted to GRMS (via Gateway)

Interactive task: VNC session scheduling 1. GRMS checks with MDS for resources 2. GRMS verifies free slot for VNC session 3. GG is informed of status change (notification) 4. Task status updated in VLab DB

Interactive tasks: Establishing a secure connection 1. GRMS launches scheduled task 2. GRMS sends notification to Gateway 3. VNC Manager sends task info 4. Gateway sends info to Vlab DB (Monitoring) 5. User launches SVNC viewer

Interactive tasks: Prolonging the VNC session 1. User request from portal 2. Verification with GAM 3. Accounting verification 4b,5. Request forwarded to GRMS 6. VNC session reservation 7,8. GRMS Answer forwarded and updated in VLab DB

Interactive tasks: Ending the VNC session by the user 1,2. Request to end session forwarded to GRMS 3. End signal sent to VNC Manager 4. Update in the session DB 5,6. Task status updated in the VLab DB

Interactive tasks: Ending the VNC session by the system 1. GRMS sends end signal to VNC Manager 2. Update in the session DB 3,4. Task status updated in the VLab DB

Task submission VNC session scheduling Establishing secure connection Ending the VNC session Summary Invocation of user-interactive tasks can be divided into the following main steps: Scheduling of the interactive task creates new possibilities for a wide range of Grid-based systems. Human factor as the main, non-deterministic element influencing the whole process.

Marcin Okoń: or: