FESR Consorzio COMETA - Progetto PI2S2 Jobs Interattivi Giuseppe La Rocca INFN Catania – Italy Tutorial.

Slides:



Advertisements
Similar presentations
Riccardo Bruno, INFN.CT Sevilla, 10-14/09/2007 GENIUS Exercises.
Advertisements

Special Jobs Claudio Cherubino INFN - Catania. 2 MPI jobs on gLite DAG Job Collection Parametric jobs Outline.
Linux+ Guide to Linux Certification, Second Edition
Basic Grid Job Submission Alessandra Forti 28 March 2006.
Systems Architecture, Fourth Edition1 Internet and Distributed Application Services Chapter 13.
COS 420 DAY 24. Agenda Assignment 5 posted Chap Due May 4 Final exam will be take home and handed out May 4 and Due May 10 Student evaluations Latest.
FESR Consorzio COMETA - Progetto PI2S2 Using MPI to run parallel jobs on the Grid Marcello Iacono Manno Consorzio COMETA
FESR Consorzio COMETA - Progetto PI2S2 Using Support System Gianni M. Ricciardi INFN Catania Tutorial per i Neo Assunti del Progetto.
Enabling Grids for E-sciencE gLite training at Sinaia '06 Victor Penso Kilian Schwarz GSI Darmstadt Germany.
Ninth EELA Tutorial for Users and Managers E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Luciano Díaz ICN-UNAM Based on Domenico.
Week 7 Working with the BASH Shell. Objectives  Redirect the input and output of a command  Identify and manipulate common shell environment variables.
Network Security SSH Tunneling David Funk Matt McLaughlin Systems Administrators Computer Systems Support COE, University of Iowa.
E-science grid facility for Europe and Latin America Installation and configuration of a top BDII Gianni M. Ricciardi – Consorzio COMETA.
The gLite API – PART I Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia.
INFSO-RI Enabling Grids for E-sciencE GILDA Praticals GILDA Tutors INFN Catania ICTP/INFM-Democritos Workshop on Porting Scientific.
:: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :: GridKA School 2009 MPI on Grids 1 MPI On Grids September 3 rd, GridKA School 2009.
Vassil Roussev 2 A socket is the basic remote communication abstraction provided by the OS to processes. controlled by operating system.
Enabling Grids for E-sciencE Workload Management System on gLite middleware Matthieu Reichstadt CNRS/IN2P3 ACGRID School, Hanoi (Vietnam)
Additional UNIX Commands. 222 Lecture Overview  Multiple commands and job control  More useful UNIX utilities.
Nadia LAJILI User Interface User Interface 4 Février 2002.
INFSO-RI Enabling Grids for E-sciencE Workload Management System Mike Mineter
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) GISELA Additional Services Diego Scardaci
CPSC 233 Run graphical Java programs remotely on Mac and Windows.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America MyProxy server installation Emidio Giorgio.
Enabling Grids for E-sciencE EGEE-II INFSO-RI Introduction to Grid Computing, EGEE and Bulgarian Grid Initiatives Plovdiv, 2006.
E-science grid facility for Europe and Latin America Using Secure Storage Service inside the EELA-2 Infrastructure Diego Scardaci INFN (Italy)
Jan 31, 2006 SEE-GRID Nis Training Session Hands-on V: Standard Grid Usage Dušan Vudragović SCL and ATLAS group Institute of Physics, Belgrade.
The gLite API – PART I Giuseppe LA ROCCA INFN Catania Master Class for Life Science, 4-6 May 2010 Singapore.
Getting started DIRAC Project. Outline  DIRAC information system  Documentation sources  DIRAC users and groups  Registration with DIRAC  Getting.
E-infrastructure shared between Europe and Latin America GENIUS PORTAL Valeria Ardizzone INFN-Catania 1° EELA Grid School Itacuruçà Island, State of Rio.
APST Internals Sathish Vadhiyar. apstd daemon should be started on the local resource Opens a port to listen for apst client requests Runs on the host.
E-infrastructure shared between Europe and Latin America 1 Workload Management System-WMS Luciano Diaz Universidad Nacional Autónoma de México - UNAM Mexico.
FESR Consorzio COMETA - Progetto PI2S2 WMS - Scripting techniques Fabio Scibilia INFN – Catania, Italy Tutorial per utenti e sviluppo.
INFSO-RI Enabling Grids for E-sciencE Job Submission Tutorial (material from INFN Catania)
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid2Win : gLite for Microsoft Windows Roberto.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Moisés Hernández Duarte UNAM FES Cuautitlán.
INFSO-RI Enabling Grids for E-sciencE Job Description Language (JDL) Giuseppe La Rocca INFN First gLite tutorial on GILDA Catania,
INFSO-RI Enabling Grids for E-sciencE GILDA Praticals Giuseppe La Rocca INFN – Catania gLite Tutorial at the EGEE User Forum CERN.
Development of test suites for the certification of EGEE-II Grid middleware Task 2: The development of testing procedures focused on special details of.
E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA Special Jobs Valeria Ardizzone INFN - Catania.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks WMS tricks & tips – further scripting Giuseppe.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical using WMProxy advanced job submission.
User Interface UI TP: UI User Interface installation & configuration.
LCG2 Tutorial Viet Tran Institute of Informatics Slovakia.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America BDII Server Installation Claudio Cherubino.
12th EELA Tutorial for Users and Managers E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
Wouter Verkerke, NIKHEF 1 Using ‘stoomboot’ for NIKHEF-ATLAS batch computing What is ‘stoomboot’ – Hardware –16 machines, each 2x quad-core Pentium = 128.
Istituto Nazionale di Astrofisica Information Technology Unit INAF-SI Job with data management Giuliano Taffoni.
GLite WN Installation Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia.
Consorzio COMETA - Progetto PI2S2 UNIONE EUROPEA Grid2Win : gLite for Microsoft Windows Elisa Ingrà - INFN.
First South Africa Grid Training Installation and configuration of BDII Gianni M. Ricciardi Consorzio COMETA First South Africa Grid Training Catania,
FESR Consorzio COMETA - Progetto PI2S2 FEMM Riccardo Bruno, INFN CT Sindoni Salvatore, DIEES UniCT.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Advanced Job Riccardo Rotondo
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
FESR Consorzio COMETA - Progetto PI2S2 Jobs with Input/Output data Fabio Scibilia, INFN - Catania, Italy Tutorial per utenti e.
FESR Consorzio COMETA - Progetto PI2S2 Using MPI to run parallel jobs on the Grid Marcello Iacono Manno Consorzio Cometa
Enabling Grids for E-sciencE Work Load Management & Simple Job Submission Practical Shu-Ting Liao APROC, ASGC EGEE Tutorial.
Relational Grid Monitoring Architecture (R-GMA)
Advanced services in gLite Gergely Sipos and Peter Kacsuk MTA SZTAKI.
FESR Trinacria Grid Virtual Laboratory Practical using WMProxy advanced job submission Emidio Giorgio INFN Catania.
Grid2Win Porting of gLite middleware to Windows XP platform
MyProxy Server Installation
Virtual User Interface
Special jobs with the gLite WMS
Port Forwarding and Shell Login Essentials
Module 4 Remote Login.
Special Jobs: MPI Alessandro Costa INAF Catania
GENIUS Grid portal Hands on
Topali Lombardo Alessandro
Presentation transcript:

FESR Consorzio COMETA - Progetto PI2S2 Jobs Interattivi Giuseppe La Rocca INFN Catania – Italy Tutorial i Neo Assunti Progetto PI2S Gennaio 2007

Messina, Tutorial neo assunti progetto PI2S2, Gennaio Outline What is Interactive job ? – Requirements & Settings – Options How to create an interactive job Submit an interactive

Messina, Tutorial neo assunti progetto PI2S2, Gennaio Interactive jobs opens a real time connection with the job standard streams and allow direct interaction with it. grid console shadow processWhen an interactive job is submitted starts, in background, a grid console shadow process that listens on a port for the job standard streams. The port on which the shadow process listens is assigned by the OS, but can be forced using a JDL’s attributes. What is a Interactive Job ?

Messina, Tutorial neo assunti progetto PI2S2, Gennaio The DISPLAY enviroment variable must contain a PUBLIC IP As the job opens a X Window, the following settings MUST BE satisfied: – X Server must be up and running in the local machine. DISPLAY – the DISPLAY environment variable must be correctly set (e.g. export DISPLAY= :0.0) – Permission for Outbound Connectivity  GlueHostNetworkAdapterOutboundIP = TRUE Requirements & Settings

Messina, Tutorial neo assunti progetto PI2S2, Gennaio – Add host name to the list allowed to make connections to the X Server: xhost + – Enable the firewall of the local machine as follow: -A RH-Firewall-1-INPUT –m state --state NEW –m tcp –p tcp –dport 6000 –j ACCEPT Requirements & Settings

Messina, Tutorial neo assunti progetto PI2S2, Gennaio secure X11 tunneling – If user is connected to the UI node from remote machine (e.g. with ssh) secure X11 tunneling must be enabled. etc/ssh/ssh_config – Add the following settings to /etc/ssh/ssh_config file. ForwardX11 yes ForwardX11Trusted yes – Restart the server with service sshd restart Requirements & Settings

Messina, Tutorial neo assunti progetto PI2S2, Gennaio – Enable all the remote connection to X server selecting Login Screen Setup from System Settings Requirements & Settings

Messina, Tutorial neo assunti progetto PI2S2, Gennaio noguiIf X11 tunneling cannot be enabled, the user can try to submit the interactive job using the --nogui option that allow to interact with running job without a graphical interface. --nolistenWith the --nolisten option the job standard streams, coming from the WN, are forwarded on the UI to named pipes whose name are returned to the user together with the OS Id of the listener process. In this case the listener process must to be killed by the user. Options

Messina, Tutorial neo assunti progetto PI2S2, Gennaio How to create an Interactive Job

Messina, Tutorial neo assunti progetto PI2S2, Gennaio JobTypeInteractiveWe can create a simple interactive job by setting JobType to Interactive [ JobType = “Interactive”; Executable = “startCYCAS.sh”; Arguments = “borneo_3d.cyc”; InputSandbox = {"startCYCAS.sh","borneo_3d.cyc"}; InterCYCAS.jdl

Messina, Tutorial neo assunti progetto PI2S2, Gennaio //grid_console_shadow listens on this port. If not specified is assigned by the OS. ListenerPort = 21000; Requirements = (Member(“CYCAS-3.20”, other.GlueHostApplicationSoftwareRunTimeEnvironment)) &&(Member(“POVRAY-3.5”, other.GlueHostApplicationSoftwareRunTimeEnvironment)) &&(other.GlueHostNetworkAdapterOutboundIP == TRUE); ] InterCYCAS.jdl This is an integer (>0) that represents the port on which the grid_console_shadow process starts to listen for the job standard streams. Its MUST BE unique! This is an integer (>0) that represents the port on which the grid_console_shadow process starts to listen for the job standard streams. Its MUST BE unique!

Messina, Tutorial neo assunti progetto PI2S2, Gennaio The script executed on the WN is the following one: #!/bin/sh # Export DISPLAY environment to a remote machine. export DISPLAY= :0.0 # Define the input file used for rendering by CYCAS. CYCAS_INPUT_FILE=$1 LOCAL_DIR=`pwd` echo "Welcome! This is a simple interactive job."; echo echo "About CYCAS.“ [..] echo "Do you want to start CYCAS (y/n) ? [Y]:" startCYCAS.sh

Messina, Tutorial neo assunti progetto PI2S2, Gennaio read ANS case ${ANS} in Y | y) #Launch the application. cd /usr/local/cycas3./cycas.real \ ${LOCAL_DIR}/${CYCAS_INPUT_FILE} ;; *) echo "Have a nice day!" ;; esac echo "That's all folks!! startCYCAS.sh

Messina, Tutorial neo assunti progetto PI2S2, Gennaio Submit an Interactive Job

Messina, Tutorial neo assunti progetto PI2S2, Gennaio The commands sequence to submit and inspect the status of this example are here reported: voms-proxy-init –-voms cometa edg-job-submit InterCYCAS.jdl edg-job-status

Messina, Tutorial neo assunti progetto PI2S2, Gennaio CYCAS is a piece of architectural software for drafting and design in 2 or 3 dimensions. In addition to typical CAD functions, CYCAS offers special elements and techniques for architectural design. CYCAS exports its 3D data in various formats in order to pass these data on to software for creating computer based graphics. About CYCAS

Messina, Tutorial neo assunti progetto PI2S2, Gennaio.2007 work !

Messina, Tutorial neo assunti progetto PI2S2, Gennaio.2007 work !

Messina, Tutorial neo assunti progetto PI2S2, Gennaio LCG-2 User Guide Manuals Series – gLite WMS’s User Guide – WMS-guide-v0-2.pdf WMS-guide-v0-2.pdf JDL Attributes – JDL-Attributes-v0-8.pdf JDL-Attributes-v0-8.pdf About CYCAS –

Messina, Tutorial neo assunti progetto PI2S2, Gennaio Questions…