Enabling Grids for E-sciencE www.eu-egee.org Workload Management System on gLite middleware - commands Matthieu Reichstadt CNRS/IN2P3 ACGRID School, Hanoi.

Slides:



Advertisements
Similar presentations
INFSO-RI Enabling Grids for E-sciencE Workload Management System and Job Description Language.
Advertisements

The Grid Constantinos Kourouyiannis Ξ Architecture Group.
Job Submission The European DataGrid Project Team
Steve LloydGridPP13 Durham July 2005 Slide 1 Using the Grid Steve Lloyd Queen Mary, University of London.
Riccardo Bruno, INFN.CT Sevilla, 10-14/09/2007 GENIUS Exercises.
INFSO-RI Enabling Grids for E-sciencE EGEE Middleware The Resource Broker EGEE project members.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Job Submission Fokke Dijkstra RuG/SARA Grid.
The EDG Workload Management System – n° 1 The EDG Workload Management System.
Basic Grid Job Submission Alessandra Forti 28 March 2006.
FESR Consorzio COMETA - Progetto PI2S2 Using MPI to run parallel jobs on the Grid Marcello Iacono Manno Consorzio COMETA
Job Submission The European DataGrid Project Team
Enabling Grids for E-sciencE gLite training at Sinaia '06 Victor Penso Kilian Schwarz GSI Darmstadt Germany.
INFSO-RI Enabling Grids for E-sciencE Practicals on VOMS and MyProxy Emidio Giorgio INFN Retreat between GILDA and ESR VO, Bratislava,
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Luciano Díaz ICN-UNAM Based on Domenico.
Enabling Grids for E-sciencE EGEE-II INFSO-RI BG induction to GRID Computing and EGEE project – Sofia, 2006 Practical: Porting applications.
INFSO-RI Enabling Grids for E-sciencE GILDA Praticals GILDA Tutors INFN Catania ICTP/INFM-Democritos Workshop on Porting Scientific.
GRID Computing: Ifrastructure, Development and Usage in Bulgaria M. Dechev, G. Petrov, E. Atanassov.
Computational grids and grids projects DSS,
Enabling Grids for E-sciencE Workload Management System on gLite middleware Matthieu Reichstadt CNRS/IN2P3 ACGRID School, Hanoi (Vietnam)
Nadia LAJILI User Interface User Interface 4 Février 2002.
INFSO-RI Enabling Grids for E-sciencE Workload Management System Mike Mineter
Group 1 : Grid Computing Laboratory of Information Technology Supervisors: Alexander Ujhinsky Nikolay Kutovskiy.
Job Submission The European DataGrid Project Team
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite job submission Fokke Dijkstra Donald.
Enabling Grids for E-sciencE EGEE-II INFSO-RI Practical: Porting applications to the GILDA grid Slides from Vladimir Dimitrov, IPP-BAS.
Enabling Grids for E-sciencE EGEE-II INFSO-RI Introduction to Grid Computing, EGEE and Bulgarian Grid Initiatives Plovdiv, 2006.
E-infrastructure shared between Europe and Latin America Security Hands-on Christian Grunfeld, UNLP 8th EELA Tutorial, La Plata, 11/12-12/12,2006.
E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA Hands-on on security Pedro Rausch IF - UFRJ.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Feb. 06, Introduction to High Performance and Grid Computing Faculty of Sciences,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Job Submission Fokke Dijkstra RuG/SARA Grid.
Jan 31, 2006 SEE-GRID Nis Training Session Hands-on V: Standard Grid Usage Dušan Vudragović SCL and ATLAS group Institute of Physics, Belgrade.
Job Management DIRAC Project. Overview  DIRAC JDL  DIRAC Commands  Tutorial Exercises  What do you have learned? KEK 10/2012DIRAC Tutorial.
E-infrastructure shared between Europe and Latin America 1 Workload Management System-WMS Luciano Diaz Universidad Nacional Autónoma de México - UNAM Mexico.
INFSO-RI Enabling Grids for E-sciencE Αthanasia Asiki Computing Systems Laboratory, National Technical.
High-Performance Computing Lab Overview: Job Submission in EDG & Globus November 2002 Wei Xing.
EGEE-0 / LCG-2 middleware Practical.
INFSO-RI Enabling Grids for E-sciencE GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,
Tier 3 Status at Panjab V. Bhatnagar, S. Gautam India-CMS Meeting, July 20-21, 2007 BARC, Mumbai Centre of Advanced Study in Physics, Panjab University,
INFSO-RI Enabling Grids for E-sciencE Job Submission Tutorial (material from INFN Catania)
Workload Management System Jason Shih WLCG T2 Asia Workshop Dec 2, 2006: TIFR.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America WMS+LB Server Installation Tony Calanducci.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Moisés Hernández Duarte UNAM FES Cuautitlán.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Command Line Grid Programming Spiros Spirou Greek Application Support Team NCSR “Demokritos”
INFSO-RI Enabling Grids for E-sciencE GILDA Praticals Giuseppe La Rocca INFN – Catania gLite Tutorial at the EGEE User Forum CERN.
Further aspects of EGEE middleware components INFN, Catania EGEE is funded by the European Union under contract IST
Enabling Grids for E-sciencE EGEE-II INFSO-RI Porting an application to the EGEE Grid & Data management for Application Rachel Chen.
Enabling Grids for E-sciencE Sofia, 17 March 2009 INFSO-RI Introduction to Grid Computing, EGEE and Bulgarian Grid Initiatives –
C. Loomis – Demonstration-Dec. 12, n° 1 Testbed 1 Demonstration December 12, 2001
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks WMS tricks & tips – further scripting Giuseppe.
Job Submission The European DataGrid Project Team
Biomed tutorial 1 Enabling Grids for E-sciencE INFSO-RI EGEE is a project funded by the European Union under contract IST JDL Flavia.
User Interface UI TP: UI User Interface installation & configuration.
LCG2 Tutorial Viet Tran Institute of Informatics Slovakia.
Enabling Grids for E-sciencE gLite security pratical tutorial Dario Russo INFN Catania Catania,
GRID commands lines Original presentation from David Bouvet CC/IN2P3/CNRS.
Introduction to Computing Element HsiKai Wang Academia Sinica Grid Computing Center, Taiwan.
FESR Consorzio COMETA - Progetto PI2S2 Using MPI to run parallel jobs on the Grid Marcello Iacono Manno Consorzio Cometa
Enabling Grids for E-sciencE Work Load Management & Simple Job Submission Practical Shu-Ting Liao APROC, ASGC EGEE Tutorial.
EGEE is a project funded by the European Union under contract IST Job Submission Giuseppe La Rocca EGEE NA4 Generic Applications INFN Catania.
Practicals on VOMS and MyProxy
Introductions Using gLite Grid Miguel Angel Díaz Corchero
Corso di Calcolo Parallelo Grid Computing
5. Job Submission Grid Computing.
login: clermont-ferrandxx password: GridCLExx
Certificates Usage and Simple Job Submission
Certificates Usage and Simple Job Submission
Certificates Usage and Simple Job Submission
gLite Job Management Christos Theodosiou
GENIUS Grid portal Hands on
WMS+LB Server Installation and Configuration
Presentation transcript:

Enabling Grids for E-sciencE Workload Management System on gLite middleware - commands Matthieu Reichstadt CNRS/IN2P3 ACGRID School, Hanoi (Vietnam) November 5th, 2007

ACGrid School 5-9/ Enabling Grids for E-sciencE Create a proxy : voms-proxy-init –voms – Enter your certificate’s password – Get your proxy Submit the job: edg-job-submit mytest.jdl – You get your job unique identifier (JobId) Get the job status : edg-job-status JobId – Request the L&B in order to know the status of your job When the job status is “OutputReady” you cabn get the output : edg-job-get-output JobId – The system returns the output in a temporary folder on the UI

ACGrid School 5-9/ Enabling Grids for E-sciencE Minimal version ( helloworld.jdl) We specify : – The executable – STDOUT and STDERR Executable = “/bin/echo”; Arguments = “Hello world”; StdError = “hello.out”; StdOutput = “hello.err”; OutputSandbox = {“hello.out”, “hello.err”};

ACGrid School 5-9/ Enabling Grids for E-sciencE Get the proxy reichma]$ voms-proxy-init --voms auvergrid:/Role=lcgadmin Your identity: /O=GRID-FR/C=FR/O=CNRS/OU=LPC/CN=Matthieu Reichstadt Enter GRID pass phrase: Creating temporary proxy Done Contacting cclcgvomsli01.in2p3.fr:15002 [/O=GRID- FR/C=FR/O=CNRS/OU=CC- LYON/CN=cclcgvomsli01.in2p3.fr] "auvergrid" Done Creating proxy Done Your proxy is valid until Sun Nov 4 19:58:

ACGrid School 5-9/ Enabling Grids for E-sciencE Job submission test]$ edg-job-submit --vo auvergrid helloworld.jdl Selected Virtual Organisation name (from --vo option): auvergrid Connecting to host lapp-rb01.in2p3.fr, port 7772 Logging to host lapp-rb01.in2p3.fr, port 9002 ************************************************************************************** JOB SUBMIT OUTCOME The job has been successfully submitted to the Network Server. Use edg-job-status command to check job current status. Your job identifier (edg_jobId) is: - ************************************************************************************** JobId

ACGrid School 5-9/ Enabling Grids for E-sciencE Get the Job status test]$ edg-job-status rb01.in2p3.fr:9000/zGuUkhru2xQzZZzPAbB2H ************************************************************* BOOKKEEPING INFORMATION: Status info for the Job : Current Status: Done (Success) Exit code: 0 Status Reason: Job terminated successfully Destination: iut15auvergridce01.univ-bpclermont.fr:2119/jobmanager- lcgpbs-auvergrid reached on: Sun Nov 4 07:08: *************************************************************

ACGrid School 5-9/ Enabling Grids for E-sciencE Get the job output test]$ edg-job-get-output rb01.in2p3.fr:9000/zGuUkhru2xQzZZzPAbB2H Retrieving files from host: lapp-rb01.in2p3.fr ( for rb01.in2p3.fr:9000/zGuUkhru2xQzZZzPAbB2H ) ********************************************************************************* JOB GET OUTPUT OUTCOME Output sandbox files for the job: - have been successfully retrieved and stored in the directory: /tmp/jobOutput/reichma_zGuUkhru2xQzZZzPAbB2Hw ********************************************************************************* test]$ cat /tmp/jobOutput/reichma_zGuUkhru2xQzZZzPAbB2Hw/hello.out Hello World

ACGrid School 5-9/ Enabling Grids for E-sciencE edg-job-submit [–r ] [-c ] [-o ] [--vo ] – -r : the job is directly submitted to the CE identified by – -c : uses the configuration file in order to overload the default values of the UI – -o : returns the jobID in – --vo : the virtual organization on which the job is submitted

ACGrid School 5-9/ Enabling Grids for E-sciencE edg-job-list-match  Lists the resources corresponding to the job description  Allows he user to know the result of the scheduling without submitting the job.  edg-job-cancel [–i ]  Cancels the job.  edg-job-status [–i ]  Gets the job status. edg-job-get-output [--dir ] [–i ]  Gets the content of the OutputSandbox edg-job-get-logging-info [–i ]  Displays the informations on the status taken by the job during his life cycle.

ACGrid School 5-9/ Enabling Grids for E-sciencE Thank you