JBQS - Bernard CHAMBON - HEPIX, Nov JBQS presentation IN2P3 Computer Center Campus de la DOUA 27, Boulevard du 11 Novembre VILLEURBANNE FRANCE

JBQS - Bernard CHAMBON - HEPIX, Nov JBQS : Graphical Interface for BQS

JBQS - Bernard CHAMBON - HEPIX, Nov Slide N o 3 BQS Summary Software component for batch management Allows –The submission of jobs; –The scheduling and execution of jobs on workers; –The monitoring of a job. Developed and used at the IN2P3 Computer Centre (France) In October 2000, BQS drives –900 workpoints on; –250 workers and; –10 classes.

JBQS - Bernard CHAMBON - HEPIX, Nov Slide N o 4 Worker : A physical machine where jobs can run. Class : –Description of resources such as Amount of CPU, memory, scratch, spool size, etc. –Other characteristics such as privileged access, AFS token information. –Example : Workers, Classes, Workpoints

JBQS - Bernard CHAMBON - HEPIX, Nov Slide N o 5 Workpoint : –Used to get a better control over job production; –Defined as a set of ordered classes allocated to a worker; –Runs only one job at a time, but –Multiple workpoints on a worker. –Example : workpoints definition for ccwasn01 (two processors SUN worker) : T,S : G,C,A : I,R,J,P : S,T,I,R Up to 4 jobs can run at the same time for the ccwasn01 worker. –About 900 workpoints at the IN2P3 Computer Center. Workers, Classes, Workpoints

JBQS - Bernard CHAMBON - HEPIX, Nov Slide N o 6 JBQS design goals A graphical interface for –production manager; –BQS administrator; –on duty staff. Avoid knowledge of BQS Unix command syntax. Allows –Graphical query; –Results display with Editing abilities (finding, sorting, selecting); Interactions facilities on single or multiple selections.

JBQS - Bernard CHAMBON - HEPIX, Nov Slide N o 7 Structure of JBQS Batch management Production manager Available BQS administration BQS staff Available Batch status,On duty staff Under development Resources optimisation

JBQS - Bernard CHAMBON - HEPIX, Nov Slide N o 8 Batch management : Description Batch management allows query & control over –jobs; –workers; –workpoints; –dispatching authorisation. Queries are made through various criteria from menus. Results interaction with –Popup menu allows actions on single or multiples selected cell. –Editing abilities allows finding, extracting, sorting. Predefined options such as job type or frequently used command options can be set.

JBQS - Bernard CHAMBON - HEPIX, Nov Slide N o 9 Batch management : Diagram Workers JobsWorkpoints Query by: user group platform worker class workpoint Query by: platform name Query by: platform worker name Switching ability

JBQS - Bernard CHAMBON - HEPIX, Nov Slide N o 10 First example : –CPU limit modification on a running job. Second example –Draining a set of workers. Screenshots examples

JBQS - Bernard CHAMBON - HEPIX, Nov Slide N o 11 Job query by account Account choice Job menu selection

JBQS - Bernard CHAMBON - HEPIX, Nov Slide N o 12 Job results Job results panel Text-area panel

JBQS - Bernard CHAMBON - HEPIX, Nov Slide N o 13 Action on a job Popup menu for the selected cell Job action choice panel

JBQS - Bernard CHAMBON - HEPIX, Nov Slide N o 14 Multiple workers drain action Worker menu selection Platform choice

JBQS - Bernard CHAMBON - HEPIX, Nov Slide N o 15 Worker results worker results panel Action status

JBQS - Bernard CHAMBON - HEPIX, Nov Slide N o 16 Multiple workers drain action 3) Worker action panel 1) Selection of multiple workers 2) Popup menu for selected cells

JBQS - Bernard CHAMBON - HEPIX, Nov Slide N o 17 BQS administration description Allows modification on all BQS objects i.e. : Farm, platform, machine, workpoint, class and account. Objects can be created or deleted Parameters can be modified and then –applied to the object itself; –propagated to other selected object.

JBQS - Bernard CHAMBON - HEPIX, Nov Slide N o 18 First example : –Default CPU modification on one class (G). Second example –Swap space modification on multiple workers. Screenshots examples

JBQS - Bernard CHAMBON - HEPIX, Nov Slide N o 19 Default CPU modification on class G New default AND max CPU values (previous 30,000) Apply new values (default and max CPU) to the class G

JBQS - Bernard CHAMBON - HEPIX, Nov Slide N o 20 New swap space for multiple workers 2) New Swap Space value (previous 4,000) 1) Selection of multiple workers 3) Button for (only) Swap Space modification

JBQS - Bernard CHAMBON - HEPIX, Nov Slide N o 21 Implementation features A Java standalone application with BQS calls made through an C API (uses of JNI * ). Available on Solaris 2.7 and Linux RH 6.1. On any platform as soon as RMI * functionality is implemented. Multithreaded application for BQS calls, in order to get a better response time. Dynamically dialog boxes generation (thanks to Java). Multiple windows with menus. Text area panel with file Open/Save et Cut/Copy/Paste facilities. * JNI : Java Native Interface. * RMI : Remote Method Invocation.

JBQS - Bernard CHAMBON - HEPIX, Nov Slide N o 22 Next implementation Editing functions for results –Finding, –Sorting, –Selecting RMI * functionality * RMI : Remote Method Invocation.

JBQS - Bernard CHAMBON - HEPIX, Nov Slide N o 23 Future development BQS status functionality –Worker status; –Job running status (dead lock, infinity loops). Batch production flow (in order to optimise) –Estimated ending time of running and queued jobs; –Workpoints and classes occupation rate. JDBC * implementation in JBQS (After a data-base migration for BQS software) * JDBC : Java Data Base Connectivity

JBQS - Bernard CHAMBON - HEPIX, Nov Slide N o 24 More information About BQS – CC/interne/pub/bqs/index.html – (Yves FOUILHE) (Bernard CHAMBON) About CC-IN2P3 – About Java –