EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks G-ICS Grid–Instrument Control System C. Vuerli OGF20 and EGEE User Forum II Interactivity and Portals Manchester, 11 May 2007

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 2 The Goal Gridification of Telescopes and attached astronomical instrumentation to allow remote monitoring and control in Quasi- Real Time –Step 1. Remote monitoring of telemetry and scientific data under acquisition –Step 2. Remote control: the astronomer interacts with night assistant by remotely sending commands and receiving feedback

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 3 The Origin: The GRID.IT Project GRID.IT: National multi-disciplinary project to validate the Italian Grid infrastructure INAF participated with 3 applications –Access to Astronomical Databases via Grid –Porting on Grid the VST Pipelines –Monitoring/Control of astronomical instrumentation

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 4 Blueprint for an Instrument Element The Grid Resource Framework Layer, Information System and Data Model is extended so that a Control System (sensors, instruments, etc.) becomes a valid instance for a Grid computing model. A new Grid component (G- ICS) that enables the access to a Control System, totally integrated with the Grid Monitoring and Discovery System and Resource Broker is defined A new Grid Element, the Instrument Element, can be built on top of the G-ICS component.

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 5 Blueprint for an Instrument Element Modify the Job Management component to access new kind of resources Integrate the Information system with the “description” of the new resource; Use the Grid Security Infrastructure No modification on the client and server side: if I can submit a job I can also submit an “ACTION”! No modification on the Brokering/Workflow systems: if I can direct the CE I can direct also an IE.

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 6 Our Grid It is the Grid middleware that we used in the framework of GRID.IT Project Set up by INFN (National Institute of Nuclear Physics) to run jobs of the LHC (Large Hadron Collider) experiments (CERN, Geneva) LCG (LHC Computing Grid) based on Globus 2.4  native computing and data storage resources LCG now migrated to gLite (WebServices enabled) No native access to non-computational resources G-ICS: a low level integration framework In Globus and not on GlobusIn Globus and not on Globus

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 7 Control systems in Grid Grid TeleControl Protocol (GTCP) –JavaServices + GT4 container Xport (X-ray Cristallography) –WebServices GridCC –Web Services G-ICS a low level integration framework on a production grid

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 8 Recycling work on G-DSE to enable G-ICS Provide a suitable formal definition of a Grid Abstract Computing Machine using Formal specification language Review the architectural definition of a Data Source Engine (DSE), to build an Instrument Control System Provide ICS integrated in the existing Grid Resource Layer Framework (G-ICS) Extend GIS capabilities to understand and handle monitoring and control requests to ICS Extend GIS capabilities to describe ICS Resources Provide a new Manager for ICS integrated in Globus Extend semantic and provide it to RSL to use G-ICS Etc…

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 9 G-DSE and G-ICS gatekeeper JobManger JobProcess Scheduler p-in Pbs/LSF GRAM GIS MDS GRIS Ldap ldif Grid Providers (snmp) Instrument Control System ICSManger ICS plug-in ICSProcess ICS specific driver ICS

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 10 Globus4 Integration GRAM services Delegation RFT GRAM Adapter Local Db control ACTION “plug-in” ICS Process GridFTP Remote SE Synchrotron

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 11 LCG-2 DB + ICS enabled middleware Computing cluster Network resourcesData storage Operating system Local scheduler File system User accessSecurityData transferInformation schema Resource BrokerData managementApp monitoring system User interfaces Applications Hardware System software “Basic” services “Collective” services Application level services HPSS, CASTOR… Scientific Linux NFS, … PBS, Condor, LSF,… VDT (Condor, Globus, GLUE) + XMLDB + XMLICS EU DataGrid +Glite + G-DSE + G-ICS Information system RDBMS MySQL Ora, etc. ICS Instruments

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 12 From G-ICS to IE With the “G-ICS enabled” collective and resource Grid layers, the new IE of the Grid is introduced IE is a CE able to manage, monitor and control requests to interact with ICS resources via Grid It speaks RSL to interact with Grid services, and ICSL (Instrument Control System Language) when connecting an ICS

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 13 From G-ICS to IE What we need is: –ICSP: a ICS Protocol to make IE and ICS able to communicate each other –ICSL: a ICS Language used by IE to speak with ICS according to protocol ICSP –ICSC: an Instrument Control System Connector, being it a driver able to  speak ICSL and understand ICSP-compliant requests and map them in requests to the specific ICS sitting behind it  handle answers to these requests

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 14 Grid Instrument Control System Local Resource Manager ICS Grid Access Enabled GRAM Protocol Grid Information System MDS LDAP Job Manager ICSC Manager ICS Instance Man ICSC Driver ICS Instance Worker Node Meta Machine GANGLIA snmpd ICS Synchro CS Tel CS Synchro ODBC Manager DSE Instance Man ODBC Driver DSE Instance DSE Internal DB User DB

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 15 IE and the WMS New job wrapper for iemanager gatekeeper ICS Manger ICS Process ACTION plug-in ICS specific driver ACTIONWrapper RB

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 16 Long Term Goal: Grid and VObs UIUI Grid Information and Brokering System Mon/Ctrl requests QE MetaData IE ICSL IE ICSL RSL(VOQL) Data Instrument Control System RSL ICSC Instrument Control System ICSC

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 17 ICSL UI/IE interactions trough a ICS LANGUAGE RSL > globus-job-run g.dse.host/iemanager-ICS -queue LM01 “get info” VCore 1: V (min = V, max = V) VCore 2: V (min = V, max = V) +3.3V: V (min = V, max = V) +5V: V (min = V, max = V) +12V: V (min = V, max = V) -12V: V (min = V, max = V) -5V: V (min = V, max = V) V5SB: V (min = V, max = V) ALARM VBat: V (min = V, max = V) fan1: 0 RPM (min = 3000 RPM, div = 2) fan2: 0 RPM (min = 3000 RPM, div = 2) fan3: 6250 RPM (min = 750 RPM, div = 8) temp1: +41°C (limit = +60°C) sensor = thermistor

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 18 In Summary: What is the IE? The IE inherits from the CE, so it has all the characteristics of a classic computing element The IE, moreover, makes possible to –Publish on the Grid any kind of scientific instrumentation. Telescopes and related astronomical instrumentation are just an example of it –Share on the Grid infrastructure any kind of scientific instrumentation –Get access to any kind of scientific instrumentation shared on the Grid infrastructure –Perform remote monitoring sessions in which the Grid technology only is used –Perform remote control sessions in which the Grid technology only is used

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 19 Current Status (I) Institutes that collaborated in the framework of GRID.IT Project –INAF Trieste  IE project coordination and development/test  G-DSE development/test –INAF Padova  G-DSE development/test –INAF Capodimonte (Naples)  IE development/test –INFN-CNAF  G-DSE development/test

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 20 Current Status (II) We are going on through subsequent refinement steps For the time being monitoring only implemented Two test-bed ICS identified (at Trieste and Naples observatories) Tests successfully carried out on EGEE implementation of the Grid middleware

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 21 Future perspectives New project proposals and requests for funding under evaluation to carry out the implementation of the Instrument Element Stay tuned with major projects dealing with Grid and instruments –RISGE (Remote Instrumentation Services in Grid Environment) BoF

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 22 Test-bed and the first prototype of UIF First prototype of UIF written in Java The Celestron C-14 located at the Basovizza branch station of INAF-OATs

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 23 The final goal: An Integrated System Grid-UI The GRID Grid-GUI IE QE DBMS CE SE IE Synchrotron

Enabling Grids for E-sciencE EGEE-II INFSO-RI OGF20 and EGEE User Forum II - Interactivity and Portals 24 End of Presentation Thank you for your attention