CYBERSAR Cybersar Gianluigi Zanetti Cybersar

CYBERSAR Cybersar A cooperative effort for a shared HPC facility Dual purpose –Computational Support to RTD –RTD on computational infrastructure Members of the co-op –CRS4, INAF, INFN, UNICA, UNISS, Nice, Tiscali Partially Funded by MUR –March 2006 – December 2008 Supported by RAS (Sardinian Regional Authority) –access to dark-fibers & regional network AOB INFN

CYBERSAR Cybersar A cooperative effort for a shared HPC facility Dual purpose –Computational Support to RTD –RTD on computational infrastructure Members of the co-op –CRS4, INAF, INFN, UNICA, UNISS, Nice, Tiscali Partially Funded by MUR –March 2006 – December 2008 Supported by RAS (Sardinian Regional Authority) –access to dark-fibers & regional network AOB INFN

CYBERSAR Cybersar Cybersar from afar 1/5 Total: Cpu : 1,224 cores RAM: 2.5 TB Disk: 211 TB Cpu : 488 cores RAM: 1 TB Disk: 100 TB Icnct: GbE, IB Cpu : 256 cores RAM: 0.5 TB Disk: 32 TB Icnct: GbE Cpu : 72 cores RAM: 0.14 TB Disk: 13 TB Icnct:, IB Cpu : 408 cores RAM: 0.8 TB Disk: 66 TB Icnct: GbE, IB

CYBERSAR Cybersar Cybersar from afar 2/5 Total: Cpu : 1,224 cores RAM: 2.5 TB Disk: 211 TB

CYBERSAR Cybersar Cybersar from afar 3/5

CYBERSAR Cybersar Cybersar from afar 4/5 RTR DWDM network 2.5Gb/s lambdas Dark fiber core

CYBERSAR Cybersar Cybersar from afar 5/5 DWDM network 2.5Gb/s lambdas Janna dark fibers

CYBERSAR Cybersar Geographical latencies -or- Have bandwith, can wait Total: Cpu : 1,224 cores RAM: 2.5 TB Disk: 211 TB Cpu : 488 cores RAM: 1 TB Disk: 100 TB Icnct: GbE, IB Cpu : 256 cores RAM: 0.5 TB Disk: 32 TB Icnct: GbE Cpu : 72 cores RAM: 0.14 TB Disk: 13 TB Icnct:, IB Cpu : 408 cores RAM: 0.8 TB Disk: 66 TB Icnct: GbE, IB

CYBERSAR Cybersar Have bandwith, can wait 1/7 Latencies Infiniband ~ 2  sec GbE ~ 10  sec Disk(10K rpm) ~ 8 msec 1 msec 0.5 msec

CYBERSAR Cybersar Have bandwidth, can wait 2/7

CYBERSAR Cybersar Have bandwidth, can wait 3/7 driving application I: large scale virtual observatory for deep space exploration

CYBERSAR Cybersar Have bandwidth, can wait 4/7 driving application II: ensemble forecast system of “extreme” meteorological events

CYBERSAR Cybersar Have bandwidth, can wait 5/7 : wavefield migration and montecarlo imaging of deep underground structures

CYBERSAR Cybersar Have bandwidth, can wait 6/7 driving application IV: immersive exploration of large scale scientific and engineering data

CYBERSAR Cybersar Have bandwidth, can wait 7/7 driving application V: driving (quasi-) holographic display

CYBERSAR Cybersar Dynamic resource allocation Total: Cpu : 1,224 cores RAM: 2.5 TB Disk: 211 TB Cpu : 488 cores RAM: 1 TB Disk: 100 TB Icnct: GbE, IB Cpu : 256 cores RAM: 0.5 TB Disk: 32 TB Icnct: GbE Cpu : 72 cores RAM: 0.14 TB Disk: 13 TB Icnct:, IB Cpu : 408 cores RAM: 0.8 TB Disk: 66 TB Icnct: GbE, IB

CYBERSAR Cybersar Collaborating computing centers, T = T 0 Network infrastructure Computing HW Computing HW Computing HW OS Middleware Application OS

CYBERSAR Cybersar Collaborating computing centers, T = T months Network infrastructure Computing HW Computing HW Computing HW OS Middleware Application OS Middleware

CYBERSAR Cybersar Physical layer VO appslayer VO computing facility layer WN portal WN scheduler WN portal WN scheduler

CYBERSAR Cybersar Physical layer VO computing facility layer WN portal WN scheduler WN portal WN scheduler Control Plane VOCF-1 VOCF-n VOCF Blueprints VOCF running images Activator Hibernator VOCF Manager

CYBERSAR Cybersar WN portal WN scheduler VLAN WN portal WN scheduler Host deploymentVM deployment

CYBERSAR Cybersar Cybersar Control plane Clear separation between –state information & control logic Implemented as a SOA –All components wrapped in a WS –State information -> WSRF –Control logic -> BPEL workflows –VM (Xen) encapsulated by a WSRF (VMH) on each comp. host –Independent comm. Network to components –Low level components control via IPMI/SNMP wrapped by WS Status –Basic Deployement system, Activator and VOCF manager –16 dual opteron testbed –Xen 3, (kvm) support –Started testing gLite WN, CE See also: + Virtual Clusters for Grid Communities. I.Foster et al. CCGrid An Edge Services Framework (ESF) for EGEE, LCG, and OSG. A.Rana et al. CHEP (Computing in High Energy and Nuclear Physics) 2006, Mumbai, February 13-17, SOA based control plane for virtual clusters, P.Anedda et Al. IEEE-XHPC’07, 2007

CYBERSAR Cybersar Cyber-infrastructure for research in Sardinia Dedicated to the support of scientific & technological research Based on high speed networks connecting Network core on dark fibers Excellent platform to support research on –Optical switching –Bandwidth Unlimited Computing –Computing control plane AOB

CYBERSAR Cybersar Questions?