2nd European PlanetLab Meetings, EPFL, Oct The EverLab Project Danny Bickson, Elliot Jaffe The Hebrew University of Jerusalem, Israel

2nd European PlanetLab Meetings, EPFL, Oct The Evergrow EU Project About 28 participants from academy and industry. About 28 participants from academy and industry. Project goal: predict the Interent in 25 years from now Project goal: predict the Interent in 25 years from now 4-year project. 4-year project.

2nd European PlanetLab Meetings, EPFL, Oct A = Aston Univ.uk B = Orsay.fr C = Louvain.ac.be D = Magdeburg.de E = Rome.it F = SICS.se G = Colbud.hu H = TAU.ac.il

2nd European PlanetLab Meetings, EPFL, Oct Problem Statement 8 European sites of 14 IBM eServer blades each: 8 European sites of 14 IBM eServer blades each: Tel Aviv, Orsay, Stockholm, Rome, Budapest, Magdenburg, Louvain-La-Nouve and Aston. Tel Aviv, Orsay, Stockholm, Rome, Budapest, Magdenburg, Louvain-La-Nouve and Aston. Would like to run distributed applications, measurement and simulations. Would like to run distributed applications, measurement and simulations. Problems of users and node management Problems of users and node management No system wide login, 8 different sys admins, No common OS, 8 different firewalls, No system wide monitor No system wide login, 8 different sys admins, No common OS, 8 different firewalls, No system wide monitor

2nd European PlanetLab Meetings, EPFL, Oct Proposed Solution Install a private PlanetLab network across all clusters. Install a private PlanetLab network across all clusters. Maintain one PLC for all user and node management. Maintain one PLC for all user and node management. Move existing software from PlanetLab to our clusters. Move existing software from PlanetLab to our clusters. Examples: P-Grid, Mozart/OZ, Julia, etc. Examples: P-Grid, Mozart/OZ, Julia, etc. Educate users to work in the PlanetLab environment. Educate users to work in the PlanetLab environment.

2nd European PlanetLab Meetings, EPFL, Oct Project challenges Hardware/software Hardware/software Security issues Security issues Political issues.. Political issues..

2nd European PlanetLab Meetings, EPFL, Oct Hardware challenges Different hardware drivers/ kernel models needed Different hardware drivers/ kernel models needed IBM eServer blades have a common USB bus IBM eServer blades have a common USB bus One CD-ROM and floppy drive for 14 blades One CD-ROM and floppy drive for 14 blades Keyboard/mouse are on USB bus Keyboard/mouse are on USB bus PlanetLab does not support USB/SATA PlanetLab does not support USB/SATA Booting from a USB disk on key is not supported Booting from a USB disk on key is not supported Currently a PlanetLab node boots from a fixed CD- ROM drive, and reads the config file from the floppy drive. Currently a PlanetLab node boots from a fixed CD- ROM drive, and reads the config file from the floppy drive.

2nd European PlanetLab Meetings, EPFL, Oct Current project status PLC Installed at HUJI, Jerusalem PLC Installed at HUJI, Jerusalem Managed to install on one node in HUJI, and one blade in TAU ( ) Managed to install on one node in HUJI, and one blade in TAU ( ) Major changes relative to the PlanetLab software. Major changes relative to the PlanetLab software. Modified boot cd Kernel to support hardware Modified boot cd Kernel to support hardware Modified install scripts to load additional hardware modules Modified install scripts to load additional hardware modules Changed installation to override floppy and CD- ROM drives Changed installation to override floppy and CD- ROM drives

2nd European PlanetLab Meetings, EPFL, Oct Remaining Issues How to securely reboot nodes that have no read- only media How to securely reboot nodes that have no read- only media CDROM CDROM USB USB DHCP/Bootp DHCP/Bootp BootCD Image on unmounted partition BootCD Image on unmounted partition Blades have significant disk space. Can we share it across the system? Blades have significant disk space. Can we share it across the system? NFS4, AFS, GFS,GPFS NFS4, AFS, GFS,GPFS

2nd European PlanetLab Meetings, EPFL, Oct Security issues Blades are in highly secure environment (closed computer rooms) Blades are in highly secure environment (closed computer rooms) Local System Admins are very nervous about exposed machines on their networks (no firewall, etc). Local System Admins are very nervous about exposed machines on their networks (no firewall, etc). EverLab nodes share a common switching fabric with other blades EverLab nodes share a common switching fabric with other blades EverLab nodes will be separated in a different VLAN EverLab nodes will be separated in a different VLAN

2nd European PlanetLab Meetings, EPFL, Oct Political issues Each computer room is managed by different administration Each computer room is managed by different administration Convince each site that it will benefit from the project Convince each site that it will benefit from the project Hardware has required multiple service calls Hardware has required multiple service calls Request users to change their software / working habits Request users to change their software / working habits

2nd European PlanetLab Meetings, EPFL, Oct Future work Install several dozen nodes in the coming two months Install several dozen nodes in the coming two months Merge our changes back to PLC Merge our changes back to PLC Start distributed experiments Start distributed experiments Create a diskless PlanetLab node Create a diskless PlanetLab node