An Introduction to PlanetLab Prepared By: Abhishek Agrawal.

Slides:



Advertisements
Similar presentations
ITR3 lecture 7: more introduction to UNIX Thomas Krichel
Advertisements

PlanetLab: An Overlay Testbed for Broad-Coverage Services Bavier, Bowman, Chun, Culler, Peterson, Roscoe, Wawrzoniak Presented by Jason Waddle.
Sonny J Zambrana University of Pennsylvania ISC-SEO November 2008.
SSH SSH is “Secure SHell” Secure, compressed, widely supported, fast Allows both users to get jobs done, and also allows system administrators to sleep.
1 Automated SFTP Windows and SUN Linux and SUN. 2 Vocabulary  Client = local=the machine generating the SFTP request  Server = remote = the machine.
1 Applications Virtualization in VPC Nadya Williams UCSD.
SSH Operation and Techniques - © William Stearns 1 SSH Operation and Techniques The Swiss Army Knife of encryption tools…
PlanetLab What is PlanetLab? A group of computers available as a testbed for computer networking and distributed systems research.
Computer Organization Tools Computer Organization 1 © WD McQuain Programming Tools Most of the programming assignments will require using.
Status of BESIII Distributed Computing BESIII Workshop, Mar 2015 Xianghu Zhao On Behalf of the BESIII Distributed Computing Group.
EverLab Workshop, June 7-8, 2006, Jerusalem Working with PlanetLab/EverLab Danny Bickson.
1 PlanetLab: A globally distributed testbed for New and Disruptive Services CS441 Mar 15th, 2005 Seungjun Lee
PlanetLab Europe 2008 Thomas Bourgeau Laboratoire LIP6 – CNRS Université Pierre et Marie Curie – Paris 6
Setting up of condor scheduler on computing cluster Raman Sehgal NPD-BARC.
1 PLuSH – Mesh Tree Fast and Robust Wide-Area Remote Execution Mikhail Afanasyev ‧ Jose Garcia ‧ Brian Lum.
PlanetLab What is PlanetLab? A group of computers available as a testbed for computer networking and distributed systems research.
Deployment and Configuration Management Solution
Reproducible Environment for Scientific Applications (Lab session) Tak-Lon (Stephen) Wu.
Amazon EC2 Quick Start adapted from EC2_GetStarted.html.
Integrating HADOOP with Eclipse on a Virtual Machine Moheeb Alwarsh January 26, 2012 Kent State University.
Firewalls, Perimeter Protection, and VPNs - SANS © SSH Operation The Swiss Army Knife of encryption tools…
Ssh: secure shell. overview Purpose Protocol specifics Configuration Security considerations Other uses.
A crash course in njit’s Afs
Introduction to UNIX/Linux Exercises Dan Stanzione.
Deploying Experiments with Raven Scott Baker SB-Software John H. Hartman University of Arizona.
Building service testbeds on FIRE D5.2.5 Virtual Cluster on Federated Cloud Demonstration Kit August 2012 Version 1.0 Copyright © 2012 CESGA. All rights.
1 Intro to Linux - getting around HPC systems Himanshu Chhetri.
OnTimeMeasure Integration with Gush Prasad Calyam, Ph.D. (PI) Tony Zhu (Software Programmer) Alex Berryman (REU Student) GEC10 Selected.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Overview of software tools for gLite installation & configuration.
Andy Bavier, PlanetWorks Scott Baker, SB-Software July 27, 2011.
PrimoGENI Tutorial Miguel Erazo, Neil Goldman, Nathanael Van Vorst, and Jason Liu Florida International University Other project participants: Julio Ibarra.
Managing User Accounts. Module 2 – Creating and Managing Users ♦ Overview ► One should log into a Linux system with a valid user name and password granted.
MyPLC My Little PlanetLab Mark Huang
| nectar.org.au NECTAR TRAINING Module 5 The Research Cloud Lifecycle.
1 Introduction to the tutorial for site managers Antonio Fuentes Red.es/RedIRIS EGEE/EUMedGrid/EELA Tutorial for Managers Sevilla,
We will now practice the following concepts: - The use of known_hosts files - SSH connection with password authentication - RSA version 2 protocol key.
Install Software. UNIX Shell The UNIX/LINUX shell is a program important part of a Unix system. interface between the user & UNIX kernel starts running.
AE6382 Secure Shell Usually referred to as ssh, the name refers to both a program and a protocol. The program ssh is one of the most useful networking.
Introduction to Microsoft Management Console (MMC) MMC is a common console framework for management applications. MMC provides a common environment for.
The Secure Shell Copyright © Software Carpentry 2011 This work is licensed under the Creative Commons Attribution License See
Berkeley R Utilities & the new S Utilities The Unix (or Berkeley) r utilities provide an alternative to IP facilities telnet and ftp. Three programs: rlogin.
REMOTE LOGIN. TEAM MEMBERS AMULYA GURURAJ 1MS07IS006 AMULYA GURURAJ 1MS07IS006 BHARGAVI C.S 1MS07IS013 BHARGAVI C.S 1MS07IS013 MEGHANA N. 1MS07IS050 MEGHANA.
ABone Architecture and Operation ABCd — ABone Control Daemon Server for remote EE management On-demand EE initiation and termination Automatic EE restart.
Introduction to System Admin Sirak Kaewjamnong. 2 The system administration’s job  Adding a new user  Doing backup and restoring files from backups.
GeniDesktop : The GEMINI Portal (and more) Hussam Nasir University of Kentucky.
SSH Tricks Slide 1 SSH Tricks Matthew G. Marsh. SSH Tricks Slide 2 Overview  SSH –What is it –How does it work  Discussion of Network Topology –Tricks.
Phil Hurvitz Securing UNIX Servers with the Secure.
SSH Tricks for CSF Slide 1 NEbraskaCERT SSH Tricks Matthew G. Marsh 05/21/03.
Creating and running an application.
PerfSONAR-PS Functionality February 11 th 2010, APAN 29 – perfSONAR Workshop Jeff Boote, Assistant Director R&D.
XWN740 X-Windows Configuring and Using Remote Access (Chapter 13: Pages )‏
LSF Universus By Robert Stober Systems Engineer Platform Computing, Inc.
SSH. 2 SSH – Secure Shell SSH is a cryptographic protocol – Implemented in software originally for remote login applications – One most popular software.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI CloudBroker usage Zoltán Farkas MTA SZTAKI LPDS
Chapter 7: Using Network Clients The Complete Guide To Linux System Administration.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Overview of software tools for gLite installation & configuration.
Linux Basics Part 2. VIM Editor vi improved Installed on most Linux machines Can be a bit confusing at first... o Cheat sheets FTW Other popular editors:
Spacewalk + Fedora = 42. What is Spacewalk? A systems management platform designed to provide complete lifecycle management of the operating system and.
1 Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. http//free-electrons.com SSH Thomas Petazzoni Free.
Managing User Desktops with Group Policy
Programming Tools Most of the programming assignments will require using the C language. We will use a current version of the GCC C compiler. What’s GCC?
Welcome to Indiana University Clusters
Chapter 9 Router Configuration (Ospf, Rip) Webmin, usermin Team viewer
Creating and running applications on the NGS
XWN740 X-Windows Configuring and Using Remote Access
File Transfer Olivia Irving and Cameron Foss
SSH SSH is “Secure SHell” Secure, compressed, widely supported, fast
OPS235: Lab 2 Virtual Machines – Part I
Introduction to High Performance Computing Using Sapelo2 at GACRC
Programming Tools Most of the programming assignments will require using the C language. We will use a current version of the GCC C compiler. What’s GCC?
Presentation transcript:

An Introduction to PlanetLab Prepared By: Abhishek Agrawal

Presentation Outline  Details about PlanetLab and Slice Management  PlanetLab Tools

Details about PlanetLab and Slice

What is PlanetLab??  PlanetLab is an overlay test bed designed to allow researchers to experiment with network applications and services that benefit from distribution across a wide geographic area.  PlanetLab Consortium is a collection of academic, industrial, and government institutions cooperating to support and enhance the PlanetLab overlay network  For more information visit

How to Join PlanetLab??  Need to donate two machines and host two PlanetLab nodes locally.  After approval, PI’s can create slices  A slice is a set of allocated resources distributed across PlanetLab  After being assigned a slice, a user can add nodes to it.

Getting Started with PlanetLab  Register for a PlanetLab account by visiting the Account Registration page. Account RegistrationAccount Registration  Contact PI for account to be activated

Create an SSH Key  Remote access to PlanetLab nodes is restricted to SSH login using RSA authentication  To generate an SSH key pair, use the ssh- keygen program on a secure UNIX system: ssh-keygen -t rsa -f ~/.ssh/identity ssh-keygen -t rsa -f ~/.ssh/identity  Ssh-keygen asks for a passphrase. It’s better to go for password-less access.  Upload the public key file identity.pub to the PlanetLab website using the Manage My Keys page. Manage My KeysManage My Keys

Getting started with the slice  Initially slice is populated with a minimal Fedora Core 2 Linux installation Fedora Core 2Fedora Core 2  To login to a node with SSH, provide your slice name as the login name (e.g. ufl_ipop), the path to your private key file (e.g. ~/.ssh/identity), and the node to login to (e.g. planetlab1.acis.ufl.edu): ssh -l ufl_ipop -i ~/.ssh/identity planetlab1.acis.ufl.edu ssh -l ufl_ipop -i ~/.ssh/identity planetlab1.acis.ufl.edu  Initially logged in as a regular user with the same name as your slice name. May su to root, add new users, control services, install new packages, mount certain directories, and perform other actions that root is normally capable of.

Populating the Slice  Additional standard packages in the slice, can be installed using yum. For example, to install emacs: yum install emacs yum install emacs  To bring your slice up-to-date with the latest versions of all packages: yum update yum update

Building and Deploying the application  The most straightforward way of deploying your application to a single node is with scp: scp -l ufl_ipop -i ~/.ssh/identity -r test1 planetlab1.acis.ufl.edu scp -l ufl_ipop -i ~/.ssh/identity -r test1 planetlab1.acis.ufl.edu  rsync may be used to copy just those files that do not exist or have changed since the last time they were copied: rsync -a -e "ssh -l ufl_ipop -i ~/.ssh/identity" test1 planetlab1.acis.ufl.edu rsync -a -e "ssh -l ufl_ipop -i ~/.ssh/identity" test1 planetlab1.acis.ufl.edu

PlanetLab Tools

 Parallel SSH Parallel SSH Parallel SSH  PlanetLab Slice Deploy Toolkit PlanetLab Slice Deploy Toolkit PlanetLab Slice Deploy Toolkit  vxargs vxargs  Nixes Tool Set Nixes Tool Set Nixes Tool Set  A complete list of contributed software may be found on the Contributed Software page on the PlanetLab Wiki. Contributed SoftwarePlanetLab WikiContributed SoftwarePlanetLab Wiki

PSSH  Developed at Intel Research, Berkeley  This package provides parallel versions of the openssh tools. Included in the distribution:  Parallel ssh (pssh)  Parallel scp (pscp)  Parallel rsync (prsync)  Parallel nuke (pnuke)  Parallel slurp (pslurp)

PSSH Demo   pssh -h ips.txt -l ufl_ipop -o /tmp/foo hostname   pscp -h hosts.txt -l ufl_ipop foo.txt /home/ufl_ipop/foo.txt   pnuke -h ips.txt -l ufl_ipop java

PlanetLab Slice Deploy Toolkit  The PlanetLab Slice Deploy Toolkit consists of three scripts used to manage slices:  plslice create and manage a slice plslice  pldeploy manage a collection of cogs deployed in a slice pldeploy  pladdnodes example of a script to push a cog to all nodes

vxargs  It provides the parallel versions of any arbitrary command, including ssh, rsync, scp, wget, curl, and whatever  The main features are:  parallelism: run many jobs at the same time  flexibility: arbitrary command with arbitrary options  visualization: monitor the total/per job progress in a curses- based UI  redirection: stdout and stderr of each individual job are redirected to files respectively for further analysis.

Nixes Tool Set  plsetup node-list: bootstraps the slice with yum and gzip  plinstallrpm “rpms” node-list: installs all the rpms on all the nodes  pldeploy node-list: deploys any file structure to the nodes  plcmd command node-list: executes any set of commands on all the nodes.

Additional Resources  For questions regarding application compilation, deployment, and execution, try the PlanetLab Users mailing list PlanetLab Users mailing listPlanetLab Users mailing list  For technical difficulty with a node, with the slice, with the account, or with the website, contact PlanetLab Support PlanetLab SupportPlanetLab Support