MASPLAS ’02 Creating A Virtual Computing Facility Ravi Patchigolla Chris Clarke Lu Marino 8th Annual Mid-Atlantic Student Workshop On Programming Languages.

Slides:



Advertisements
Similar presentations
Hardware Lesson 3 Inside your computer.
Advertisements

Copyright © 2008 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 3: Operating Systems Computer Science: An Overview Tenth Edition.
SLA-Oriented Resource Provisioning for Cloud Computing
2. Computer Clusters for Scalable Parallel Computing
Beowulf Supercomputer System Lee, Jung won CS843.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Introduction to Operating Systems CS-2301 B-term Introduction to Operating Systems CS-2301, System Programming for Non-majors (Slides include materials.
Novell Server Linux vs. windows server 2008 By: Gabe Miller.
IT Infrastructure: Software September 18, LEARNING GOALS Identify the different types of systems software. Explain the main functions of operating.
Computational Steering on the GRID Using a 3D model to Interact with a Large Scale Distributed Simulation in Real-Time Michael.
CompuNet Grid Computing Milena Natanov Keren Kotlovsky Project Supervisor: Zvika Berkovich Lab Chief Engineer: Dr. Ilana David Spring, /
VMware Infrastructure Alex Dementsov Tao Yang Clarkson University Feb 28, 2007.
MCITP: Microsoft Windows Vista Desktop Support - Enterprise Section 1: Prepare to Deploy.
Workload Management Massimo Sgaravatto INFN Padova.
Linux clustering Morris Law, IT Coordinator, Science Faculty, Hong Kong Baptist University.
1 SOFTWARE TECHNOLOGIES BUS Abdou Illia, Spring 2007 (Week 2, Thursday 1/18/2007)
Chapter 2 Introduction to Systems Architecture. Chapter goals Discuss the development of automated computing Describe the general capabilities of a computer.
Operating Systems.
Standard 1 - Objective 2: Understand, evaluate, and use computer software.
Frangipani: A Scalable Distributed File System C. A. Thekkath, T. Mann, and E. K. Lee Systems Research Center Digital Equipment Corporation.
Distributed Systems Early Examples. Projects NOW – a Network Of Workstations University of California, Berkely Terminated about 1997 after demonstrating.
Fundamentals of Networking Discovery 1, Chapter 2 Operating Systems.
About the Presentations The presentations cover the objectives found in the opening of each chapter. All chapter objectives are listed in the beginning.
Report : Zhen Ming Wu 2008 IEEE 9th Grid Computing Conference.
Open Science Grid Software Stack, Virtual Data Toolkit and Interoperability Activities D. Olson, LBNL for the OSG International.
Appendix B Planning a Virtualization Strategy for Exchange Server 2010.
University of Illinois at Urbana-Champaign NCSA Supercluster Administration NT Cluster Group Computing and Communications Division NCSA Avneesh Pant
So, Jung-ki Distributed Computing System LAB School of Computer Science and Engineering Seoul National University Implementation of Package Management.
Copyright © 2011 EMC Corporation. All Rights Reserved. MODULE – 6 VIRTUALIZED DATA CENTER – DESKTOP AND APPLICATION 1.
DISTRIBUTED COMPUTING
Introduction to Interactive Media Interactive Media Tools: Software.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
Chapter 3 Installing Windows XP Professional. Preparing for installation Pre-installation requirement; ◦ Hardware requirements ◦ Hardware compatibility.
MediaGrid Processing Framework 2009 February 19 Jason Danielson.
Grid Technologies  Slide text. What is Grid?  The World Wide Web provides seamless access to information that is stored in many millions of different.
Evaluation of Agent Teamwork High Performance Distributed Computing Middleware. Solomon Lane Agent Teamwork Research Assistant October 2006 – March 2007.
1 SIAC 2000 Program. 2 SIAC 2000 at a Glance AMLunchPMDinner SunCondor MonNOWHPCGlobusClusters TuePVMMPIClustersHPVM WedCondorHPVM.
The Anatomy of the Grid Mahdi Hamzeh Fall 2005 Class Presentation for the Parallel Processing Course. All figures and data are copyrights of their respective.
Laboratório de Instrumentação e Física Experimental de Partículas GRID Activities at LIP Jorge Gomes - (LIP Computer Centre)
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
The II SAS Testbed Site Jan Astalos - Institute of Informatics Slovak Academy of Sciences.
© 2007 UC Regents1 Track 1: Cluster and Grid Computing NBCR Summer Institute Session 1.1: Introduction to Cluster and Grid Computing July 31, 2007 Wilfred.
Tools for collaboration How to share your duck tales…
GRID ARCHITECTURE Chintan O.Patel. CS 551 Fall 2002 Workshop 1 Software Architectures 2 What is Grid ? "...a flexible, secure, coordinated resource- sharing.
Authors: Ronnie Julio Cole David
GVis: Grid-enabled Interactive Visualization State Key Laboratory. of CAD&CG Zhejiang University, Hangzhou
Parts of the computer.
Chapter 2 Introduction to Systems Architecture. Chapter goals Discuss the development of automated computing Describe the general capabilities of a computer.
EVGM081 Multi-Site Virtual Cluster: A User-Oriented, Distributed Deployment and Management Mechanism for Grid Computing Environments Takahiro Hirofuchi,
Operating Systems Objective n The historic background n What the OS means? n Characteristics and types of OS n General Concept of Computer System.
Campus grids: e-Infrastructure within a University Mike Mineter National e-Science Centre 14 February 2006.
HepNT - January 15, 1997 : PCSF Frederic Hemmer IT/PDP 1 PCSF - A Pentium ® /Windows NT ® Based simulation farm Frederic Hemmer CERN IT/PDP.
1 Grid Activity Summary » Grid Testbed » CFD Application » Virtualization » Information Grid » Grid CA.
Economic and On Demand Brain Activity Analysis on Global Grids A case study.
Globus and PlanetLab Resource Management Solutions Compared M. Ripeanu, M. Bowman, J. Chase, I. Foster, M. Milenkovic Presented by Dionysis Logothetis.
A.Abhari CPS1251 Topic 1: Introduction to Computers Computer Hardware Computer components Connecting Computers Computer Software Operating System (OS)
Tool Integration with Data and Computation Grid “Grid Wizard 2”
BMTS 242: Computer and Systems Lecture 2: Memory, and Software Yousef Alharbi Website
5 th October 2004Hardware – KS41 Hardware Objectives: Computer systems  What do they do?  Identify the hardware that makes up a computer system (PC)
Advanced Network Administration Computer Clusters.
Integrating Scientific Tools and Web Portals
Matt Lemons Nate Mayotte
Clouds , Grids and Clusters
SOFTWARE TECHNOLOGIES
PROOF – Parallel ROOT Facility
University of Technology
NCSA Supercluster Administration
IT Infrastructure: Software
Support for ”interactive batch”
Presentation transcript:

MASPLAS ’02 Creating A Virtual Computing Facility Ravi Patchigolla Chris Clarke Lu Marino 8th Annual Mid-Atlantic Student Workshop On Programming Languages And Systems

The Virtual Pool Concept Resources’ locations are transparent A user is allocated requested services based on availability by an Agent Execution Transparency User jobs are executed on whichever nodes are available within the pool FOR MORE INFO... R Figueiredo, N Kapadia, J Fortes, The PUNCH Virtual File System: Seamless Access to Decentralized Storage Services in A Computational Grid. 10 th IEEE International Symposium on High Performance Computing Aug01.

Virtual Machines and Time Shares Virtual Reality Vehicular Simulators Remote Viewing TeleImmersion TeleOperation

Virtual Terminals Remote Session Telnet TTY VT100

Commodity PC prices have dropped dramatically over the years due to innovations in Chip fabrication Technology Clustered Commodity PC can achieve GigaFlop performance Network Component Prices as well as Networking technology are following on the heels of the Commodity PC

Open Source Software Is “Pervasive” Linux is freeware Security software Academic projects Open Source projects

Create a Beowulf Style Cluster Document and Benchmark Create a Virtual Pool of Win32 Machines Run Some Parallel Simulation software Test CONDOR on Win32 Machines Test The Job Management Capabilities on Win32

SWITCH LynkSys 8 port 10/100 Mbs SWITCH LynkSys 8 port 10/100 Mbs Master / Node PII 266 MHz 64 Meg SDRAM 4Gb Harddisk Generic VGA Princeton E015 Floppy Disk CD Rom Drive Linux OS 10 Mbps NIC + 10/100Mbps NIC Master / Node PII 266 MHz 64 Meg SDRAM 4Gb Harddisk Generic VGA Princeton E015 Floppy Disk CD Rom Drive Linux OS 10 Mbps NIC + 10/100Mbps NIC Node PII 266 MHz 64 Meg RAM 4Gb Harddisk Generic VGA Princeton E015 Floppy Disk CD Rom Drive Linux OS 10 MB NIC Node PII 266 MHz 64 Meg RAM 4Gb Harddisk Generic VGA Princeton E015 Floppy Disk CD Rom Drive Linux OS 10 MB NIC Node PII 266 MHz 64 Meg SDRAM 4Gb Harddisk Generic VGA Princeton E015 Floppy Disk CD Rom Drive Linux OS 10 MB NIC Node PII 266 MHz 64 Meg SDRAM 4Gb Harddisk Generic VGA Princeton E015 Floppy Disk CD Rom Drive Linux OS 10 MB NIC Node PII 166 MHz 32 Meg SDRAM 2Gb Harddisk Generic VGA Princeton E015 Floppy Disk CD Rom Drive Linux OS 10 MB NIC Node PII 166 MHz 32 Meg SDRAM 2Gb Harddisk Generic VGA Princeton E015 Floppy Disk CD Rom Drive Linux OS 10 MB NIC penguin

BASELINE Run 1 Run 2 Run 3 Run 4 Average PII 586/166Mhz s s s s PII 686/ s s78.72 Test 1 (2 Computer Net) Run 1 Run 2 Run 3 Run 4 Average PII 266/266 Mhz (N1/N2) s69.30 s69.40 s70.10 s69.87 PII 166/266 Mhz (N3/N2) s s s s Test 2 (3 Computer Net) Run 1 Run 2 Run 3 Run 4 Average PII 266/266/266 Mhz (N1/N2/N4) s63.42 s62.69 s62.27 s62.69 Test 3 (4 Computer Net) Run 1 Run 2 Run 3 Run 4 Average PII 166/266/266/266 Mhz (N3/N1/N2/N4) s34.72 s32.97 s31.81 s32.84

Load the Charm daemon to create pool Launch the Simulator NAMD with varying workload and processor requests View the simulation with VMD Record the CPU Usage on the affected machines

The PUNCH Virtual File System: Seamless Access to Decentralized Storage Services in A Computational Grid. R Figueiredo, N Kapadia, J Fortes, The PUNCH Virtual File System: Seamless Access to Decentralized Storage Services in A Computational Grid. 10 th IEEE International Symposium on High Performance Computing Aug01. The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann Publishers, I. Foster and C. Kesselman, editors. The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann Publishers, Cluster In A Box: OSCAR Feb02. OSCAR version Cluster In A Box: OSCAR Feb02. OSCAR version is a snapshot of the best known methods for building, programming, and using clusters. It consists of a fully integrated and easy to install software bundle designed for high performance cluster computing. Condor: the goal of the Condor Project Condor: the goal of the Condor Project is to develop, implement, deploy, and evaluate mechanisms and policies that support High Throughput Computing (HTC) on large collections of distributively owned computing resources. Throughput Computing (HTC) Globus Toolkit: The Globus Project Globus Toolkit: The Globus Project is developing fundamental technologies needed to build computational grids. Grids are persistent environments that enable software applications to integrate instruments, displays, computational and information resources that are managed by diverse organizations in widespread locations.computational grids NAMD NAMD is a parallel, object-oriented molecular dynamics code designed for high-performance simulation of large biomolecular systems. NAMD scales to hundreds of processors on high-end parallel platforms and tens of processors on commodity clusters using switched fast ethernet. VMD VMD is a molecular visualization program for displaying, animating, and analyzing large biomolecular systems using 3-D graphics and built-in scripting. VMD supports computers running MacOS-X, Unix, or Windows, is distributed free of charge, and includes source code.