Testing Virtual Machine Performance Running ATLAS Software Yushu Yao Paolo Calafiura LBNL April 15, 2008 1.

Slides:



Advertisements
Similar presentations
Basic Computer Vocabulary
Advertisements

Google chrome operating system For Tiwi island college Lachlan Doyle.
UNIX System Programming Installing OpenSolaris. 2/86 Contents How to setup a virtual machine guest How to install OpenSolaris as a guest How to update.
VMWare to Hyper-V FOR SERVER What we looked at before migration  Performance – Hyper-V performs at near native speeds.  OS Compatibility – Hyper-V.
Click Here to Begin. Objectives Purchasing a PC can be a difficult process full of complex questions. This Computer Based Training Module will walk you.
Virtual Machines Measure Up John Staton Karsten Steinhaeuser University of Notre Dame December 15, 2005 Graduate Operating Systems, Fall 2005 Final Project.
Virtual Machines for HPC Paul Lu, Cam Macdonell Dept of Computing Science.
Hosted VMM Architecture Advantages: –Installs and runs like an application –Portable – host OS does I/O access –Coexists with applications running on.
MapR – HADOOP DEVELOPMENT IN A VIRTUAL MACHINE Thomas Tiahrt, MA, PhD CSC482 Introduction to Text Analytics.
A Brief Introduction To Virtualization Technologies Yin Yunqiao HP.
VMWare Workstation Installation. Starting Vmware Workstation Go to the start menu and start the VMware Workstation program. *Note: The following instructions.
Cap 333 Network Administration. Grades  20 marks distributed on  Assignments / Project Activities Individual Pairs  1 or 2 tutorial quizzes.
© 2012 The McGraw-Hill Companies, Inc. All rights reserved. 1 Third Edition Chapter 3 Desktop Virtualization McGraw-Hill.
Test results Test definition (1) Istituto Nazionale di Fisica Nucleare, Sezione di Roma; (2) Istituto Nazionale di Fisica Nucleare, Sezione di Bologna.
To run the program: To run the program: You need the OS: You need the OS:
Red Hat Installation. Installing Red Hat Linux is the process of copying operating system files from a CD, DVD, or USB flash drive to hard disk(s) on.
Welcome! Computer 101 Session 2 With Laura Crichton.
Space Science and Engineering Center University of Wisconsin-Madison Virtual Machines: A method for distributing DB processing software Liam Gumley.
Virtualization and Open source Software Mr. Lau Ka Lun – Lai King Catholic Secondary School Date: 9 th, 21 st, 22 nd March, 2011.
Using Virtualization in the Classroom. Using Virtualization in the Classroom Session Objectives Define virtualization Compare major virtualization programs.
Tanenbaum 8.3 See references
Operating System Virtualization
About the Presentations The presentations cover the objectives found in the opening of each chapter. All chapter objectives are listed in the beginning.
An Introduction to Xen Prof. Chih-Hung Wu
CERN IT Department CH-1211 Genève 23 Switzerland t Virtualization with Windows at CERN Juraj Sucik, Emmanuel Ormancey Internet Services Group.
Excellence Publication Co. Ltd. Volume Volume 1.
Hands-On Virtual Computing
Virtualization. ABCs Special software: hypervisors or virtual machine managers Guest OS (virtual machine) sits on top of host OS (Win 7 in our case) We.
Cap 333 Network Administration. Solution Rules  Your solution must be typed by computer. Otherwise, it will not be accepted.  If the question is a project.
Using Virtualization in the Classroom. Using Virtualization in the Classroom Session Objectives Define virtualization Compare major virtualization programs.
VirtualBox What you need to know to build a Virtual Machine.
F. Brasolin / A. De Salvo – The ATLAS benchmark suite – May, Benchmarking ATLAS applications Franco Brasolin - INFN Bologna - Alessandro.
Manchester HEP Desktop/ Laptop 30 Desktop running RH Laptop Windows XP & RH OS X Home server AFS using openafs 3 DB servers Kerberos 4 we will move.
Cap 333 Network Administration. Grades  20 marks distributed on  Assignments / Project Activities Individual Pairs  1 or 2 tutorial quizzes.
NA61/NA49 virtualisation: status and plans Dag Toppe Larsen CERN
1 Copyright © 2015 Pexus LLC Patriot PS Personal Server Importing Virtual Appliance Image.
© 2015 by McGraw-Hill Education. This proprietary material solely for authorized instructor use. Not authorized for sale or distribution in any manner.
Virtualization One computer can do the job of multiple computers, by sharing the resources of a single computer across multiple environments. Turning hardware.
Virtual Machines. A virtual machine takes the layered approach to its logical conclusion. It treats hardware and the operating system kernel as though.
Predrag Buncic (CERN/PH-SFT) Software Packaging: Can Virtualization help?
36 th LHCb Software Week Pere Mato/CERN.  Provide a complete, portable and easy to configure user environment for developing and running LHC data analysis.
GCSE Computing: A451 Computer Systems & Programming Topic 3 Software System Software (1) The Operating System.
Virtual Server Server Self Service Center (S3C) JI July.
Hyukjin Kwon ESLAB SKKU Increasing memory density by using KSM.
The Future With Windows XP Microsoft announced that after April 16, 2014 it will not longer support Windows XP. No statement on continued inclusion of.
System Software (1) The Operating System
Virtual PC 2007 Virtualization for Fermi Desktops KTF
Predrag Buncic (CERN/PH-SFT) Virtualization R&D (WP9) Status Report.
Virtualisation Exercise Installing VirtualBox Installing FreeBSD in a virtual machine Chris Wilson Joel Jaeggli AfNOG 2012.
1 COP 4343 Unix System Administration Unit 1: –Linux OS structure –Distributions –Hardware inventory –Disks and partitions –Installation steps –Boot loader.
Virtualization - an introduction Gordon Ross Computing Service.
VirtualBox Introduction:
Using Virtualization in the Classroom
Different Operating Systems
CSC227: Operating Systems
Chapter 1: Introduction
Matt Lemons Nate Mayotte
Desktop Virtualization
Getting More Done on Linux
Chapter 1: Introduction
Chapter 1: Introduction
CernVM Status Report Predrag Buncic (CERN/PH-SFT).
Virtual Machines.
Different Operating Systems
Virtual Operating Systems
Virtualization.
Windows Virtual PC / Hyper-V
Subject Name: Operating System Concepts Subject Number:
Chapter 1: Introduction
Hypervisor A hypervisor or virtual machine monitor (VMM) is computer software, firmware or hardware that creates and runs virtual machines. A computer.
Presentation transcript:

Testing Virtual Machine Performance Running ATLAS Software Yushu Yao Paolo Calafiura LBNL April 15,

Objectives We run bench tests and common ATLAS tasks on Virtual machines to test their performance and compare them with running them in LXPLUS. Hoping to give an impression to the audiences how well virtual machines work, and to provide some reference for the CERN VM developers. Common ATLAS tasks include: –Compiling Packages, using CMT, etc. –Running jobs (simulation, reconstruction, etc.) Virtual Machines include: –Windows: Vmware, Qemu –MacOS: Vmware, Qemu VMWARE is tested since it is the most popular one. FREE player for Linux and Windows, $60 for Mac. QEMU is especially attractive because it is FREE for Linux, Windows and Mac. Note: For Linux Hosts results and Parallel for Mac results, please refer to later talks of today. 2

Host Machine Tests are done on my laptop, since most users are likely to use virtual machines for development / analysis on their laptops or desktops. Hardware: 15’’ Mac Book Pro –CPU: 2.2 GHz Intel Core 2 Duo –Memory: 2 GB 677 MHz DDR2 –HD: TOSHIBA MK2035GSS (200 G) Software: Running dual system via rEFIt. –Mac OS X VMWARE Fusion 1.1 / QEMU –Windows XP SP2 VMWARE Workstation/ QEMU

Virtual (Guest) Machine Setup The following cpu and memory allocation are used for the guest machine, to maximum the performance of the guest machine while ensure acceptable performance of the host machine (Let you read s or surf the web, even running eclipse). –Single CPU –1 G Memory Virtual machines use disk images as virtual disks. For portability, hard disk image type vmdk is used in this test. 4

Virtual Machine Setup (cont.) /dev/hda –Scientific Linux 3 Gcc 323 Kernel /dev/hdb –ATLAS Release (downloaded by pacman) /dev/hdc –Working Disk 5

The Tests CPU Benchmark - nBench –Run CPU/Memory intensive jobs like sorting, FFT, etc. ATLAS specific tests –Compiling Test Compile four ATLAS packages –ATLAS Jobs A combination of event generation, simulation, digitalization, reconstruction and analysis. For results go to next page-> 6

CPU Performance (nBench) Results show the ratio = (Average Score Given by nBench in a VM) / (Average Score Given by LXPLUS) 20-30% difference between Native Mac and VMWARE. Mac Vmware is slighter better than Windows Vmware. QEMU is very slow, unfortunately. (One hope: a kernel acceleration kqemu is available, but not for mac) Note that the LXPLUS run is testing a specific LXPLUS node (lxplus212), while all other runs are testing my MacBook Pro. 7

ATLAS Job Performance Results show the ratio = (the time to run the test on a VM) / (the time to run the test on LXPLUS) Compiling is about half the speed of LXPLUS in VMWARE. The ATLAS full chain tests take 20% more time in Mac Vmware and 45% more time in Windows Vmware. Compiling in QEMU is 20 times slower. Chain tests crash in QEMU. 8

Summary QEMU is slow. We need to figure out why QEMU is slow, and try to find solution for that. If no solution found, we will have to walk away from it. For development / analysis, performance of VMWARE is acceptable. Comparing to LXPLUS. 9

One Possible Way to Distribute ATLAS VM Is it better if the user can download the whole atlas software release (e.g ) as a virtual disk? (Instead of using pacman) User download the desired OS volumes and Software Release volumes. User choose which to use in a User Interface (GUI). The GUI plugs the proper volumes into the VM. Using either IDE (/dev/hda, …) or SCSI (/dev/sda, …) Optional: In case different initialization need to be done for different software releases, the GUI can pass these information to the VM through a “Setup Info” disk (could be virtual floppy, usb, network, etc) User Interface Virtual Machine SLC3 SLC4 ATLAS ATLAS One OS Volume One or more ATLAS SW Volume WORK One or more Working Volume SETUP INFO 10