1 Bio Applications Virtualization using Rocks Nadya Williams UCSD.

Slides:



Advertisements
Similar presentations
/ 1 N. Williams Grid Middleware Experiences Nadya Williams OCI Grid Computing, University of Zurich
Advertisements

Motivation 1.Application resources setup – make it easy 2.Transform PRAGMA grid – add on demand –Continue using Grid resources –Add cloud resources Current.
Resource WG Summary Mason Katz, Yoshio Tanaka. Next generation resources on PRAGMA Status – Next generation resource (VM-based) in PRAGMA by UCSD (proof.
Wei Lu 1, Kate Keahey 2, Tim Freeman 2, Frank Siebenlist 2 1 Indiana University, 2 Argonne National Lab
Fabric Management at CERN BT July 16 th 2002 CERN.ch.
2  Industry trends and challenges  Windows Server 2012: Beyond virtualization  Complete virtualization platform  Improved scalability and performance.
1 Applications Virtualization in VPC Nadya Williams UCSD.
VC Deployment Script for OpenNebula/KVM Yoshio Tanaka, Akihiko Ota (AIST)
Deployment Adavatages Provisioning time reduced to minutes, not days to weeks! Configure hardware Install OS Configure OS & Tools Assign IP Addr Configure.
Dan Stolts Chief Technology Strategist Microsoft Corporation Blog: Managing and Monitoring Critical Infrastructure.
VMWare to Hyper-V FOR SERVER What we looked at before migration  Performance – Hyper-V performs at near native speeds.  OS Compatibility – Hyper-V.
Xrootd and clouds Doug Benjamin Duke University. Introduction Cloud computing is here to stay – likely more than just Hype (Gartner Research Hype Cycle.
PRAGMA19, Sep. 15 Resources breakout Migration from Globus-based Grid to Cloud Mason Katz, Yoshio Tanaka.
Quick Overview of NPACI Rocks Philip M. Papadopoulos Associate Director, Distributed Computing San Diego Supercomputer Center.
© UC Regents 2010 Extending Rocks Clusters into Amazon EC2 Using Condor Philip Papadopoulos, Ph.D University of California, San Diego San Diego Supercomputer.
Automating SQL Buildouts With Hyper-V and SQL Server 2008 R2 Robert L Davis, Sr. DBA, Microsoft Corp.
VIRTUALISATION OF HADOOP CLUSTERS Dr G Sudha Sadasivam Assistant Professor Department of CSE PSGCT.
System Center 2012 Setup The components of system center App Controller Data Protection Manager Operations Manager Orchestrator Service.
Virtualization Infrastructure Administration Hyper-V 2012 R2 Jakub Yaghob.
Rocks cluster : a cluster oriented linux distribution or how to install a computer cluster in a day.
SYN407D: Image Management made easy with Provisioning Services 6.0
Building service testbeds on FIRE D5.2.5 Virtual Cluster on Federated Cloud Demonstration Kit August 2012 Version 1.0 Copyright © 2012 CESGA. All rights.
Windows Azure Conference 2014 Running Docker on Windows Azure.
Managing Your Datacenter with Microsoft System Center Configuration Manager Kent Agerlund, ECM MVP, Coretech.
PRAGMA20 – PRAGMA 21 Collaborative Activities Resources Working Group.
Hands-On Virtual Computing
Personal Cloud Controller (PCC) Yuan Luo 1, Shava Smallen 2, Beth Plale 1, Philip Papadopoulos 2 1 School of Informatics and Computing, Indiana University.
So, Jung-ki Distributed Computing System LAB School of Computer Science and Engineering Seoul National University Implementation of Package Management.
Rocks ‘n’ Rolls An Introduction to Programming Clusters using Rocks © 2008 UC Regents Anoop Rajendra.
1.  PRAGMA Grid test-bed : Shares clusters which managed by multiple sites Realizes a large-scale computational environment. › Expects as a platform.
Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Hosted by CNIC, CAS Beijing, China Oct 16-18, 2013.
การติดตั้งและทดสอบการทำคลัสเต อร์เสมือนบน Xen, ROCKS, และไท ยกริด Roll Implementation of Virtualization Clusters based on Xen, ROCKS, and ThaiGrid Roll.
Resource WG PRAGMA 18 Mason Katz, Yoshio Tanaka.
Simplifying Resource Sharing in Voluntary Grid Computing with the Grid Appliance David Wolinsky Renato Figueiredo ACIS Lab University of Florida.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
© 2007 UC Regents1 Track 1: Cluster and Grid Computing NBCR Summer Institute Session 1.1: Introduction to Cluster and Grid Computing July 31, 2007 Wilfred.
Nara Institute of Science and technology, Nara Prefecture, Japan CONFIGURATION AND DEPLOYMENT OF A SCALABLE VIRTUAL MACHINE CLUSTER FOR MOLECULAR DOCKING.
EVGM081 Multi-Site Virtual Cluster: A User-Oriented, Distributed Deployment and Management Mechanism for Grid Computing Environments Takahiro Hirofuchi,
Module 4 Planning for Group Policy. Module Overview Planning Group Policy Application Planning Group Policy Processing Planning the Management of Group.
Week #2 Objectives Upgrade and Migrating to Windows 7 Image-Based Installation of Windows 7 Application Compatibility.
Virtualization Infrastructure Administration Virtual machine Jakub Yaghob.
GLIDEINWMS - PARAG MHASHILKAR Department Meeting, August 07, 2013.
1 Grid Activity Summary » Grid Testbed » CFD Application » Virtualization » Information Grid » Grid CA.
Nara Institute of Science and Technology, Nara Prefecture, Japan CONFIGURATION AND DEPLOYMENT OF A SCALABLE VIRTUAL MACHINE CLUSTER FOR MOLECULAR DOCKING.
20409A 7: Installing and Configuring System Center 2012 R2 Virtual Machine Manager Module 7 Installing and Configuring System Center 2012 R2 Virtual.
Application Programming in Cloud via Swift Swift Tutorial, CCGrid 2013, Hour 2 Ketan Maheshwari.
Tool Integration with Data and Computation Grid “Grid Wizard 2”
Grid testing using virtual machines Stephen Childs*, Brian Coghlan, David O'Callaghan, Geoff Quigley, John Walsh Department of Computer Science Trinity.
Microsoft Virtual Academy Module 12 Managing Services with VMM and App Controller.
PRAGMA 25 Working Group Updates Resources Working Group Yoshio Tanaka (AIST) Phil Papadopoulos (UCSD) Most slides by courtesy of Peter, Nadya, Luca, and.
Improving the Research Bootstrap of Condor High Throughput Computing for Non-Cluster Experts Based on Knoppix Instant Computing Technology RIKEN Genomic.
Aimee Stewart (KU) Nadya Williams (UCSD) 1.
Nara Institute of Science and Technology, Nara Prefecture, Japan CONFIGURATION AND DEPLOYMENT OF A SCALABLE VIRTUAL MACHINE CLUSTER FOR MOLECULAR DOCKING.
Information Initiative Center, Hokkaido University North 11, West 5, Sapporo , Japan Tel, Fax: General.
Microsoft Virtual Academy. Microsoft Virtual Academy First HalfSecond Half (01) Introduction to Microsoft Virtualization(05) Hyper-V Management (02) Hyper-V.
UFIT Infrastructure Self-Service. Service Offerings And Changes Virtual Machine Hosting Self service portal Virtual Machine Backups Virtual Machine Snapshots.
11 DEPLOYING AN UPDATE MANAGEMENT INFRASTRUCTURE Chapter 6.
Intro To Virtualization Mohammed Morsi
 Session Objectives:  Understand how to upgrade your private cloud: Windows Server 2008 R2  Windows Server 2012 R2 Windows Server 2012  Windows.
Puppet and Cobbler for the configuration of multiple grid sites
Building AD-SQL-APP Server on AZURE
Use of HLT farm and Clouds in ALICE
Installation and Integration of Virtual Clusters onto Pragma Grid
MCSA VCE
100% Exam Passing Guarantee & Money Back Assurance
OPNFV Arno Installation & Validation Walk-Through
20409A 7: Installing and Configuring System Center 2012 R2 Virtual Machine Manager Module 7 Installing and Configuring System Center 2012 R2 Virtual.
Microsoft Virtual Academy
Managing Services with VMM and App Controller
High Performance Computing and TupleSpaces
Presentation transcript:

1 Bio Applications Virtualization using Rocks Nadya Williams UCSD

2 VM Rocks frontend Opal toolkit Job Scheduler (SGE) Applications VM configuration key parts all networking all networking all services all services configuration configuration master master working nodes working nodes configuration configuration app deployment app deployment

3 VM reconfiguration Autodock Vina MGL tools: autodock autogrid) Receptor transformation Gromos clustering PDB2PQR OPAL toolkit Updated VM Rocks VM configuration Applications Applications

4 One host as an example: rocsk- 214.sdsc.edu

5 VM creation and deployment process # rocks add cluster fqdn=$FQDN ip=$IP num-computes=0 fe- name=$NAME # rocks create keys key=private.key passphrase=no > public.key # rocks set host power $NAME action=install key=private.key # rocks open host console $NAME key=private.key Install frontend and desired rolls Shutdown VM Copy VM disk to shared area (gfarm) Create a VM with desired applications: original site /opt/vm-scripts/local-vc-deploy bioapp5 1 /vm-images Deploy VM: hosting site # /root/vm/VMreconfig # reboot Start running applications on a new host Reconfiure VM: hosting site Run one time Run one time Run many times Run many times

6 How we can use VM Single frontend VM VM cluster EC2 VM EC2 cluster Clone VM Create VM Deploy and Reconfigure VM

7 Lessons learned Focus on minimizing time to uptime through easy automatic VM setup Simplification, Unification and Automation of the VM creation (tight integration with Rocks environment) Easy automated reconfiguration Easy automated deployment into existing environment Guarantee reproducibility Interoperability Create VM anywhere – deploy anywhere. Works now with Rocks. Get missing features by creating bridges between different Virtualizations Future work Extend to VM cluster deployment Extend to EC2 deployment Convert Xen VM image into KVM

8 Historical Lessons … Inscription on an ancient Jade plate Pang made this treasured vessel. May it be used and treasured by my descendents for years.