Its potential for Grid and Cloud Computing Tan Tin Wee Dept of Biochemistry Yong Loo Lin School of Medicine National University of Singapore.

Slides:



Advertisements
Similar presentations
SUS Feature Pack for SMS Michel Jouvin LAL / IN2P3
Advertisements

Kyle Thurow, Kyle Neuschaefer, Alexander Matusiak, and Justin Carroll.
Server 2012 R2 Essentials - What’s new ? Bart #techninebe Technine Group.
Futures – Alpha Cloud Deployment and Application Management.
Windows Deployment Services WDS for Large Scale Enterprises and Small IT Shops Presented By: Ryan Drown Systems Administrator for Krannert.
1 31 August, 2007 ICSY Lab, University of Kaiserslautern, Germany A File System Service for the Venice Service Grid 33 rd Euromicro 28-31August 2007 Lübeck,
BioSlax – Live Media Operating System. Copyright ⓒ National University of Singapore. All rights reserved. What is BioSlax? Slackware Linux on a.
The Cactus Portal A Case Study in Grid Portal Development Michael Paul Russell Dept of Computer Science The University of Chicago
Cs238 Lecture 3 Operating System Structures Dr. Alan R. Davis.
Matt Bertrand Building GIS Apps in the Cloud. Infrastructure - Provides computer infrastructure, typically a platform virtualization environment, as a.
Company LOGO Development of Resource/Commander Agents For AgentTeamwork Grid Computing Middleware Funded By Prepared By Enoch Mak Spring 2005.
I Information Systems Technology Ross Malaga 3 "Part I Understanding Information Systems Technology" Copyright © 2005 Prentice Hall, Inc. 3-1 SOFTWARE.
Microsoft ® Application Virtualization 4.5 Infrastructure Planning and Design Series.
UFCFX5-15-3Mobile Device Development Android Development Environments and Windows.
Understanding and Managing WebSphere V5
Google AppEngine. Google App Engine enables you to build and host web apps on the same systems that power Google applications. App Engine offers fast.
Using BioSlax and the BioSlax Server Tin Wee Tan National University of Singapore.
Utility Computing Casey Rathbone 1http://cyberaide.org.edu.
Chapter 10 – UNIX. History In late 1960s, two employees of Bell Labs (Ken Thompson & Dennis Ritchie) designed a new operating system to overcome the constraints.
Cloud computing is the use of computing resources (hardware and software) that are delivered as a service over the Internet. Cloud is the metaphor for.
Customized cloud platform for computing on your terms !
Building service testbeds on FIRE D5.2.5 Virtual Cluster on Federated Cloud Demonstration Kit August 2012 Version 1.0 Copyright © 2012 CESGA. All rights.
Windows Azure Conference 2014 Running Docker on Windows Azure.
A CCELERATING E VOLUTIONARY M OLECULAR P HYLOGENETIC ANALYSES ON THE NUS TCG G RID Hu Yongli Department of Biochemistry, Yong Loo Lin School of Medicine.
A Cloud is a type of parallel and distributed system consisting of a collection of inter- connected and virtualized computers that are dynamically provisioned.
Promoting Open Source Software Through Cloud Deployment: Library à la Carte, Heroku, and OSU Michael B. Klein Digital Applications Librarian
Cloud Computing & Amazon Web Services – EC2 Arpita Patel Software Engineer.
Chapter 34 Java Technology for Active Web Documents methods used to provide continuous Web updates to browser – Server push – Active documents.
BioSLAX Live Systems Tan Tin Wee Mark De Silva Lim Kuan Siong.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks perfSONAR deployment over Spanish LHC Tier.
Scott Drucker, Systems Engineer Migrating to Microsoft Vista with WinINSTALL.
Conversing in the Cloud Ryan Kupfer, Scott Wetter, Bryan Welfel, Shekhar Pradhan.
APGrid Core Meeting Phuket Asia Pacific BioGRID initiative A/P Tan Tin Wee, Mark De Silva, Lim Kuan Siong – Bioinformatics Centre, National Univ.
Styx Grid Services: Lightweight, easy-to-use middleware for e-Science Jon Blower Keith Haines Reading e-Science Centre, ESSC, University of Reading, RG6.
CERN-PH-SFT-SPI August Ernesto Rivera Contents Context Automation Results To Do…
The BioBox Initiative: Bio-ClusterGrid Maddie Wong Technical Marketing Engineer Sun APSTC – Asia Pacific Science & Technology Center.
10/8: Software What is software? –Types of software System software: Operating systems Applications Creating software –Evolution of software development.
Experiment Management System CSE 423 Aaron Kloc Jordan Harstad Robert Sorensen Robert Trevino Nicolas Tjioe Status Report Presentation Industry Mentor:
Introducing Virtualization via an OpenStack “Cloud” System to SUNY Orange Applied Technology Students SUNY Innovative Instruction Technology Grant Christopher.
PerfSONAR-PS Functionality February 11 th 2010, APAN 29 – perfSONAR Workshop Jeff Boote, Assistant Director R&D.
The Asian Bioinformation Center (ABC) Initiative Presenter: Rohit Reja, ABC Project Secretariat (on behalf of Dr. Tan Tin Wee, NUS, Singapore)
Multi-Tier Apps with Admin Access, RDP, Custom Installs Modern Scalable Web Sites Full Windows Server/Linux VMs Web Sites Virtual Machines Cloud Services.
Web Technologies Lecture 13 Introduction to cloud computing.
11 Computers, C#, XNA, and You Session 1.1. Session Overview  Find out what computers are all about ...and what makes a great programmer  Discover.
Bioinformatics Applications on and APBioGrid ONG Guan SinTAN Chee Chiang Grid EvangelistManager, Computer Centre Singapore Computer Sys LtdNational.
PROGRESS: GEW'2003 Using Resources of Multiple Grids with the Grid Service Provider Michał Kosiedowski.
APBioKnoppix Bioinformatics software in one CD Justin Choo*, Ong Guan Sin, Tan Tin Wee National University of Singapore.
XAMPP.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI UMD Roadmap Steven Newhouse 14/09/2010.
System Center 2012 Configuration Manager Service Pack 1 Overview.
The LGI Pilot job portal EGI Technical Forum 20 September 2011 Jan Just Keijser Willem van Engen Mark Somers.
Google. Android What is Android ? -Android is Linux Based OS -Designed for use on cell phones, e-readers, tablet PCs. -Android provides easy access to.
Mobile Device Development
Unit 3 Virtualization.
Containers as a Service with Docker to Extend an Open Platform
Introduction to VMware Virtualization
Dag Toppe Larsen UiB/CERN CERN,
Dag Toppe Larsen UiB/CERN CERN,
Quattor in Amazon Cloud
Platform as a Service.
Tools and Services Workshop Overview of Atmosphere
MIK 2.1 DBNS - introduction to WS-PGRADE, 2013
Amazon Web Services as a team project platform
Grid Means Business OGF-20, Manchester, May 2007
Module 01 ETICS Overview ETICS Online Tutorials
Cloud computing mechanisms
Ivan Reid (Brunel University London/CMS)
An introduction to the Linux environment v
Different types of Linux installation
SCCM in hybrid world Predrag Jelesijević Microsoft 7/6/ :17 AM
Presentation transcript:

its potential for Grid and Cloud Computing Tan Tin Wee Dept of Biochemistry Yong Loo Lin School of Medicine National University of Singapore

Merging two trajectories LiveCD/DVD/USB/VM eScience and Grid Computing APBioGrid : Globus Grid 1.1.6/7 – Ong Guan Sin (2002) APBioBox 1 and 2 with Sun’s BioClusterGrid/BioBox and KOOPLite workflow integration APBioKnoppix 1 and 2 LiveCD - Derek Kiong, Justin Choo ( ) BioSlax LiveCD - Mark de Silva and Lim Kuan Siong ( ) BioSlax LiveDVD, LiveUSB, VMplayer ( ) BioSlax Server ( ) BioSlax7.5-VMplayer-MokaFive (2009) UDBlast-BioSlax-VMplayer-MokaFive (2009) SINGAREN (1998) Telemanufacturing, eScience, remote control of Synchrotron beam line ( ) NUS BioGrid and APBioGrid ( ) National Grid and LSVGC database ( ) BioManufacturing Grid (SERC Proof of Concept for Integrated Manufacturing and Services Systems (IMSS) grant) ( ) - KOOPrime’s KOOPlatform - SIMTech and NTU - APSTC Sun Microsystems TeraCampus Grid ( ) 1 st World Wide Workflow Grid - Chris Baker (2008)

NUS BioGrid and APBioGrid

APBioBox

National Grid Office and LS VGC

APBioKnoppix ( ) Bioinformatics in a LiveCD Used by 500 NUS students a year in Life Science Module LSM2104 from 2004 to 2007

Integrated Biolaboratory Manufacturing and Services System A TSRP pilot project Group 9 Project Integrated Manufacturing and Services Systems (IMSS) For acceleration of specific areas of manufacturing, in particular biomanufacturing. www2.jp.apan.net/meetings/bangkok2005/presentation/tantinwee-APAN19-eScienceBKKJan05.ppt

1st WWWFG

TeraCampusGrid

Grid Apps on Grid svu/services/gridapps.htm

UDBlast at

Merged two trajectories LiveCD/DVD/USB/VM eScience and Grid Computing APBioGrid : Globus Grid 1.1.6/7 – Ong Guan Sin (2002) APBioBox 1 and 2 with Sun’s BioClusterGrid/BioBox and KOOPLite workflow integration APBioKnoppix 1 and 2 LiveCD - Derek Kiong, Justin Choo ( ) BioSlax LiveCD - Mark de Silva and Lim Kuan Siong ( ) BioSlax LiveDVD, LiveUSB, VMplayer ( ) BioSlax Server ( ) BioSlax7.5-VMplayer-MokaFive (2009) UDBlast-BioSlax-VMplayer-MokaFive (2009) SINGAREN (1998) Telemanufacturing, eScience, remote control of Synchrotron beam line ( ) NUS BioGrid and APBioGrid ( ) National Grid and LSVGC database ( ) BioManufacturing Grid (SERC Proof of Concept for Integrated Manufacturing and Services Systems (IMSS) grant) ( ) - KOOPrime’s KOOPlatform - SIMTech and NTU - APSTC Sun Microsystems TeraCampus Grid ( ) 1 st World Wide Workflow Grid - Chris Baker (2008) Moka5+VMWare+BioSlax On

( )

BioSlax with VMplayer Bioinformatics software in a virtual machine Packages Applications Programming languages – C, perl, python etc GUI interfaces Servers – apache, mysql No need to reboot, just install VMplayer, run BioSlax vmx file and create a new instance of a BioSlax virtual machine

Rapid and Easy Customisable Interface

Addable Modules Modules e.g. newmodule.lzm Stored in /mnt/sda1/modules Activated during boot up Compile –> dir2lzm -> copy into virtual HDD /mnt/sda1/module

Persistent Changes changes=/mnt/sda1/changes To change the boot up sequence for starting any program Add /etc/rc.d/rc.newprog

BioSlax 7.5 Bootable with changes LiveCD, LiveDVD, LiveUSB BioSlax-VMplayer version MokaFive version portable on Intel Machines What has it/can it be used for? Desktop-as-a-Service UDGrid mpagent ftp://sf01.bic.nus.edu.sg/incoming/bioslax/fixes/zz01_gr id_mpagent.lzm

BioSlax with VMplayer+MokaFive Downloadable from MokaFive server Multiple instantiations Shoppable Cacheable LivePC No need for installation Portable on a USB Rapid deployment – user initiated

BioSlax+VM+MokaFive: Desktop-as-a-Service

Desktop-as-a-Service

Grid-enabling BioSlax: UD MP agent in BioSlax History – UDBlast and UDHMMer Rapid recruitment of machines No need for user installation Push or pull instances Enduser joining of Grid

Joining a virtual machine to

UD-BioSlax-VMware-Moka5 How Desktops-as-a-Service can be used for harnessing free cpu cycles quickly End-users and members of the public can contribute “Contribute-to-Benefit” model – enduser can log in to monitor their “credits” depending on how much CPU time they have contributed and how much they pay. Creation of public participation grid computing and public recruitment of grid-enabled processors without interfering with Enduser’s machine. Inter-Grid functionality – deploy instances of UD- BioSlax on multiple clouds

1.UD Mpagent updates require reinstallation. 2.Variation of the scheduler requires reinstallation 3.Endusers have to install the mpagent. 4.MPagent not portable 1.Moka5 can do push the update Alternatively, BioSlax can do PXE boot 2.Endusers can run the agent whenever they want to 3.MPagent wrapped in BioSlax, played in Vmplayer, pushed by Moka5 is portable

Future Work BioSlax LivePC pushed to clouds End users can have BioSlax as a development platform that will work exactly as the BioSlax pushed to the cloud. Nutch-Hadoop configured on BioSlax and pushed onto Amazon EC2, for example Bioinformatics datasets will be permanently pushed to EC2 as a common accessible database by data providers for end-users to compute