Application Programming in Cloud via Swift Swift Tutorial, CCGrid 2013, Hour 2 Ketan Maheshwari.

Slides:



Advertisements
Similar presentations
Motivation 1.Application resources setup – make it easy 2.Transform PRAGMA grid – add on demand –Continue using Grid resources –Add cloud resources Current.
Advertisements

Sponsored by the National Science Foundation Tutorial: OpenFlow-Based Vertical Handoff over WiFi and WiMAX in the Orbit Testbed Ryan Izard and KC Wang.
Ed Duguid with subject: MACE Cloud
Deployment Adavatages Provisioning time reduced to minutes, not days to weeks! Configure hardware Install OS Configure OS & Tools Assign IP Addr Configure.
Parallel Scripting on Beagle with Swift Ketan Maheshwari Postdoctoral Appointee (Argonne National.
Cloud Computing Open source cloud infrastructures Keke Chen.
Cloud Computing Imranul Hoque. Today’s Cloud Computing.
Goal – Verify that the infrastructure is able to handle the NFV application requirements Challenges – NFV applications are very different – Complex to.
An Approach to Secure Cloud Computing Architectures By Y. Serge Joseph FAU security Group February 24th, 2011.
 Max Planck Institute for Software Systems Towards trusted cloud computing Nuno Santos, Krishna P. Gummadi, and Rodrigo Rodrigues MPI-SWS.
Advanced Computing and Information Systems laboratory Educational Virtual Clusters for On- demand MPI/Hadoop/Condor in FutureGrid Renato Figueiredo Panoat.
June 23rd, 2009Inflectra Proprietary InformationPage: 1 SpiraTest/Plan/Team Deployment Considerations How to deploy for high-availability and strategies.
Implementing a menu based application in FutureGrid
© UC Regents 2010 Extending Rocks Clusters into Amazon EC2 Using Condor Philip Papadopoulos, Ph.D University of California, San Diego San Diego Supercomputer.
Nikolay Tomitov Technical Trainer SoftAcad.bg.  What are Amazon Web services (AWS) ?  What’s cool when developing with AWS ?  Architecture of AWS 
Introduction to DoC Private Cloud
Reproducible Environment for Scientific Applications (Lab session) Tak-Lon (Stephen) Wu.
Cloud Computing Systems Lin Gu Hong Kong University of Science and Technology Sept. 21, 2011 Windows Azure—Overview.
Windows Azure Conference 2014 Oracle on Windows Azure.
System Center 2012 Setup The components of system center App Controller Data Protection Manager Operations Manager Orchestrator Service.
Utility Computing Casey Rathbone 1http://cyberaide.org.edu.
 Cloud computing  Workflow  Workflow lifecycle  Workflow design  Workflow tools : xcp, eucalyptus, open nebula.
Customized cloud platform for computing on your terms !
VMware + Chef A VMworld Workshop.
Software Architecture
Course Information. Course resources All course materials (slides, links to recorded lectures, online quiz, assignments, course project, and online exams)
Presented by: Sanketh Beerabbi University of Central Florida COP Cloud Computing.
Customized cloud platform for computing on your terms ! Nirav Merchant
Grids, Clouds and the Community. Cloud Technology and the NGS Steve Thorn Edinburgh University Matteo Turilli, Oxford University Presented by David Fergusson.
1 A Framework for Data-Intensive Computing with Cloud Bursting Tekin Bicer David ChiuGagan Agrawal Department of Compute Science and Engineering The Ohio.
Large Scale Sky Computing Applications with Nimbus Pierre Riteau Université de Rennes 1, IRISA INRIA Rennes – Bretagne Atlantique Rennes, France
608D CloudStack 3.0 Omer Palo Readiness Specialist, WW Tech Support Readiness May 8, 2012.
Advanced Topics StratusLab Tutorial (Orsay, France) 28 November 2012.
Grid and Cloud Computing Globus Provision Dr. Guy Tel-Zur.
Systematic Experimentation: Automating Experiments and ExoGENI Image Snapshots Paul Ruth, RENCI / UNC Chapel Hill.
IPlant Collaborative Hands-on Cyberinfrastructure Workshop - Part 1 R. Walls University of Arizona Biodiversity Information Standards (TDWG) Sep. 28, 2015,
Cloud Computing Tony Floyd ITEC 452 Part 1 Part 2.
GLIDEINWMS - PARAG MHASHILKAR Department Meeting, August 07, 2013.
1 Adventures in Web Services for Large Geophysical Datasets Joe Sirott PMEL/NOAA.
Nara Institute of Science and Technology, Nara Prefecture, Japan CONFIGURATION AND DEPLOYMENT OF A SCALABLE VIRTUAL MACHINE CLUSTER FOR MOLECULAR DOCKING.
Sponsored by the National Science Foundation Today’s Exercise.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Accessing Cloud Systems from WS-PGRADE/gUSE Zoltán Farkas MTA SZTAKI LPDS.
Condor + Cloud Scheduler Ashok Agarwal, Patrick Armstrong, Andre Charbonneau, Ryan Enge, Kyle Fransham, Colin Leavett-Brown, Michael Paterson, Randall.
NA61/NA49 virtualisation: status and plans Dag Toppe Larsen Budapest
Evaluating Clouds for Smart Grid Computing: early Results using GE MARS App Ketan Maheshwari
Grid testing using virtual machines Stephen Childs*, Brian Coghlan, David O'Callaghan, Geoff Quigley, John Walsh Department of Computer Science Trinity.
OpenNebula: Experience at SZTAKI Peter Kacsuk, Sandor Acs, Mark Gergely, Jozsef Kovacs MTA SZTAKI EGI CF Helsinki.
Deploying Highly Available SQL Server in Windows Azure A Presentation and Demonstration by Microsoft Cluster MVP David Bermingham.
Information Initiative Center, Hokkaido University North 11, West 5, Sapporo , Japan Tel, Fax: General.
Let's build a VMM service template from A to Z in one hour Damien Caro Technical Evangelist Microsoft Central & Eastern Europe
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI CloudBroker usage Zoltán Farkas MTA SZTAKI LPDS
Building on virtualization capabilities for ExTENCI Carol Song and Preston Smith Rosen Center for Advanced Computing Purdue University ExTENCI Kickoff.
GridWay Overview John-Paul Robinson University of Alabama at Birmingham SURAgrid All-Hands Meeting Washington, D.C. March 15, 2007.
UCS D OSG School 11 Grids vs Clouds OSG Summer School Comparing Grids to Clouds by Igor Sfiligoi University of California San Diego.
Cloud Technology and the NGS Steve Thorn Edinburgh University (Matteo Turilli, Oxford University)‏ Presented by David Fergusson.
Architectural Overview Of Cloud Computing
Elastic Computing Resource Management Based on HTCondor
Virtualisation for NA49/NA61
Dag Toppe Larsen UiB/CERN CERN,
Progress on NA61/NA49 software virtualisation Dag Toppe Larsen Wrocław
Dag Toppe Larsen UiB/CERN CERN,
StratusLab Tutorial (Bordeaux, France)
Virtualisation for NA49/NA61
Building and Testing using Condor
Tomi Juvonen Software Architect, Nokia
Haiyan Meng and Douglas Thain
Webinar # April 2017 Isolates in the Cloud
An introduction to the Linux environment v
Different types of Linux installation
SQL Server on Containers
Presentation transcript:

Application Programming in Cloud via Swift Swift Tutorial, CCGrid 2013, Hour 2 Ketan Maheshwari

Overview  Part I –Cloud model of computation –Amazon ec2 setup –Tests accessing ec2 VM nodes  Part II –Swift setup –Swift test drive  Part III –Running a mock app using Swift on Cloud –Exercise

Cloud Model of Computation  Compute resources drawn as VMs from a pool of hardware resources  One time configuration  Economical: Computation power “outsourced”  More control: “root” access to VMs gives more setup options

Amazon EC2 setup  For this tutorial, we encourage using Amazon EC2 cloud computing environment  Any other cloud could be used if EC2 not available  Create VMs

Swift  Application programming language –aka parallel scripting –aka workflow framework  Suited to a variety of applications  Interfaced to –Clouds –Grids –Clusters –Supercomputers

What we need: Cloud side  A number of VM instances  Onetime Setup –firewalls –installation  Sanity test  IP of instances

What we need: Application Side  App executable installed on cloud instances –Making a single cloud image and drawing instances from it is convenient  Data  workflow

What we need: Swift side  Swift installed on submit host  Make sure perl is installed on cloud instances

Steps  Encode workflow in Swift