Customized cloud platform for computing on your terms !

Slides:



Advertisements
Similar presentations
Amazon Web Services (aws) B. Ramamurthy. Introduction  Amazon.com, the online market place for goods, has leveraged the services that worked for their.
Advertisements

Implementing a menu based application in FutureGrid
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of Atmosphere.
Project Implementation for COSC 5050 Distributed Database Applications Lab1.
Amazon EC2 Quick Start adapted from EC2_GetStarted.html.
Remote Accessing Your Home Computer Using VNC and a Dynamic DNS Name.
REMOTE ACCESS Research Data Management. On Campus There are two networks – the staff network and the student network. Staff network: Access to the shared.
GenSAS: Genome Sequence Annotation Server, a Tool for Online Annotation and Curation Dorrie Main, Taein Lee, Ping Zheng, Sook Jung, Stephen P. Ficklin,
Microsoft Windows 2003 Server. Client/Server Environment Many client computers connect to a server.
Building service testbeds on FIRE D5.2.5 Virtual Cluster on Federated Cloud Demonstration Kit August 2012 Version 1.0 Copyright © 2012 CESGA. All rights.
Cloud Computing. What is Cloud Computing? Cloud computing is a model for enabling convenient, on-demand network access to a shared pool of configurable.
Home Media Network Hard Drive Training for Update to 2.0 By Erik Collett Revised for Firmware Update.
Atmosphere: iPlant’s Cloud Computing Service. Overview How to connect to Atmosphere & start a virtual machine Ways to log in to a VM A simple R command.
HOW-TO guide This tutorial has sound.
Computing on the Cloud Jason Detchevery March 4 th 2009.
Enabling Cloud and Grid Powered Image Phenotyping Nirav Merchant iPlant Collaborative
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of Atmosphere.
Cloud Computing for Education and Research Customized cloud platform for computing on your terms ! CSUPERB symposium, Jan 3 rd 2013 Nirav Merchant
Using Biological Cyberinfrastructure Scaling Science and People: Applications in Data Storage, HPC, Cloud Analysis, and Bioinformatics Training Scaling.
| nectar.org.au NECTAR TRAINING Module 5 The Research Cloud Lifecycle.
Customized cloud platform for computing on your terms ! Nirav Merchant
| nectar.org.au NECTAR TRAINING Module 10 Beyond the Dashboard.
IPlant cyberifrastructure to support ecological modeling Presented at the Species Distribution Modeling Group at the American Museum of Natural History.
608D CloudStack 3.0 Omer Palo Readiness Specialist, WW Tech Support Readiness May 8, 2012.
Image Management and Rain on FutureGrid: A practical Example Presented by Javier Diaz, Fugang Wang, Gregor von Laszewski.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Atmosphere.
Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the.
IPlant Collaborative Hands-on Cyberinfrastructure Workshop - Part 1 R. Walls University of Arizona Biodiversity Information Standards (TDWG) Sep. 28, 2015,
Biomedical Big Data Training Collaborative biobigdata.ucsd.edu BBDTC UPDATES Biomedical Big Data Training Collaborative biobigdata.ucsd.edu.
Introductory RNA-seq Transcriptome Profiling. Before we start: Align sequence reads to the reference genome The most time-consuming part of the analysis.
Overview of Atmosphere
Breaking Barriers Exploding with Possibility Breaking Barriers Exploding with Possibility The Cloud Era Unveiled.
How to Deploy and Configure the Smart Net Total Care CSPC Collector
Linux Services Configuration
Sync and Exchange Research Data b2drop.eudat.eu This work is licensed under the Creative Commons CC-BY 4.0 licence B2DROP EUDAT’s Personal.
Getting Started Introduction Section 0 Lecture 1 Slide 1 Section 0 Slide 1 INTRODUCTION TO Modern Physics PHYX 2710 Fall 2004 Intermediate Lab Fall.
Administering Microsoft Windows Server 2003 Chapter 2.
| nectar.org.au NECTAR TRAINING Module 10 Beyond the Dashboard.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of the iPlant Discovery Environment.
Sponsored by the National Science Foundation Today’s Exercise.
Remote Access Usages. Remote Desktop Remote desktop technology makes it possible to view another computer's desktop on your computer. This means you can.
Configuring and Deploying Web Applications Lesson 7.
VMWare Workstation Installation. Starting Vmware Workstation Go to the start menu and start the VMware Workstation program. *Note: The following instructions.
Remote & Collaborative Visualization. TACC Remote Visualization Systems Longhorn – Dell XD Visualization Cluster –256 nodes, each with 48 GB (or 144 GB)
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of the iPlant Discovery Environment.
IPlant Collaborative Tools and Services Workshop Overview of the iPlant Discovery Environment Sriram Srinivasan.
Virtual Machines Module 2. Objectives Define virtual machine Define common terminology Identify advantages and disadvantages Determine what software is.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of Atmosphere.
IGV Demo Slides:/g/funcgen/trainings/visualization/Demos/IGV_demo.ppt Galaxy Dev: 0.
Transforming Science Through Data-driven Discovery Tools and Services Workshop Atmosphere Joslynn Lee – Data Science Educator Cold Spring Harbor Laboratory,
© 2015 MetricStream, Inc. All Rights Reserved. AWS server provisioning © 2015 MetricStream, Inc. All Rights Reserved. By, Srikanth K & Rohit.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI CloudBroker usage Zoltán Farkas MTA SZTAKI LPDS
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of Atmosphere.
Introductory RNA-seq Transcriptome Profiling of the hy5 mutation in Arabidopsis thaliana.
Transforming Science Through Data-driven Discovery Workshop Overview Ohio State University MCIC Jason Williams – Lead, CyVerse – Education, Outreach, Training.
VIRTUAL NETWORK COMPUTING SUBMITTED BY:- Ankur Yadav Ashish Solanki Charu Swaroop Harsha Jain.
Open OnDemand: Open Source General Purpose HPC Portal
BEST CLOUD COMPUTING PLATFORM Skype : mukesh.k.bansal.
Investigation authentication using AAF for the CVL on NeCTAR
CyVerse Tools and Services
Integrative Genomics Viewer (IGV)
Customized cloud platform for computing on your terms !
MANAGING, SHARING, AND PUBLISHING DATA WITH THE CYVERSE DATA STORE
Tools and Services Workshop Overview of Atmosphere
Telnet/SSH Connecting to Hosts Internet Technology.
Getting Started: Amazon AWS Account Creation
Radoslaw Jedynak, PhD Poland, Technical University of Radom
* Introduction to Cloud computing * Introduction to OpenStack * OpenStack Design & Architecture * Demonstration of OpenStack Cloud.
Remote Computing Services Cloud connection Distributed system
Getting Started: Accessing Our Amazon AWS Server
Presentation transcript:

Customized cloud platform for computing on your terms !

What is cloud computing ? The practice of using a network of remote servers hosted on the Internet to store, manage, and process data

What is Atmosphere? On-demand computing resource built on a cloud infrastructure Virtual Machine pre-configured with: – Software – Memory requirements – Processing power Fully integrated into iPlant authentication and storage and HPC capabilities Enables users to build custom images/appliances and share with community Cross-platform desktop access to GUI applications in the cloud (using VNC) Provide easy web based access to resources

Atmosphere: motivation Standalone GUI-based applications are frequently required for analysis but not easy to transform into web apps Need to handle complex software dependencies (e.g specific bioperl version and R modules) Users needing full control of their software stack (occasional sudo access) Need to share desktop/applications for collaborative analysis (remote collaborators)

Who is this tutorial designed for ? Users wanting to launch configured images in atmosphere (like app store) Developers for application distribution Prototyping/Testing new software/modules Tailored software training setups (custom workshops/laboratory courses etc) Extend compute capabilities of existing applications i.e. utilize iPlant API

API-compatible implementation of Amazon EC2/S3 interfaces Virtualize the execution environment for applications and services Up to 12 core / 48 GB instances Access to Cloud Storage + EBS >60 hosted applications in Atmosphere today, including users from USDA, Forest Service, database providers, etc. The iPlant Collaborative Project Atmosphere™: Custom Cloud Computing

Atmosphere: Collaboration iPlant Data Store

Lifecycle

How to Connect

Different Ways to Log in to VMs

Run the Integrative Genome Viewer

Accessing Your Virtual Machine VNC client Command line tools (e.g. SSH)

Atmosphere Exercise Objectives Launch an Atmosphere VM, “NGS Viewers” Connect using VNC Viewer Move data using iDrop Share instance with selected users Launch IGV “Integrative Genomics Viewer” View RNA-seq alignments to Arabidopsis reference genome TERMINATE YOUR INSTANCE WHEN DONE

Additional On-line Instruction Atmosphere Manual: ay/atmman/Table+of+Contents ay/atmman/Table+of+Contents iDrop: ay/start/Using+iDrop ay/start/Using+iDrop IGV: RealVNC:

Atmosphere Exercise Preparation Work in teams of 4 – One person in team will launch Atmosphere & share with other team members Download and Install VNC Viewer – +to+Connect+to+an+Atmosphere+VM +to+Connect+to+an+Atmosphere+VM Import required data files to your home directory – _rep1.fastq.tophat.bam _rep1.fastq.tophat.bam – T_rep1.fastq.tophat.bam.bai T_rep1.fastq.tophat.bam.bai

Import Needed Data using DE Step 1: click icon “Import from URL” Step 2: Paste URL’s & click “Upload”

Log In to Atmosphere (One member of team)

Launch Atmosphere Select “NGS Viewers” Takes min: you will receive notification with needed IP address

Launch Atmosphere Confirmation message Can take min to complete request You will receive notification with needed IP address

View Status in Dashboard Status “pending” will change to “running” You will also get an notification with IP address IP Address needed to log into VNC

Launching VNC Paste your DNS (IP address) Add “:1” to end Enter iPlant Username & Password

Moving Data with iDrop Right click on iDrop icon and select “Open” *Do not click icon multiple times!

Log In to iDrop Atmosphere: Moving Data w/ iDrop

Navigate to files in your iRods Data Store Navigate to your Atmosphere Home Directory Drag Files to copy: WT_rep1_fastq.tophat.bam WT_rep1_fastq.tophat.bam.bai

Sharing Your Atmosphere Instance Step 1 Open “VNC Server (User-Mode) or click icon

Sharing Your Atmosphere Instance Step 2 Click “Configure”

Sharing Your Atmosphere Instance Step 3 1.Click “Add User” 2.Enter iPlant User Name you wish to share with 3.Click “Add User” AGAIN! 4.“OK” Give Users the IP Address needed to Log In Shared Users can launch VNC, login, and share the desktop

Launch Integrative Genomics Viewer IGV is desktop application for customized Genome Browsing Many pre-installed genomes (or can load your own genome) Upload and view your own annotations & experimental data Many file formats accepted (e.g. BAM, GFF, BED)

Load Arabidopsis v10 Genome

Load Expression Data From File Load From File: ”WT_rep1.fastq.tophat.bam” WT_rep1.fastq.tophat.bam.bai must be in same directory but is not loaded directly

IGV View RNA-seq Alignment Tracks Need to zoom in and navigate around to find aligned regions Good Example Chr1:4,560,423-4,568,773 Or enter gene of interest Tracks show stacked alignment and bar-graph

Terminate Your Instance! Final Step…

elp+and+Asking+Questions# Thank you!