What’s Hot in Clouds? Analyze (superficially) the ~140 Papers/Short papers/Workshops/Posters/Demos in CloudCom Each paper may fall in more than one category.

Slides:



Advertisements
Similar presentations
Cloud Computing at GES DISC Presented by: Long Pham Contributors: Aijun Chen, Bruce Vollmer, Ed Esfandiari and Mike Theobald GES DISC UWG May 11, 2011.
Advertisements

Cloud Computing Open source cloud infrastructures Keke Chen.
SALSA HPC Group School of Informatics and Computing Indiana University.
International Conference on Cloud and Green Computing (CGC2011, SCA2011, DASC2011, PICom2011, EmbeddedCom2011) University.
Clouds from FutureGrid’s Perspective April Geoffrey Fox Director, Digital Science Center, Pervasive.
Advanced Computing and Information Systems laboratory Educational Virtual Clusters for On- demand MPI/Hadoop/Condor in FutureGrid Renato Figueiredo Panoat.
Authors: Thilina Gunarathne, Tak-Lon Wu, Judy Qiu, Geoffrey Fox Publish: HPDC'10, June 20–25, 2010, Chicago, Illinois, USA ACM Speaker: Jia Bao Lin.
INTRODUCTION TO CLOUD COMPUTING CS 595 LECTURE 4.
ORNL is managed by UT-Battelle for the US Department of Energy Data Management User Guide Suzanne Parete-Koon Oak Ridge Leadership Computing Facility.
MapReduce in the Clouds for Science CloudCom 2010 Nov 30 – Dec 3, 2010 Thilina Gunarathne, Tak-Lon Wu, Judy Qiu, Geoffrey Fox {tgunarat, taklwu,
Virtual Clusters Supporting MapReduce in the Cloud Jonathan Klinginsmith School of Informatics and Computing.
Panel Session The Challenges at the Interface of Life Sciences and Cyberinfrastructure and how should we tackle them? Chris Johnson, Geoffrey Fox, Shantenu.
A Brief Overview by Aditya Dutt March 18 th ’ Aditya Inc.
Big Data and Clouds: Challenges and Opportunities NIST January Geoffrey Fox
Applying Twister to Scientific Applications CloudCom 2010 Indianapolis, Indiana, USA Nov 30 – Dec 3, 2010.
Research on cloud computing application in the peer-to-peer based video-on-demand systems Speaker : 吳靖緯 MA0G rd International Workshop.
X-Informatics Cloud Technology (Continued) March Geoffrey Fox Associate.
Cloud based storage. Cloud Storage Storage accessed by a web service API It is a block storage, it exposes its storage to clients as Raw storage that.
INTRODUCTION TO CLOUD COMPUTING CS 595 LECTURE 7 2/23/2015.
 Cloud computing  Workflow  Workflow lifecycle  Workflow design  Workflow tools : xcp, eucalyptus, open nebula.
Interoperability in the Cloud By Alex Espinoza
Science of Cloud Computing Panel Cloud2011 Washington DC July Geoffrey Fox
MapReduce TG11 BOF FutureGrid Team (Geoffrey Fox) TG11 19 July 2011 Downtown Marriott Salt Lake City.
Experimenting with FutureGrid CloudCom 2010 Conference Indianapolis December Geoffrey Fox
Cloud Computing 1. Outline  Introduction  Evolution  Cloud architecture  Map reduce operation  Platform 2.
Science Clouds and FutureGrid’s Perspective June Science Clouds Workshop HPDC 2012 Delft Geoffrey Fox
CS525: Special Topics in DBs Large-Scale Data Management Hadoop/MapReduce Computing Paradigm Spring 2013 WPI, Mohamed Eltabakh 1.
Introduction to Apache Hadoop Zibo Wang. Introduction  What is Apache Hadoop?  Apache Hadoop is a software framework which provides open source libraries.
Hadoop/MapReduce Computing Paradigm 1 Shirish Agale.
Introduction to Hadoop and HDFS
Biomedical Cloud Computing iDASH Symposium San Diego CA May Geoffrey Fox
Large Scale Sky Computing Applications with Nimbus Pierre Riteau Université de Rennes 1, IRISA INRIA Rennes – Bretagne Atlantique Rennes, France
What’s Hot in Clouds? Analyze (superficially) the ~140 Papers/Short papers/Workshops/Posters/Demos in CloudCom Each paper may fall in more than one category.
The Limitation of MapReduce: A Probing Case and a Lightweight Solution Zhiqiang Ma Lin Gu Department of Computer Science and Engineering The Hong Kong.
FutureGrid Connection to Comet Testbed and On Ramp as a Service Geoffrey Fox Indiana University Infra structure.
Magellan: Experiences from a Science Cloud Lavanya Ramakrishnan.
SALSA HPC Group School of Informatics and Computing Indiana University.
Performance Evaluation of Image Conversion Module Based on MapReduce for Transcoding and Transmoding in SMCCSE Speaker : 吳靖緯 MA0G IEEE.
Grid and Cloud Computing Globus Provision Dr. Guy Tel-Zur.
Grid Computing at Yahoo! Sameer Paranjpye Mahadev Konar Yahoo!
RAIN: A system to Dynamically Generate & Provision Images on Bare Metal by Application Users Presented by Gregor von Laszewski Authors: Javier Diaz, Gregor.
SALSASALSASALSASALSA FutureGrid Venus-C June Geoffrey Fox
1 NETE4631 Working with Cloud-based Storage Lecture Notes #11.
SALSASALSASALSASALSA Clouds Ball Aerospace March Geoffrey Fox
SALSASALSASALSASALSA Cloud Panel Session CloudCom 2009 Beijing Jiaotong University Beijing December Geoffrey Fox
Big Data Open Source Software and Projects ABDS in Summary IV: Level 7 I590 Data Science Curriculum August Geoffrey Fox
CS525: Big Data Analytics MapReduce Computing Paradigm & Apache Hadoop Open Source Fall 2013 Elke A. Rundensteiner 1.
NTU Cloud 2010/05/30. System Diagram Architecture Gluster File System – Provide a distributed shared file system for migration NFS – A Prototype Image.
 Frequent Word Combinations Mining and Indexing on HBase Hemanth Gokavarapu Santhosh Kumar Saminathan.
Cloudbiolinux = Genomics resources for use on cloud platforms. Includes: – An Amazon Machine Image with lots of handy bioinformatics software pre-installed.
Computing Research Testbeds as a Service: Supporting large scale Experiments and Testing SC12 Birds of a Feather November.
Security: systems, clouds, models, and privacy challenges iDASH Symposium San Diego CA October Geoffrey.
Impala. Impala: Goals General-purpose SQL query engine for Hadoop High performance – C++ implementation – runtime code generation (using LLVM) – direct.
A Technical Overview Bill Branan DuraCloud Technical Lead.
Hadoop/MapReduce Computing Paradigm 1 CS525: Special Topics in DBs Large-Scale Data Management Presented By Kelly Technologies
Vignesh Ravindran Sankarbala Manoharan. Infrastructure As A Service (IAAS) is a model that is used to deliver a platform virtualization environment with.
Bioinformatics on Cloud Cyberinfrastructure Bio-IT April Geoffrey Fox
Directions in eScience Interoperability and Science Clouds June Interoperability in Action – Standards Implementation.
Next Generation of Apache Hadoop MapReduce Owen
Servizi di brokering Valerio Venturi CCR Giornata di formazione dedicata al Cloud Computing 6 Febbraio 2013.
INTRODUCTION TO HADOOP. OUTLINE  What is Hadoop  The core of Hadoop  Structure of Hadoop Distributed File System  Structure of MapReduce Framework.
Apache Hadoop on Windows Azure Avkash Chauhan
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
The StratusLab Distribution and Its Evolution 4ème Journée Cloud (Bordeaux, France) 30 November 2012.
Large Scale Semantic Data Integration and Analytics through Cloud: A Case Study in Bioinformatics Tat Thang Parallel and Distributed Computing Centre,
Lecture 1 Book: Hadoop in Action by Chuck Lam Online course – “Cloud Computing Concepts” lecture notes by Indranil Gupta.
Canadian Bioinformatics Workshops
CLOUD ARCHITECTURE Many organizations and researchers have defined the architecture for cloud computing. Basically the whole system can be divided into.
Gregor von Laszewski Indiana University
Cloud versus Cloud: How Will Cloud Computing Shape Our World?
Presentation transcript:

What’s Hot in Clouds? Analyze (superficially) the ~140 Papers/Short papers/Workshops/Posters/Demos in CloudCom Each paper may fall in more than one category Core Cloud/Virtualization/Reliability 26 plus ~2 keynotes and 5 tutorials Applications 40 plus 1 (adopting clouds) panel plus ? keynotes Scheduling /resource allocation 16 Security/Privacy 25 plus 1 Panel plus 1 Keynote MapReduce 31 plus 3 tutorials Other Programming models (e.g. workflow) 9 Storage 14 plus 2 tutorials Discovery/semantics 5 Portal/clients 7 Interoperability/Federation 3 plus 1 panel Green IT 6

Tutorials -- MapReduce Yahoo on Hadoop – 40,000 nodes running Hadoop Indiana on Twister – Iterative Chicago on Sphere – General user processing in Map and Reduce; put communication at end of “map” and not beginning of “reduce” as in Hadoop

Tutorials -- Storage Yahoo on HDFS Chicago on Sector – Does not spread blocks of files around, so faster than Hadoop Bret Piatt on OpenStack – has open source service based object store like Amazon S3 (not released yet); supports CDMI Cloud Data Management Interface standard from SNIA (Industry Storage association)

Tutorials -- Core Cloud Platforms Microsoft on Azure Spanish group on OpenNebula RackSpace on OpenStack which has a compute (~EC2) component from NASA that is released; supports OCCI standard from OGF Indiana on FutureGrid including Eucalyptus. FutureGrid also supports Nimbus and expects to support OpenStack and OpenNebula Chicago on Nimbus

Adopting Clouds Panel Agreement that clouds are good for some applications – especially data-intensive and bioinformatics Complaints about details of Hadoop – language and need for text input Software as a Service important; – Globus has data transfer as a Service (Foster keynote) Fortes emphasized need for SLA’s (Service Level Agreements) and multi-cloud systems (Called Sky Computing) Gannon emphasized following day cloud – client interaction e.g. cloud backend to Excel