Technology from seed Cloud-TM: A distributed transactional memory platform for the Cloud Paolo Romano INESC ID Lisbon, Portugal 1st Plenary EuroTM Meeting,

Slides:



Advertisements
Similar presentations
1/17/20141 Leveraging Cloudbursting To Drive Down IT Costs Eric Burgener Senior Vice President, Product Marketing March 9, 2010.
Advertisements

1 Ontolog OOR Use Case Review Todd Schneider 1 April 2010 (v 1.2)
© 2007 Open Grid Forum Grids in the IT Data Center OGF 21 - Seattle Nick Werstiuk October 16, 2007.
What is Cloud Computing? Massive computing resources, deployed among virtual datacenters, dynamically allocated to specific users and tasks and accessed.
What is Cloud Computing? Massive computing resources, deployed among virtual datacenters, dynamically allocated to specific users and tasks and accessed.
Department of Electronic Engineering Challenges & Proposals INFSO Information Day Research Networking Test-beds 26/27 May 2005,
Distributed Processing, Client/Server and Clusters
2  Industry trends and challenges  Windows Server 2012: Beyond virtualization  Complete virtualization platform  Improved scalability and performance.
Cloud Computing: Theirs, Mine and Ours Belinda G. Watkins, VP EIS - Network Computing FedEx Services March 11, 2011.
SLA-Oriented Resource Provisioning for Cloud Computing
End-to-End Efficiency (E 3 ) Integrated Project of the EC 7 th Framework Programme E 3 WP5 Objectives E 3 WP5 Structure and Research Challenges
Evaluating Database-Oriented Replication Schemes in Software Transacional Memory Systems Roberto Palmieri Francesco Quaglia (La Sapienza, University of.
Cloud Computing to Satisfy Peak Capacity Needs Case Study.
Green Cloud Computing Hadi Salimi Distributed Systems Lab, School of Computer Engineering, Iran University of Science and Technology,
A FIT Event Broker for trustworthy infrastructure monitoring and management António Casimiro University of Lisbon Faculty of Sciences LASIGE – Navigators.
City University London
Dynamic adaptation of parallel codes Toward self-adaptable components for the Grid Françoise André, Jérémy Buisson & Jean-Louis Pazat IRISA / INSA de Rennes.
Based on last years lecture notes, used by Juha Takkinen.
What Great Research ?s Can RAMP Help Answer? What Are RAMP’s Grand Challenges ?
Overview Distributed vs. decentralized Why distributed databases
U NIVERSITY OF M ASSACHUSETTS, A MHERST Department of Computer Science Virtualization in Data Centers Prashant Shenoy
By- Jaideep Moses, Ravi Iyer , Ramesh Illikkal and
Community Manager A Dynamic Collaboration Solution on Heterogeneous Environment Hyeonsook Kim  2006 CUS. All rights reserved.
WORKFLOWS IN CLOUD COMPUTING. CLOUD COMPUTING  Delivering applications or services in on-demand environment  Hundreds of thousands of users / applications.
A User Experience-based Cloud Service Redeployment Mechanism KANG Yu.
DuraCloud Managing durable data in the cloud Michele Kimpton, Director DuraSpace.
A brief overview about Distributed Systems Group A4 Chris Sun Bryan Maden Min Fang.
Differentiated Access to Virtual Resources in Cloud Environments M. Fazio and A. Puliafito Euro-TM Workshop.
Presenter: Dipesh Gautam.  Introduction  Why Data Grid?  High Level View  Design Considerations  Data Grid Services  Topology  Grids and Cloud.
DISTRIBUTED COMPUTING
CONTENTS Arrival Characters Definition Merits Chararterstics Workflows Wfms Workflow engine Workflows levels & categories.
Division of IT Convergence Engineering Towards Unified Management A Common Approach for Telecommunication and Enterprise Usage Sung-Su Kim, Jae Yoon Chung,
אלעד חיון שותף ומנהל מוצרים ותוכנה בחברת U-BTech מרצה בכיר ומנהל תחום Management במכללת הי - טק.
Distributed Software Engineering Lecture 1 Introduction Sam Malek SWE 622, Fall 2012 George Mason University.
DISTRIBUTED COMPUTING Introduction Dr. Yingwu Zhu.
Distributed Computing Systems CSCI 4780/6780. Distributed System A distributed system is: A collection of independent computers that appears to its users.
Distributed Computing Systems CSCI 4780/6780. Geographical Scalability Challenges Synchronous communication –Waiting for a reply does not scale well!!
Challenges Towards Elastic Power Management in Internet Data Centers Present by Sheng Cai.
CORBA1 Distributed Software Systems Any software system can be physically distributed By distributed coupling we get the following:  Improved performance.
Department of Computer Science MapReduce for the Cell B. E. Architecture Marc de Kruijf University of Wisconsin−Madison Advised by Professor Sankaralingam.
SDN Management Layer DESIGN REQUIREMENTS AND FUTURE DIRECTION NO OF SLIDES : 26 1.
Programmability Hiroshi Nakashima Thomas Sterling.
Self-Organizing Architectures SOAR 2010 International Conference on Autonomic Computing and Communication, ICAC Washington DC, USA June 7, 2010.
Distributed Computing Systems CSCI 4780/6780. Scalability ConceptExample Centralized servicesA single server for all users Centralized dataA single on-line.
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED SYSTEMS.
1/12 Distributed Transactional Memory for Clusters and Grids EuroTM, Paris, May 20th, 2011 Michael Schöttner.
Computing Systems: Next Call for Proposals Dr. Panagiotis Tsarchopoulos Computing Systems ICT Programme European Commission.
Status & Challenges Interoperability and global integration of communication infrastructure & service platform Fixed-mobile convergence to achieve a future.
GPFS: A Shared-Disk File System for Large Computing Clusters Frank Schmuck & Roger Haskin IBM Almaden Research Center.
Is MPI still part of the solution ? George Bosilca Innovative Computing Laboratory Electrical Engineering and Computer Science Department University of.
INTRODUCTION TO GRID & CLOUD COMPUTING U. Jhashuva 1 Asst. Professor Dept. of CSE.
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED SYSTEMS.
Towards a High Performance Extensible Grid Architecture Klaus Krauter Muthucumaru Maheswaran {krauter,
New Paradigms: Clouds, Virtualization and Co.
Introduction to Cloud Technology
Curator: Self-Managing Storage for Enterprise Clusters
Stefan Kaestle, Reto Achermann, Timothy Roscoe, Tim Harris ATC’15
A Network Virtual Machine for Real-Time Coordination Services
Plethora: Infrastructure and System Design
Replication Middleware for Cloud Based Storage Service
Anne Pratoomtong ECE734, Spring2002
CMSC 611: Advanced Computer Architecture
Optimizing MapReduce for GPUs with Effective Shared Memory Usage
Scalable Parallel Interoperable Data Analytics Library
Distributed Systems CS
Chi: A Scalable & Programmable Control Plane for Distributed Stream Processing Luo Mai, Kai Zeng, Rahul Potharaju, Le Xu, Steve Suh, Shivaram Venkataraman,
Introduction To Distributed Systems
Database System Architectures
Self-Managed Systems: an Architectural Challenge
Presentation transcript:

technology from seed Cloud-TM: A distributed transactional memory platform for the Cloud Paolo Romano INESC ID Lisbon, Portugal 1st Plenary EuroTM Meeting, Paris May 2011

At a glance 2 1st Plenary EuroTM Meeting, Paris May 2011

Cloud computing: the vision lower barriers to entry and capital costs via usage-based pricing schemes minimize operating costs & carbon footprint via elastic resource provisioning achieve unprecedented scalability levels 3 1st Plenary EuroTM Meeting, Paris May 2011

Project Motivations Cloud computing is at the peak of its hype… How to materialize the vision and maximize actual productivity? 1st Plenary EuroTM Meeting, Paris May 2011 SIMPLIFYING THE DEVELOPMENT AND ADMINISTRATION OF CLOUD APPLICATIONS

Key Goals Develop an open-source middleware platform for the Cloud: 1.Providing a simple and intuitive programming model: hide complexity of distribution, persistence, fault-tolerance let programmers focus on differentiating business value 2.Minimizing administration and monitoring costs: automate elastic resource provisioning based on applications QoS requirements 3.Minimize operational costs via self-tuning maximizing efficiency adapting consistency mechanisms upon changes of workload and allocated resources 1st Plenary EuroTM Meeting, Paris May 2011

The Cloud-TM Programming Paradigm: Background Transactional Memories (TM): –replace locks with atomic transactions in multi/many core systems –hide away synchronization issues from the programme –drastically simplify development of parallel applications Distributed Transactional Memories (DTM): –extends the TM abstraction over the boundaries of a single machine –avoid performance pitfalls of Distributed Shared Memory via speculation: no need to synchronize every and each read/write operation batch consistency actions at commit time have been shown to scale up to hundreds of node (Sinfonia, ClusterSTM) 1st Plenary EuroTM Meeting, Paris May 2011

The Cloud-TM Programming Paradigm: Elastic Distributed Transactional Memory Elastic scale-up and scale-down of the DTM platform: –data distribution policies minimizing reconfiguration overhead –auto-scaling based on user defined QoS & cost constraints Transparent support for fault-tolerance via data replication: –self-tuning of consistency protocols driven by workload changes Language level support for: –transparent support of object-oriented domain model (incl. search) –highly scalable abstractions –parallel transaction nesting in distributed environments 1st Plenary EuroTM Meeting, Paris May 2011

Architectural Overview 1st Plenary EuroTM Meeting, Paris May 2011

Autonomic adaptation at play 1st Plenary EuroTM Meeting, Paris May 2011

Conclusions Whole new breed of research challenges: –elasticity: self-tuning as an essential requirement –non-uniform transaction synchronization costs: multi-core rack data-center cloud federation –unprecedented scalability challenge 10 1st Plenary EuroTM Meeting, Paris May 2011

Webpage: Contact:

Projects timeline Internet of Services Collaboration Meeting – Bruxelles October 2010 June 2011 Dec 2010 June 2013 Mar 2013 Dec 2012