Hierarchical Quorum Consensus: A New Algorithm for Managing Replicated Data Akhil Kumar IEEE TRANSACTION ON COMPUTERS, VOL.40, NO.9, SEPTEMBER 1991.

Slides:



Advertisements
Similar presentations
Agent agent Outline of Presentation Introduction: Inter-Agent Message Passing ARP: Design and Analysis Generalization: A Generic Framework Conclusion.
Advertisements

Copyright 2004 Koren & Krishna ECE655/DataRepl.1 Fall 2006 UNIVERSITY OF MASSACHUSETTS Dept. of Electrical & Computer Engineering Fault Tolerant Computing.
Failure Detection The ping-ack failure detector in a synchronous system satisfies – A: completeness – B: accuracy – C: neither – D: both.
Replication Management. Motivations for Replication Performance enhancement Increased availability Fault tolerance.
Beyond the MDS Bound in Distributed Cloud Storage
DISTRIBUTED SYSTEMS II REPLICATION CNT. II Prof Philippas Tsigas Distributed Computing and Systems Research Group.
Dave Lattanzi’s RRT Algorithm. General Concept Use dictionaries for trees Create a randomized stack of nodes Iterate through stack “Extend” each tree.
Chien Hsing James Wu David Gottesman Andrew Landahl.
Chapter 13 Replica Management in Grids
On the Construction of Energy- Efficient Broadcast Tree with Hitch-hiking in Wireless Networks Source: 2004 International Performance Computing and Communications.
GRID COMPUTING: REPLICATION CONCEPTS Presented By: Payal Patel.
6.4 Data and File Replication Gang Shen. Why replicate  Performance  Reliability  Resource sharing  Network resource saving.
NCCloud: A Network-Coding-Based Storage System in a Cloud-of-Clouds
MAXIMIZING SPECTRUM UTILIZATION OF COGNITIVE RADIO NETWORKS USING CHANNEL ALLOCATION AND POWER CONTROL Anh Tuan Hoang and Ying-Chang Liang Vehicular Technology.
6.4 Data And File Replication Presenter : Jing He Instructor: Dr. Yanqing Zhang.
Miao Zhao, Ming Ma and Yuanyuan Yang
Distributed Algorithms – 2g1513 Lecture 9 – by Ali Ghodsi Fault-Tolerance in Distributed Systems.
Chapter 19 Recovery and Fault Tolerance Copyright © 2008.
Distributed systems A collection of autonomous computers linked by a network, with software designed to produce an integrated computing facility –A well.
Replication March 16, Replication What is Replication?  A technique for increasing availability, fault tolerance and sometimes, performance 
Maximum Network Lifetime in Wireless Sensor Networks with Adjustable Sensing Ranges Cardei, M.; Jie Wu; Mingming Lu; Pervaiz, M.O.; Wireless And Mobile.
EEC 688/788 Secure and Dependable Computing Lecture 9 Wenbing Zhao Department of Electrical and Computer Engineering Cleveland State University
Byzantine fault-tolerance COMP 413 Fall Overview Models –Synchronous vs. asynchronous systems –Byzantine failure model Secure storage with self-certifying.
SYNCHRONIZATION TECHNIQUES BASED ON TWO-PHASE LOCKING
Improving the Efficiency of Fault-Tolerant Distributed Shared-Memory Algorithms Eli Sadovnik and Steven Homberg Second Annual MIT PRIMES Conference, May.
Expert Systems with Applications 34 (2008) 459–468 Multi-level fuzzy mining with multiple minimum supports Yeong-Chyi Lee, Tzung-Pei Hong, Tien-Chin Wang.
PAPER PRESENTATION Real-Time Coordination of Plug-In Electric Vehicle Charging in Smart Grids to Minimize Power Losses and Improve Voltage Profile IEEE.
Fault-Tolerant Parallel and Distributed Computing for Software Engineering Undergraduates Ali Ebnenasir and Jean Mayo {aebnenas, Department.
Chapter 6.5 Distributed File Systems Summary Junfei Wen Fall 2013.
IM NTU Distributed Information Systems 2004 Replication Management -- 1 Replication Management Yih-Kuen Tsay Dept. of Information Management National Taiwan.
1 Distributed Databases BUAD/American University Distributed Databases.
Time, Clocks, and the Ordering of Events in a Distributed System Leslie Lamport Massachusetts Computer Associates,Inc. Presented by Xiaofeng Xiao.
Re-Configurable Byzantine Quorum System Lei Kong S. Arun Mustaque Ahamad Doug Blough.
1 Revisiting Hierarchical Quorum Systems Nuno Preguiça, J. Legatheaux Martins Henry Canivel.
A Generalized Version Space Learning Algorithm for Noisy and Uncertain Data T.-P. Hong, S.-S. Tseng IEEE Transactions on Knowledge and Data Engineering,
Network Coding Data Collecting Mechanism based on Prioritized Degree Distribution in Wireless Sensor Network Wei Zhang, Xianghua Xu, Qinchao Zhang, Jian.
Topic Distributed DBMS Database Management Systems Fall 2012 Presented by: Osama Ben Omran.
Chapter 4 Wenbing Zhao Department of Electrical and Computer Engineering Cleveland State University Building Dependable Distributed Systems.
Real-Time Scheduling II: Compositional Scheduling Framework Insik Shin Dept. of Computer Science KAIST.
An Efficient and Fault-Tolerant Solution for Distributed Mutual Exclusion by D. Agrawal, A.E. Abbadi Presentation by Peter Tsui for COEN 317, F/03.
CS 3471 CS 347: Parallel and Distributed Data Management Notes13: Time and Clocks.
A N I N - MEMORY F RAMEWORK FOR E XTENDED M AP R EDUCE 2011 Third IEEE International Conference on Coud Computing Technology and Science.
An Efficient Quorum-based Fault- Tolerant Approach for Mobility Agents in Wireless Mobile Networks Yeong-Sheng Chen Chien-Hsun Chen Hua-Yin Fang Department.
CIS 720 Replication. Replica Management Three Subproblems Your boss says to you, “Our system is too slow, make it faster.” You decide that replication.
EEC 688/788 Secure and Dependable Computing Lecture 9 Wenbing Zhao Department of Electrical and Computer Engineering Cleveland State University
An Energy-Efficient Approach for Real-Time Tracking of Moving Objects in Multi-Level Sensor Networks Vincent S. Tseng, Eric H. C. Lu, & Kawuu W. Lin Institute.
A Survey of Fault Tolerance in Distributed Systems By Szeying Tan Fall 2002 CS 633.
Antidio Viguria Ann Krueger A Nonblocking Quorum Consensus Protocol for Replicated Data Divyakant Agrawal and Arthur J. Bernstein Paper Presentation: Dependable.
“Distributed Algorithms” by Nancy A. Lynch SHARED MEMORY vs NETWORKS Presented By: Sumit Sukhramani Kent State University.
1 Space-Efficient TCAM-based Classification Using Gray Coding Authors: Anat Bremler-Barr and Danny Hendler Publisher: IEEE INFOCOM 2007 Present: Chen-Yu.
Implementation of Simple Cloud-based Distributed File System Group ID: 4 Baolin Wu, Liushan Yang, Pengyu Ji.
Fundamentals of Fault-Tolerant Distributed Computing In Asynchronous Environments Paper by Felix C. Gartner Graeme Coakley COEN 317 November 23, 2003.
1 On the Trade-Off between Energy and Multicast Efficiency in e-Like Mobile Networks Reuven Cohen, Liran Katzir, and Romeo Rizzi Department of Computer.
MapReduce MapReduce is one of the most popular distributed programming models Model has two phases: Map Phase: Distributed processing based on key, value.
Design of a Multi-Agent System for Distributed Voltage Regulation
6.4 Data and File Replication
Distributed Systems CS
Outline Announcements Fault Tolerance.
A CASE STUDY INTRODUCING DYNAMIC PROGRAMMING IN CS2
INTRODUCTION Objectives
Consistency and Replication
EEC 688/788 Secure and Dependable Computing
EEC 688/788 Secure and Dependable Computing
Replication and Availability in Distributed Systems
CS 584 Lecture7 Assignment -- Due Now! Paper Review is due next week.
X y y = x2 - 3x Solutions of y = x2 - 3x y x –1 5 –2 –3 6 y = x2-3x.
EEC 688/788 Secure and Dependable Computing
Ch 6. Summary Gang Shen.
Copyright 2004 Koren & Krishna ECE655/DataRepl.1 Fall 2006 UNIVERSITY OF MASSACHUSETTS Dept. of Electrical & Computer Engineering Fault Tolerant Computing.
Distributed systems A collection of autonomous computers linked by a network, with software designed to produce an integrated computing facility A well.
Presentation transcript:

Hierarchical Quorum Consensus: A New Algorithm for Managing Replicated Data Akhil Kumar IEEE TRANSACTION ON COMPUTERS, VOL.40, NO.9, SEPTEMBER 1991

Outline Introduction Quorum Consensus Algorithm Hierarchical Quorum Consensus HQC algorithm Availability Analysis Tradeoffs between HQC and Related Algorithm Conclusion

Introduction(1/8) Motivations of Data Replication 1.Fault Tolerant 2.Increasing System Reliability

Introduction(2/8) 1.Providing Fault tolerant capability in distributed system :One copy of an object

Introduction(3/8) 2.Replication of data for concurrent read/write The copy is using :One copy of an object The copy is using

Introduction(4/8) Two problems occur in distribution system: –RW problem –WW problem Read Write Read Write

Introduction(5/8) Two operations of quorum structure in distribution system: –Read operation To access all of the copies in a read quorum a copy with the highest version number is returned –Write operation To write to all of the copies in a write quorum assigns each copy the version number that is one more than the maximum version number encountered in the write quorum. Read quorum Write quorum

Introduction(6/8) The solution : intersect property of read/write quorum –RW problem –WW problem Read and Write Read quorumWrite quorum Write and Write write quorumWrite quorum

Introduction(7/8) This paper generalizes the quorum consensus scheme (QC) –into a multilevel algorithm called hierarchical quorum consensus (HQC) –shows that given a collection of n copies of an object, the minimum size of a quorum is n 0.63 copies. A smaller quorum size results in a lower cost of synchronization.

Introduction(8/8) Our method is based on organizing the copies of an object into –extending the quorum consensus algorithm –Logical node –multilevel hierarchy

QC Algorithm 8 copies let n=8+1 qr+qw > 9 2qw > copies let n=9+1 qr+qw > =10 2qw > = Read and Write Read quorumWrite quorum The quorum intersection conditions: Read and Write Read quorum Write quorum

The concept of HQC An example of 2-level l1=3 l2=3 r1+w1>3 r2+w2>3 2w1>3 2w2> r w best size

The concept of HQC

HQC algorithm For example: l1=3 r1+w1>3 2w1>

HQC algorithm

=

best size worst size

Availability Analysis HQC Majority Voting HQC  Majority Voting HQC Majority Voting HQC  Majority Voting

Availability Analysis HQC Majority Voting HQC  Majority Voting HQC Majority Voting HQC  Majority Voting

Tradeoffs between HQC and Related Algorithm HQC is better than others fully.

Conclusion In this paper, they introduced a new algorithm, also based on voting, and showed that: –It is possible to reduce the size of a quorum from  (n+1)/2  copies (as in majority voting) to n 0.63 copies –The HQC method produces certain intersecting sets of quorums that cannot be produced in a single-level vote assignment