MIT – Laboratory for Computer Science

Slides:



Advertisements
Similar presentations
Giggle: A Framework for Constructing Scalable Replica Location Services Ann Chervenak, Ewa Deelman, Ian Foster, Leanne Guy, Wolfgang Hoschekk, Adriana.
Advertisements

Dynamic Replica Placement for Scalable Content Delivery Yan Chen, Randy H. Katz, John D. Kubiatowicz {yanchen, randy, EECS Department.
Tapestry: Decentralized Routing and Location SPAM Summer 2001 Ben Y. Zhao CS Division, U. C. Berkeley.
One Hop Lookups for Peer-to-Peer Overlays Anjali Gupta, Barbara Liskov, Rodrigo Rodrigues Laboratory for Computer Science, MIT.
Efficient Event-based Resource Discovery Wei Yan*, Songlin Hu*, Vinod Muthusamy +, Hans-Arno Jacobsen +, Li Zha* * Chinese Academy of Sciences, Beijing.
1 Mariposa system Witold Litwin. 2 Basic goals WAN oriented DDBS Multiple sites –e.g., 1000 Scalable Locally autonomous Easy to evolve.
Chord: A scalable peer-to- peer lookup service for Internet applications Ion Stoica, Robert Morris, David Karger, M. Frans Kaashock, Hari Balakrishnan.
Xiaowei Yang CompSci 356: Computer Network Architectures Lecture 22: Overlay Networks Xiaowei Yang
A Server-less Architecture for Building Scalable, Reliable, and Cost-Effective Video-on-demand Systems Jack Lee Yiu-bun, Raymond Leung Wai Tak Department.
Peer-to-Peer Networks as a Distribution and Publishing Model Jorn De Boever (june 14, 2007)
Peer to Peer File Sharing Huseyin Ozgur TAN. What is Peer-to-Peer?  Every node is designed to(but may not by user choice) provide some service that helps.
Extensible Scalable Monitoring for Clusters of Computers Eric Anderson U.C. Berkeley Summer 1997 NOW Retreat.
Scalable Application Layer Multicast Suman Banerjee Bobby Bhattacharjee Christopher Kommareddy ACM SIGCOMM Computer Communication Review, Proceedings of.
Rendezvous Points-Based Scalable Content Discovery with Load Balancing Jun Gao Peter Steenkiste Computer Science Department Carnegie Mellon University.
A Scalable Content-Addressable Network Authors: S. Ratnasamy, P. Francis, M. Handley, R. Karp, S. Shenker University of California, Berkeley Presenter:
Scalable Distributed Stream System Mitch Cherniack, Hari Balakrishnan, Magdalena Balazinska, Don Carney, Uğur Çetintemel, Ying Xing, and Stan Zdonik Proceedings.
Object Naming & Content based Object Search 2/3/2003.
Chord-over-Chord Overlay Sudhindra Rao Ph.D Qualifier Exam Department of ECECS.
H-1 Network Management Network management is the process of controlling a complex data network to maximize its efficiency and productivity The overall.
Distributed Data Stores – Facebook Presented by Ben Gooding University of Arkansas – April 21, 2015.
5.1 Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED.
L C SL C S Security Research in Project Oxygen Srini Devadas Ronald L. Rivest Students: Burnside, Clarke, Gassend, Kotwal, Raman Oxygen Visitors: Marten.
Wireless Networks of Devices (WIND) Hari Balakrishnan and John Guttag MIT Lab for Computer Science NTT-MIT Meeting, January 2000.
Presentation 1 By: Hitesh Chheda 2/2/2010. Ion Stoica, Robert Morris, David Karger, M. Frans Kaashoek, Hari Balakrishnan MIT Laboratory for Computer Science.
Enabling Peer-to-Peer SDP in an Agent Environment University of Maryland Baltimore County USA.
Adaptive Web Caching CS411 Dynamic Web-Based Systems Flying Pig Fei Teng/Long Zhao/Pallavi Shinde Computer Science Department.
Internet Real-Time Laboratory Arezu Moghadam and Suman Srinivasan Columbia University in the city of New York 7DS System Design 7DS system is an architecture.
1 MSc Project Yin Chen Supervised by Dr Stuart Anderson 2003 Grid Services Monitor Long Term Monitoring of Grid Services Using Peer-to-Peer Techniques.
INAT Hari BalakrishnanFrans Kaashoek John Guttag Robert Morris MIT Laboratory for Computer Science NGI PI Meeting October 2, 2000.
The Replica Location Service The Globus Project™ And The DataGrid Project Copyright (c) 2002 University of Chicago and The University of Southern California.
1 Peer-to-Peer Technologies Seminar by: Kunal Goswami (05IT6006) School of Information Technology Guided by: Prof. C.R.Mandal, School of Information Technology.
1 Naming for Internet MMLAB, Seongil Han
1 Secure Peer-to-Peer File Sharing Frans Kaashoek, David Karger, Robert Morris, Ion Stoica, Hari Balakrishnan MIT Laboratory.
Information-Centric Networks10b-1 Week 10 / Paper 2 Hermes: a distributed event-based middleware architecture –P.R. Pietzuch, J.M. Bacon –ICDCS 2002 Workshops.
Querying The Internet With PIER Nitin Khandelwal.
Information-Centric Networks Section # 10.2: Publish/Subscribe Instructor: George Xylomenos Department: Informatics.
Mapping Salutation to Bluetooth 4 Overview 4 Bluetooth Summary 4 Salutation Architecture Summary 4 Mapping Bluetooth SDP to Salutation APIs 4 Mapping Bluetooth.
Peer to Peer Network Design Discovery and Routing algorithms
Integrating Access Control with Intentional Naming Sanjay Raman MIT Laboratory for Computer Science January 8, 2002 With help from: Dwaine.
DATABASE REPLICATION DISTRIBUTED DATABASE. O VERVIEW Replication : process of copying and maintaining database object, in multiple database that make.
Peer-to-Peer Systems: An Overview Hongyu Li. Outline  Introduction  Characteristics of P2P  Algorithms  P2P Applications  Conclusion.
Design and implementation of an intentional naming system William Adjie-WinotoElliot Schwartz Hari BalakrishnanJeremy Lilley MIT Laboratory for Computer.
P2P Search COP P2P Search Techniques Centralized P2P systems  e.g. Napster, Decentralized & unstructured P2P systems  e.g. Gnutella.
NCLAB 1 Supporting complex queries in a distributed manner without using DHT NodeWiz: Peer-to-Peer Resource Discovery for Grids Sujoy Basu, Sujata Banerjee,
REED : Robust, Efficient Filtering and Event Detection in Sensor Network Daniel J. Abadi, Samuel Madden, Wolfgang Lindner Proceedings of the 31st VLDB.
Integrating Access Control with Intentional Naming Sanjay Raman MIT Laboratory for Computer Science January 8, 2002 With help from: Dwaine.
Department of Computer Science, Johns Hopkins University EN Instructor: Randal Burns 24 September 2013 NoSQL Data Models and Systems.
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED SYSTEMS.
A Survey of Peer-to-Peer Content Distribution Technologies Stephanos Androutsellis-Theotokis and Diomidis Spinellis ACM Computing Surveys, December 2004.
Magdalena Balazinska, Hari Balakrishnan, and David Karger
Database Development (8 May 2017).
Module Overview Installing and Configuring a Network Policy Server
Ad-hoc Networks.
Load Weighting and Priority
Wireless Networks of Devices
CHAPTER 3 Architectures for Distributed Systems
MapReduce Computing Paradigm Basics Fall 2013 Elke A. Rundensteiner
SCOPE: Scalable Consistency in Structured P2P Systems
Comparison of LAN, MAN, WAN
Overlay Networking Overview.
Providing Secure Storage on the Internet
DHT Routing Geometries and Chord
Cse 344 May 4th – Map/Reduce.
Distributed P2P File System
Prof. Leonardo Mostarda University of Camerino
An Introduction to Software Architecture
Wireless Networks of Devices (WIND)
3rd Studierstube Workshop TU Wien
Combinatorial Optimization of Multicast Key Management
A Semantic Peer-to-Peer Overlay for Web Services Discovery
Presentation transcript:

MIT – Laboratory for Computer Science International Conference of Pervasive Computing, LNCS, 2002. INS/Twine : A Scalable Peer-to-Peer Architecture for Intentional Resource Discovery

Problem Description Abundant ubiquitous computation and communication Increasingly large computing environments Dynamic environments Locate resources using intentional descriptions

INR: Intentional Name Resolver INS Overview INR: Intentional Name Resolver INR Self-configuring resolver network Resources advertise their capabilities Client describes attributes of required resources

Resource Discovery Goals Allow client applications to locate services and devices Handle sophisticated resource descriptions Handle dynamism in the operating environment Scale to large numbers of resources

Existing Solutions for Scalability Sensor Proxy Resolver Partitioning Bldg 1 Bldg 2 Bldg 3 Floors 1-3 Floors 4-6 ? Cameras

Existing Solutions for Scalability Sensor Proxy Resolver Hierarchies

INS/Twine Contributions Collaborating peer resolvers: no content or location constraints on queries Scalability and load distribution via hash-based partitioning of resource descriptions among resolvers Semi-structured resource descriptions with arbitrary attribute-set Network dynamism Designed for an environment where all resources are equally important to users

INS/Twine Approach Overview Resolver resource = camera subject = traffic resource = motion sensor Sensor Proxy

INS/Twine Approach Overview A resource advertises its descriptions and network location to any resolver The description is converted into a canonical form: attribute-value tree (AVTree) Using the content of the advertised description, the resolver determines which resolvers should know about the resource The resolver forwards the description to these resolvers for storage Similarly for queries <res>camera <man>ACompany</man> <model>AModel</model> </res> <subject>traffic</subject> traffic root subject resource camera manufacturer ACompany model AModel

Architecture of INS/Twine (3-layer) T: type (advertisement or query) V: AVTree NR: name-record

Architecture of One Resolver 0110 1001 0000 Key Strand Mapper h : 0110 Best(01101001000) K nodes are chosen Router Distributed Hash Table h = hash(a1v1-a2v2) Res adv. … a1 v1 a2 v2

Splitting Descriptions into Strands Resource description: AVTrees traffic root subject resource camera manufacturer ACompany model AModel Six strands Input strand: res-camera-man-ACompany h1 = hash(res-camera) h2 = hash(res-camera-man) h3 = hash(res-camera-man-ACompany) Output keys: h1, h2 and h3

State Management Resources: join, move, leave and fail Resolvers: join and fail How to maintain consistency while achieving fault-tolerance? Hard state Soft state Hybrid solution implemented in INS/Twine

State Management in INS/Twine Resources refresh: at a high frequency by the refresh interval δ Resolvers refresh: at a lower rate defined by the refresh interval △

Evaluation: Data Distribution - Data distribution rather even. - Each resolvers holds a small fraction of resource descriptions

Evaluation: Data Distribution - Even distribution of queries among resolvers

Conclusion Intentional resource discovery Scalable peer-to-peer network of resolvers Hash-based mapping of resource descriptions to resolvers Dynamic and event distribution of resource information and queries Handles dynamism of resources and resolvers