ETRI Bloom Filter-based Flat Name Resolution System for ICN ICNRG Interim meeting, Paris Jungha Hong, Woojik Chun, and Heeyoung Jung September 27, 2014.

Slides:



Advertisements
Similar presentations
Dynamic Replica Placement for Scalable Content Delivery Yan Chen, Randy H. Katz, John D. Kubiatowicz {yanchen, randy, EECS Department.
Advertisements

Scalable Content-Addressable Network Lintao Liu
1 Accessing nearby copies of replicated objects Greg Plaxton, Rajmohan Rajaraman, Andrea Richa SPAA 1997.
Naming Computer Engineering Department Distributed Systems Course Asst. Prof. Dr. Ahmet Sayar Kocaeli University - Fall 2014.
Internet Networking Spring 2006 Tutorial 12 Web Caching Protocols ICP, CARP.
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED SYSTEMS.
Adaptive Web Caching: Towards a New Caching Architecture Authors and Institutions: Scott Michel, Khoi Nguyen, Adam Rosenstein and Lixia Zhang UCLA Computer.
A Scalable and Load-Balanced Lookup Protocol for High Performance Peer-to-Peer Distributed System Jerry Chou and Tai-Yi Huang Embedded & Operating System.
1 Spring Semester 2007, Dept. of Computer Science, Technion Internet Networking recitation #13 Web Caching Protocols ICP, CARP.
CSCI 4550/8556 Computer Networks Comer, Chapter 19: Binding Protocol Addresses (ARP)
© 2007 Pearson Education Inc., Upper Saddle River, NJ. All rights reserved.1 Computer Networks and Internets with Internet Applications, 4e By Douglas.
SCALLOP A Scalable and Load-Balanced Peer- to-Peer Lookup Protocol for High- Performance Distributed System Jerry Chou, Tai-Yi Huang & Kuang-Li Huang Embedded.
Implementation of a Tapestry Node: The main components: The core router, utilizes the routing and object reference tables to handle messages, The node.
Internet Networking Spring 2002 Tutorial 13 Web Caching Protocols ICP, CARP.
Object Naming & Content based Object Search 2/3/2003.
DISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S
Peer To Peer Distributed Systems Pete Keleher. Why Distributed Systems? l Aggregate resources! –memory –disk –CPU cycles l Proximity to physical stuff.
1Bloom Filters Lookup questions: Does item “ x ” exist in a set or multiset? Data set may be very big or expensive to access. Filter lookup questions with.
P2P Course, Structured systems 1 Introduction (26/10/05)
BUFFALO: Bloom Filter Forwarding Architecture for Large Organizations Minlan Yu Princeton University Joint work with Alex Fabrikant,
Hash, Don’t Cache: Fast Packet Forwarding for Enterprise Edge Routers Minlan Yu Princeton University Joint work with Jennifer.
SIMULATING A MOBILE PEER-TO-PEER NETWORK Simo Sibakov Department of Communications and Networking (Comnet) Helsinki University of Technology Supervisor:
11.1 © 2004 Pearson Education, Inc. Exam Managing and Maintaining a Microsoft® Windows® Server 2003 Environment Lesson 11: Introducing WINS, DNS,
Naming Chapter 5. n Most of the lecture notes are based on slides by Prof. Jalal Y. Kawash at Univ. of Calgary n Some slides are from Brennen Reynolds.
INTRODUCTION TO PEER TO PEER NETWORKS Z.M. Joseph CSE 6392 – DB Exploration Spring 2006 CSE, UT Arlington.
Fast and deterministic hash table lookup using discriminative bloom filters  Author: Kun Huang, Gaogang Xie,  Publisher: 2013 ELSEVIER Journal of Network.
CoPTUA: Consistent Policy Table Update Algorithm for TCAM without Locking Zhijun Wang, Hao Che, Mohan Kumar, Senior Member, IEEE, and Sajal K. Das.
Research Interests Georgia Koloniari Computer Science Department University of Ioannina, Greece.
BUFFALO: Bloom Filter Forwarding Architecture for Large Organizations Minlan Yu Princeton University Joint work with Alex Fabrikant,
DMAP : Global Name Resolution Services Through Direct Mapping Tam Vu, Akash Baid WINLAB, Rutgers University (Joint.
Bloom Filter-based Flat Name Resolution System for ICN ICNRG Interim Meeting, Dallas Jungha Hong, Woojik Chun, and Heeyoung Jung March 22, www.idnet.re.kr1.
Content Addressable Network CAN. The CAN is essentially a distributed Internet-scale hash table that maps file names to their location in the network.
A Scalable Content-Addressable Network (CAN) Seminar “Peer-to-peer Information Systems” Speaker Vladimir Eske Advisor Dr. Ralf Schenkel November 2003.
Lecture # 3 & 4 Chapter # 2 Database System Concepts and Architecture Muhammad Emran Database Systems 1.
Networking 2012 On inter-domain name resolution for information-centric networks K.V. Katsaros, N. Fotiou, X. Vasilakos, C.N. Ververidis, C. Tsilopoulos,
Authors: Matteo Varvello, Diego Perino, and Leonardo Linguaglossa Publisher: NOMEN 2013 (The 2nd IEEE International Workshop on Emerging Design Choices.
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED SYSTEMS.
SIGCOMM 2001 Lecture slides by Dr. Yingwu Zhu Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications.
1 A Throughput-Efficient Packet Classifier with n Bloom filters Authors: Heeyeol Yu and Rabi Mahapatra Publisher: IEEE GLOBECOM 2008 proceedings Present:
How to use DNS during the evolution of ICN? Zhiwei Yan.
Freenet “…an adaptive peer-to-peer network application that permits the publication, replication, and retrieval of data while protecting the anonymity.
1. Outline  Introduction  Different Mechanisms Broadcasting Multicasting Forward Pointers Home-based approach Distributed Hash Tables Hierarchical approaches.
1. Efficient Peer-to-Peer Lookup Based on a Distributed Trie 2. Complex Queries in DHT-based Peer-to-Peer Networks Lintao Liu 5/21/2002.
Hint-based Acceleration of Web Proxy Cache Daniela Rosu Arun Iyengar Daniel Dias IBM T.J.Watson Research Center Unversity of Yuan Ze,Syslab Mike Tien
CS Spring 2014 CS 414 – Multimedia Systems Design Lecture 37 – Introduction to P2P (Part 1) Klara Nahrstedt.
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED SYSTEMS.
PeerNet: Pushing Peer-to-Peer Down the Stack Jakob Eriksson, Michalis Faloutsos, Srikanth Krishnamurthy University of California, Riverside.
CSCI 599: Beyond Web Browsers Professor Shahram Ghandeharizadeh Computer Science Department Los Angeles, CA
1 Plaxton Routing. 2 History Greg Plaxton, Rajmohan Rajaraman, Andrea Richa. Accessing nearby copies of replicated objects, SPAA 1997 Used in several.
Naming in Content-Oriented Architectures 1. select produce Data publishing RWINameKey Data own certify 2.
Chapter Five Distributed file systems. 2 Contents Distributed file system design Distributed file system implementation Trends in distributed file systems.
Chapter 5 Naming (I) Speaker : Jyun-Yao Huang 1 Application and Practice of Distributed Systems.
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED SYSTEMS.
BUFFALO: Bloom Filter Forwarding Architecture for Large Organizations Minlan Yu Princeton University Joint work with Alex Fabrikant,
Peer-to-Peer Data Management
Draft-forwarding-label-ccn-02.txt Ravi Ravindran, Asit Chakraborti, Aytac Azgin Huawei (IETF/ICNRG-95, Buenos Aires)
COS 461: Computer Networks
Internet Networking recitation #12
Accessing nearby copies of replicated objects
Database.
5.2 FLAT NAMING.
Edge computing (1) Content Distribution Networks
Distributed Systems CS
Distributed Systems CS
Mobile P2P Data Retrieval and Caching
Dynamic Replica Placement for Scalable Content Delivery
Ch 17 - Binding Protocol Addresses
An Architecture for Secure Wide-Area Service Discovery
Design and Implementation of OverLay Multicast Tree Protocol
Lin Xiao David A. Bryan Yingjie Gu Xuan Tai
Presentation transcript:

ETRI Bloom Filter-based Flat Name Resolution System for ICN ICNRG Interim meeting, Paris Jungha Hong, Woojik Chun, and Heeyoung Jung September 27, www.idnet.re.kr1

ETRI Contents Review of last draft Updated parts Implementation issues –False positive probability (FPP) –Bloom filter (BF) size www.idnet.re.kr2

ETRI Background In ICN, location independent and flat name is assumed The binding between name and locator is required for lookup-by-name routing –Name resolution system (NRS) –Maintains and resolves the bindings The most important challenge on designing NRS is scalability on the ever-increasing number of named data object (NDO) Bloom filter-based NRS (B-NRS) is proposed –We utilize the hierarchical structure of B-NRS and bloom filter Constructs a network of B-NRS servers, which consists of a forest by several disjoint trees Bloom filter as an aggregated form of names is announced instead of announcing the whole list of names

ETRI Bloom filter-based NRS (B- NRS) B-NRS structure A network of B-NRS servers Relationships of parent-child and peering B-NRS server components Peering : B-NRS Server Name lookup table Bloom filters (BFs) for its own, from child, and from peer BF for its own BF from child 1 BF from child 2 BF from peer 1 BF from peer 2 Announce to parents & peers Bitwise OR Lookup table NameLocator(s) Name 1 LOC 1 Name 2 LOC 2-1, LOC www.idnet.re.kr4 B-NRS server

ETRI Name registration (1) No constraints –Flat names can be registered to any arbitrary B-NRS server Followed by BF updates : insert-through No BF update when name is deleted –BF cannot handle deletion –Use periodic refresh www.idnet.re.kr5

ETRI Name registration (2) www.idnet.re.kr6 S1 S3 S2 S7 S6 S5 S4 Peering Registration BF Update S : B-NRS server

ETRI Locator update When a NDO presents(depresents) into(from) the network, only locator information is inserted(deleted) into(from) lookup table –No effects on BFs and structure of B-NRS –Inherently supports mobility www.idnet.re.kr7 NameLocator(s) N1LOC1 N2LOC2-1, LOC2-2 N3- N4LOC4-1, LOC4-2, LOC4-3

ETRI Lookup (1) Through the BF test for the given name, locator lookup request is forwarded into the B-NRS server where the binding is actually stored –BF is a role of forwarding table Request message is forwarded into all child and peers which return positive answers –If none of BFs returns positive answer, then it is forwarded into parent Reply takes the reverse path of the request www.idnet.re.kr8

ETRI Lookup (2) www.idnet.re.kr9 S1 S3 S2 S7 S6 S5 S4 Peering Request message Reply message Nack

ETRI Comparison with other NRS (1) www.idnet.re.kr10 NRS Distributed NRS DHT-based NRS -MF-DMap -SAIL-MDHT B-NRS Centralized NRS

ETRI Comparison with other NRS (2) www.idnet.re.kr11

ETRI Analysis of BF size and FPP n is the # of names in a BF m is the size of BF k is the # of hash functions In lower tier: –n=1K, m=8Kb  m/n = 8, k = 5.4  FPP = 0.02 (2%) 1K servers with 1K entries for each  1M entries  1MB memory for FPP=0.02 In higher tier: –n = 1M, m = 16Mb  m/n = 16, k =  FPP = (0.046%) 1M servers with 1M entries for each  1T entries  2TB memory for FPP= www.idnet.re.kr12

ETRI Can we reduce the amount of memory? Need to invent algorithm for –Insert, refresh, lookup Name  5(6) hash values  memory chunk –Structuring memory hierarchy (TCAM with DRAM) –Consider the possibility of using GPU www.idnet.re.kr13

ETRI Lookup www.idnet.re.kr14 BF for Child 1 BF for Child 2 BF for Child 3 BF for Child p BF for Peer 1 BF for Peer 2 BF for Peer q } All 1’s match List of Children & Peers BF for Name May implement with TCAM or GPU Multicast, Iterative, or Random Query Distribution BF for its own p children q peers

ETRI Design choice – ongoing work Same or different hash functions –Rehash in every server ? How many children and peers –Many servers have the limited no. of names How many levels (tiers) –Not so deep –Related with query distribution overhead H/W assisted implementation –TCAM or GPU –Performance for higher level server www.idnet.re.kr15

ETRI www.idnet.re.kr16 Questions or Comments