NAMED DATA NETWORKING IN CLIMATE RESEARCH AND HEP APPLICATIONS CHEP2015, APRIL 16 2015, OKINAWA, JAPAN Susmit Shannigrahi*, Artur Barczyk^, Christos Papadopoulos*,

Slides:



Advertisements
Similar presentations
Tivoli SANergy. SANs are Powerful, but... Most SANs today offer limited value One system, multiple storage devices Multiple systems, isolated zones of.
Advertisements

Recent Developments in Logistical Networking Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab Computer Science Department.
Information-centric networking: Concepts for a future Internet David D. Clark, Karen Sollins MIT CFP November, 2012.
Supercharging PlanetLab : a high performance, Multi-Application, Overlay Network Platform Written by Jon Turner and 11 fellows. Presented by Benjamin Chervet.
MUNIS Platform Migration Project WELCOME. Agenda Introductions Tyler Cloud Overview Munis New Features Questions.
Serverless Network File Systems. Network File Systems Allow sharing among independent file systems in a transparent manner Mounting a remote directory.
Introduction to the Internet September 7, 2005 Lecture 1.
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS PRIMERGY Servers and Windows Server® 2008 R2 Benefit from an efficient, high performance and flexible platform.
Web Caching Schemes1 A Survey of Web Caching Schemes for the Internet Jia Wang.
1 GENI: Global Environment for Network Innovations Jennifer Rexford Princeton University
Positive Feedback Loops in DHTs or Be Careful How You Simulate January 13, 2004 Sean Rhea, Dennis Geels, Timothy Roscoe, and John Kubiatowicz From “Handling.
Midterm 2: April 28th Material:   Query processing and Optimization, Chapters 12 and 13 (ignore , 12.7, and 13.5)   Transactions, Chapter.
The new The new MONARC Simulation Framework Iosif Legrand  California Institute of Technology.
Improving Data Access in P2P Systems Karl Aberer and Magdalena Punceva Swiss Federal Institute of Technology Manfred Hauswirth and Roman Schmidt Technical.
PRASHANTHI NARAYAN NETTEM.
How the Internet Works Jon Crowcroft,
Distributed MapReduce Team B Presented by: Christian Bryan Matthew Dailey Greg Opperman Nate Piper Brett Ponsler Samuel Song Alex Ostapenko Keilin Bickar.
Proxy Servers Dr. Ronald Bergmann, CIO, ISO. Proxy servers A proxy server is a machine which acts as an intermediary between the computers of a local.
World Wide Web Caching: Trends and Technology Greg Barish and Katia Obraczka USC Information Science Institute IEEE Communications Magazine, May 2000 Presented.
Virtual Network Servers. What is a Server? 1. A software application that provides a specific one or more services to other computers  Example: Apache.
1 Introduction on the Architecture of End to End Multihoming Masataka Ohta Tokyo Institute of Technology
Microsoft Windows 2003 Server. Client/Server Environment Many client computers connect to a server.
Mapping Internet Addresses to Physical Addresses (ARP)
Database Services for Physics at CERN with Oracle 10g RAC HEPiX - April 4th 2006, Rome Luca Canali, CERN.
Sarah Edwards, GENI Project Office
The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Dataset Caitlin Minteer & Kelly Clynes.
Martin-1 CSE 5810 CSE 5810 Individual Research Project: Integration of Named Data Networking for Improved Healthcare Data Handling Robert Martin Computer.
Copyright © Clifford Neuman and Dongho Kim - UNIVERSITY OF SOUTHERN CALIFORNIA - INFORMATION SCIENCES INSTITUTE Advanced Operating Systems Lecture.
Let’s ChronoSync: Decentralized Dataset State Synchronization in Named Data Networking Zhenkai Zhu Alexander Afanasyev (presenter) Tuesday, October 8,
Thoughts on Future LHCOPN Some ideas Artur Barczyk, Vancouver, 31/08/09.
Kiew-Hong Chua a.k.a Francis Computer Network Presentation 12/5/00.
Enabling Peer-to-Peer SDP in an Agent Environment University of Maryland Baltimore County USA.
Architecture and ATLAS Western Tier 2 Wei Yang ATLAS Western Tier 2 User Forum meeting SLAC April
Kaleidoscope – Adding Colors to Kademlia Gil Einziger, Roy Friedman, Eyal Kibbar Computer Science, Technion 1.
NUOL Internet Application Services Midterm presentation 22 nd March, 2004.
Multimedia & Mobile Communications Lab.
Can We Talk Now? Technology Selection for an Intelligent Status Tracking System 5 th June 2009 Sidney Shek ( ) Supervisor:
6° of Darkness or Using Webs of Trust to Solve the Problem of Global Indexes.
ADVANCED COMPUTER NETWORKS Peer-Peer (P2P) Networks 1.
Tracking Malicious Regions of the IP Address Space Dynamically.
NAMED DATA NETWORKING: AN INTERNET ARCHITECTURE FOR THE FUTURE Christos Papadopoulos Colorado State University LHCOPN-LHCONE meeting, Oct 19, 2015, Amsterdam.
Information-Centric Networks Section # 3.2: DNS Issues Instructor: George Xylomenos Department: Informatics.
Introducing a New Concept in Networking Fluid Networking S. Wood Nov Copyright 2006 Modern Systems Research.
COS 420 Day 15. Agenda Finish Individualized Project Presentations on Thrusday Have Grading sheets to me by Friday Group Project Discussion Goals & Timelines.
CS 6401 Overlay Networks Outline Overlay networks overview Routing overlays Resilient Overlay Networks Content Distribution Networks.
Super Computing 2000 DOE SCIENCE ON THE GRID Storage Resource Management For the Earth Science Grid Scientific Data Management Research Group NERSC, LBNL.
Challenges in the Next Generation Internet Xin Yuan Department of Computer Science Florida State University
Characteristics of Scaleable Internetworks
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation featuring Named Data Networking Sarah Edwards.
Netprog: Chat1 Chat Issues and Ideas for Service Design Refs: RFC 1459 (IRC)
Overview on Web Caching COSC 513 Class Presentation Instructor: Prof. M. Anvari Student name: Wei Wei ID:
Network Devices and Firewalls Lesson 14. It applies to our class…
COMPUTER NETWORKS Quizzes 5% First practical exam 5% Final practical exam 10% LANGUAGE.
1 © 2007 Cisco Systems, Inc. All rights reserved.Cisco Public Network Architecture Characteristics  Explain four characteristics that are addressed by.
Mobility With IP, implicit assumption that there is no mobility. Addresses -- network part, host part -- so routers determine how to get to correct network.
NFV Group Report --Network Functions Virtualization LIU XU →
Server Upgrade HA/DR Integration
Solutions for Fourth Quiz
Implementation of GPU based CCN Router
Manchester HEP group Network, Servers, Desktop, Laptops, and What Sabah Has Been Doing Sabah Salih.
Named Data Networking in science Applications
Subnetting Basics benefits Reduced network traffic
Chat Refs: RFC 1459 (IRC).
Content Distribution Networks
AWS Cloud Computing Masaki.
Distributed Hash Tables
One-slide Research Overview
Chord and CFS Philip Skov Knudsen
EE 122: Lecture 22 (Overlay Networks)
SANDIE: Optimizing NDN for Data Intensive Science
Presentation transcript:

NAMED DATA NETWORKING IN CLIMATE RESEARCH AND HEP APPLICATIONS CHEP2015, APRIL , OKINAWA, JAPAN Susmit Shannigrahi*, Artur Barczyk^, Christos Papadopoulos*, Alex Sim**, Inder Monga**, Harvey Newman ^, John Wu**, Edmund Yeh # *Colorado State University, ** LBNL, ^California Institute of Technology, # Northeastern University

1 The NDN Project  Part of the NSF Future Internet Architecture initiative  One of four multi-institution projects funded in , ~$8M  Now in the second round of funding, , ~$6M  Goal: design the next generation Internet Architecture 1

2 NDN Institutions – Past and Present 

3 Today’s Internet  To find content in the network ..you have to learn where the content is ..and then ask the network to take you there ..so you can tell the server what you want  In other words, the Internet is like an old GPS! Latitude: ° Longitude: °

4 But Things Often Fail Often the content is not there....or the path is too congested!

5  Instead of taking you where you think the content is.. ..the network could get the content for you! ..in the most efficient way! What if the Network was Smarter And you could tell it what you want! How do we make the network smarter? Ask what you want by its name, not address

6 Named Data Network (NDN)  The new idea: Name the data, not the hosts! ..so you can ask the network directly for the data!

7  In the Internet you secure your path.. ..but the server may still be hacked! Named Data is Easy to Secure  In NDN you sign the data with a digital signature.. ..so the users know when they get bad data!

8 Named Data Can be Cached Cache The network caches the data for you because it can answer similar questions later Data is naturally cached to locations of high demand Caching becomes the network operator’s problem!

9 Robustness to Site Failure 9 Cache Failover in a named data network happens automatically without application involvement

10 This Sounds Awfully Complex.. It’s not! It’s actually quite simple:  First, name your datasets with a hierarchical, community agreed name:  /store/mc/fall13/BprimeBprime_M_3000/GEN-SIM/POSTLS162_v1- v2/10000 /  Then, advertise the prefix to the network:  I can answer any questions starting with:  /store/mc/fall13/BprimeBprime_M_3000/GEN-SIM/POSTLS162_v1- v2/*  Finally, let users issue interests with the appropriate name or name prefix 10

11 Example: xrootd Cluster /my/file 3: I DO! 1: open(“/my/file”)4: Try open() at A 5: open(“/my/file”) Data Servers Manager (a.k.a. Redirector) Client cmsdxroot d cmsdxroot d cmsdxroot d cmsdxroot d Who has “/my/file”? 2: Who has “/my/file”? ABC Here is how xrootd works today:

12 xrootd under NDN 12 /my/file Data Servers Client cmsdxroot d cmsdxroot d cmsdxroot d ABC NDN Network myfile? myfile myfile? No manager, fewer steps, more robust

13 NDN Simplifies Networking IPNDN DNSCachingLoad Balancing AddressingDiscovery Naming FailoverSecurity NDN let’s you focus on the science not the plumbing!

14 NDN in Our Climate Testbed 14

15 Current State of NDN  Climate testbed hardware: six state of the art Dell PE720xd servers with 10G fiber connections throughout  20 cores, 128GB RAM, 48TB local storage  Cisco and others currently building specialized routers  Washington University implementing forwarding algorithms that support lookups at 1B prefixes at line speed 15

16 Optimized NDN for LHC Network  NDN can automatically and dynamically cache “hot” files near users for lower delay  VIP algorithm: optimal interest forwarding and cache placement/replacement  76% lower latency over no caching Yeh et al. 2014

17 Conclusions  In HEP, mistakes are expensive.. ..hard to do course correction midstream.. ..so better get it right the first time!  NDN frees up resources for more intelligent networks.. ..to reduce waste contact: No, I meant turn left..