1 U.S. Department of the Interior U.S. Geological Survey A Cognitive Agent Based Geospatial Data Distribution System 12 May 2006.

Slides:



Advertisements
Similar presentations
What is OceanStore? - 10^10 users with files each - Goals: Durability, Availability, Enc. & Auth, High performance - Worldwide infrastructure to.
Advertisements

Welcome to DEAS 2005 Design and Evolution of Autonomic Application Software David Garlan, CMU Marin Litoiu, IBM CAS Hausi A. Müller, UVic John Mylopoulos,
Autonomic Systems Justin Moles, Winter 2006 Security in an Autonomic Computing Environment Paper by: D. M. Chess, C. C. Palmer S. R. White Presentation.
Fundamentals of Information Systems, Second Edition 1 Telecommunications, the Internet, Intranets, and Extranets Chapter 4.
Fabián E. Bustamante, Winter 2006 Autonomic Computing The vision of autonomic computing, J. Kephart and D. Chess, IEEE Computer, Jan Also - A.G.
Digital Rights Management © Knowledge Books & Software, 2012.
Yingping Huang and Gregory Madey University of Notre Dame A W S utonomic eb-based imulation Presented by Tariq M. King Published by the IEEE Computer Society.
U.S. Department of the Interior U.S. Geological Survey National Geospatial Technical Operations Center Towards a More Consistent Framework for Disseminated.
Open Workshop on e-Infrastructures, Helsinki October 4 – 5, 2006 Roadmap Parallel Session on last chapter of e-IRG Roadmap: Crossing the Boundaries of.
Option 2: The Oceanic Data Utility: Global-Scale Persistent Storage John Kubiatowicz.
Distributed Service Architectures Yitao Duan 03/19/2002.
Autonomic Computing Shafay Shamail Malik Jahan Khan.
William Y. Arms Corporation for National Research Initiatives March 22, 1999 Object models, overlay journals, and virtual collections.
EEC-681/781 Distributed Computing Systems Lecture 3 Wenbing Zhao Department of Electrical and Computer Engineering Cleveland State University
OceanStore: Data Security in an Insecure world John Kubiatowicz.
An Agent-Oriented Approach to the Integration of Information Sources Michael Christoffel Institute for Program Structures and Data Organization, University.
Introduction to the new mainframe: Large-Scale Commercial Computing © Copyright IBM Corp., All rights reserved. Chapter 8: Autonomic computing.
Concurrency Control & Caching Consistency Issues and Survey Dingshan He November 18, 2002.
OceanStore/Tapestry Toward Global-Scale, Self-Repairing, Secure and Persistent Storage Anthony D. Joseph John Kubiatowicz Sahara Retreat, January 2003.
1 Secure Zero Configuration in a Ubiquitous Computing Environment Shenglan Hu and Chris J. Mitchell Information Security Group Royal Holloway, University.
OceanStore An Architecture for Global-Scale Persistent Storage Motivation Feature Application Specific Components - Secure Naming - Update - Access Control-
Corporation For National Research Initiatives NSF SMETE Library Building the SMETE Library: Getting Started William Y. Arms.
Data and Applications Security Developments and Directions Dr. Bhavani Thuraisingham The University of Texas at Dallas Secure Knowledge Management: and.
Bandwidth DoS Attacks and Defenses Robert Morris Frans Kaashoek, Hari Balakrishnan, Students MIT LCS.
Data-PASS Shared Catalog Micah Altman & Jonathan Crabtree 1 Micah Altman Harvard University Archival Director, Henry A. Murray Research Archive Associate.
1 Autonomic Computing An Introduction Guenter Kickinger.
Component 4: Introduction to Information and Computer Science Unit 8: Security Lecture 2 This material was developed by Oregon Health & Science University,
WELCOME. AUTONOMIC COMPUTING PRESENTED BY: NIKHIL P S7 IT ROLL NO: 33.
B. McLeod CCRS Evolution of the Canadian Geospatial Data Infrastructure (CGDI)
Nationally Significant Databases and Collections Providers’ Group Emma Kelly Environmental Information Advisor Environmental Monitoring and Reporting Team.
U.S. Department of the Interior U.S. Geological Survey The National Map in North Dakota The National Map in North Dakota Ron Wencl State Mapping Liaison.
Metadata and Geographical Information Systems Adrian Moss KINDS project, Manchester Metropolitan University, UK
Fundamentals of Information Systems, Second Edition 1 Telecommunications, the Internet, Intranets, and Extranets.
SWIM-SUIT Information Models & Services
Advanced Computer Networks Topic 2: Characterization of Distributed Systems.
ArcGIS Server for Administrators
Privacy, Confidentiality, and Security Unit 8: Professional Values and Medical Ethics Lecture 2 This material was developed by Oregon Health & Science.
Adaptive Web Caching CS411 Dynamic Web-Based Systems Flying Pig Fei Teng/Long Zhao/Pallavi Shinde Computer Science Department.
OS Services And Networking Support Juan Wang Qi Pan Department of Computer Science Southeastern University August 1999.
Multimedia & Mobile Communications Lab.
THE VISION OF AUTONOMIC COMPUTING. WHAT IS AUTONOMIC COMPUTING ? “ Autonomic Computing refers to computing infrastructure that adapts (automatically)
The Story of at the Alaska State Library Presented by Sheri Somerville Alaska State Library March 14, 2009.
U.S. Department of the Interior U.S. Geological Survey The National Map Mark L. DeMulder Director, National Geospatial Program.
Cartographic Users Advisory Council The National Spatial Data Infrastructure and the Geospatial One Stop E-Gov Initiative May 3, 2002 John Moeller Staff.
Security Vulnerabilities in A Virtual Environment
Fundamentals of Information Systems, Second Edition 1 Telecommunications, the Internet, Intranets, and Extranets.
The Personal Server Changing the Way We Think About Ubiquitous Computing Roy Want, et al. / Intel Research UBICOMP 2002 Nov Seungjae Lee
1 © NOKIA WWRF-Reference-Framework.PPT/ 26 June 2002 / Kimmo Raatikainen WWRF Reference Framework Nokia’s Perspective WWRF WG2 Meeting 26 June 2002 Kimmo.
Lifecycle Metadata for Digital Objects November 15, 2004 Preservation Metadata.
Company LOGO Network Management Architecture By Dr. Shadi Masadeh 1.
Text Information Management ChengXiang Zhai, Tao Tao, Xuehua Shen, Hui Fang, Azadeh Shakery, Jing Jiang.
Rights Management for Shared Collections Storage Resource Broker Reagan W. Moore
Dsitributed File Systems
Understanding IT Infrastructure Lecture 9. 2 Announcements Business Case due Thursday Business Analysis teams have been formed Business Analysis Proposals.
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
Fedora Commons Overview and Background Sandy Payette, Executive Director UK Fedora Training London January 22-23, 2009.
IPv6 Security Issues Georgios Koutepas, NTUA IPv6 Technology and Advanced Services Oct.19, 2004.
AUTONOMIC COMPUTING B.Akhila Priya 06211A0504. Present-day IT environments are complex, heterogeneous in terms of software and hardware from multiple.
Grid Services for Digital Archive Tao-Sheng Chen Academia Sinica Computing Centre
OceanStore : An Architecture for Global-Scale Persistent Storage Jaewoo Kim, Youngho Yi, Minsik Cho.
Clouding with Microsoft Azure
Chapter 1 Characterization of Distributed Systems

Building Distributed Educational Applications using P2P
Introduction to Data Management in EGI
Management of Virtual Execution Environments 3 June 2008
OceanStore: Data Security in an Insecure world
Content Distribution Network
Outline for today Oceanstore: An architecture for Global-Scale Persistent Storage – University of California, Berkeley. ASPLOS 2000 Feasibility of a Serverless.
Presentation transcript:

1 U.S. Department of the Interior U.S. Geological Survey A Cognitive Agent Based Geospatial Data Distribution System 12 May 2006

2 The National will have an infrastructure that is an information society that stimulates the economy, improves environmental health, and increases the general Welfare of the Nation by communicating geographic science and enabling problem solving within its communities. Geospatial Infrastructure - A possible vision of the future...

3 It's All in the GOALS or.. I'm not a { } It is in fact in choosing the goal of what to design which is where experts make their mistakes. Amateur designers will get the details wrong because they just don't have the professional mastery. Experts will typically get the details right, put a lot of polish on the design and get the whole project wrong. from : The Design of Design, Frederick P. Brooks, 1999 ACM Turing Award Lecture Cartographer Geographer Computer Scientist Here is where experts go wrong: Miss fresh vision – e.g., microcomputer revolution Vision not high enough – e.g., OS/360 JCL

4 The Design Problem The infrastructure is a logistics problem! How to: allocate and marshal resources recover from component failure monitor performance manage intellectual property rights control the system

5 Core members providing governance and persistence Mgt. & Governance Provider Communities Problem Solving Communities Gov’t NGO Comm. Archive Partners Gov’t NGO Comm. Archive Homeland Security Education Elevation Data Road Data Orthoimagery NavTech Local State Census Affiliates USGS Local Library Of Congress NGA FEMA NAIP ESRI Law Enforcement 5

6 A Business Partner utilizing The infrastructure NGA DHS Network Operations Center PKI Archive Services Support Services Core Members Deep Archives Commercial Archive

Communities Affiliates Firewall Access Restrictions User X Not Allowed Partners Gov’t NGO Comm. Archive Core OK! Mgt. & Governance Federal User SpecialAccessArrangements FISMA and The Business Model USGS as an affiliate 7

8 The Infrastructure Should NOT Be … ● A geographic information system ● A decision support system ● A library of links to other's data ● An information discovery system ● Web mapping application ● Monolithic

9 The Infrastructure Should Be ● An information society ● Marketplace ● A framework for delivery of products and services ● A framework for archiving quality-controlled spatial information ● Focused on geographic problem solving ● A system of systems

10 Information Characteristics ● Durable – does not change over time ● Persistent – does not disappear ● Ubiquitous – available everywhere needed ● Access Managed – controlled IP rights (DRM) ● Authorize – known users ● Authoritative Content – The correct data

11 Rights Content Creator Owns Over Usage Type Digital Rights Management Architecture Core Entities Model After: Lannella, Renato Digital Rights Management (DRM) Architectures, D-Lib Magazine, June 2001 User

12 System Requirements for The Infrastructure ● Geographic independence for availability, durability, partnerships, and resistance to failure. ● Encryption for privacy, signatures for authenticity, and Digital Rights Management. ● Redundancy with continuous repair and redistribution for long-term durability. ● Automatic optimization, diagnosis and repair.

13 Network Architectural Elements Network Layer Router Host Transport Layer Method Request Layer 13

14 Characteristics needed by The Infrastructure ●Partners bring multiple organizational management structures ●Can’t possibly manage large numbers of affiliate servers by hand! ●System should automatically: –Adapt to failure of individual components –Repair itself –Allow affiliates to join and leave without prior notice –Adapt to changes in demand and regional outages

15 Characteristics needed by The Infrastructure ●Guarantee data is available for 100s of years (multiple generations): –New servers added from time to time –Old servers removed from time to time –Affiliates can self associate (join and leave) ●Redundant components with geographic separation –System not disabled by natural or man-made disasters – Gain in stability through statistics

16 Characteristics needed by The Infrastructure ●Untrusted Infrastructure: –Comprised of untrusted components –Only cipher text within the infrastructure ●Mostly Well - Connected : –Data producers and consumers are connected to a high- bandwidth network most of the time –Exploit multicast for quicker consistency when possible –Provide for unconnected operation

17 Characteristics needed by The Infrastructure ●Nomadic Data: – Promiscuous caching data can be cached anywhere, anytime – Floating replicas object replicas independent of the server they reside on – Optimize locality and to trade off consistency for availability ●Infrastructure should disappear into the background: –Don’t want to worry about backup. –Don’t want to worry about obsolescence. ●Need lots of resources to make data secure and highly available, BUT don’t want to own them.

18 Autonomic Computing Requirements for the Infrastructure ● Self-configuring Adapt automatically to dynamically changing environments ● Self-optimizing Monitor and tune resources automatically – plan for execution ● Self-protecting Anticipate, detect, identify, and protect against attacks from anywhere ● Self-healing Discover, diagnose, and react to disruptions

19 An Architecture for The Infrastructure Plug-ins Blackboard (PLAN) Agent Publish Subscribe Message Queue Plug-ins Blackboard (PLAN) Agent Publish Message Queue GIS System Viewer Planner Subscribe Executor Control White Pages Yellow Pages Data Catalogue Affiliate Core Services Core Members Affiliate

20 For more information: ●OceanStore vision paper for ASPLOS 2000 “OceanStore: An Architecture for Global-Scale Persistent Storage” ●OceanStore web site: ●Cougaar web site: ●Fedora web site:

21