Download presentation
Presentation is loading. Please wait.
1
VORB Virtual Object Ring Buffers
ROADNet Project Arcot Rajasekar
2
Motivation How can I acquire my RT data?
How can I discover/access my RT data? How can I share/integrate the data? Can I integrate dynamically? Can I share with other disciplines? Can I integrate seamlessly with data from other disciplines Can I integrate wth static data?
3
Realtime Data Acqusition Requirements
Data Acquisition Data Communications Data and Information Buffering Data and Information Flow Automated Data Processing Automated Data and Information Archiving Real-Time Data and Information Integration, Distribution and Sharing Real-Time System Monitoring and Control Real-Time Graphical User Interfaces
4
VORB Aims Requirements Virtualized Access to Real Time Data Streams
Virtualized Integration of Real Time Data Multiple VORBs Private Virtual Real Time Data Management Private VORBs Rapidly Configurable RT Data Networks Demand-driven Reconfigurable VORB Requirements Federated Resource Brokering Metadata Catalog Rule-driven Data Aquisition and Integration Extensible ORBs
5
What is VORB? VORB = ORB + SRB ORB: Object Ring Buffer
SRB: Storage Resource Broker
6
Object Ring Buffer A server-client approach for managing the ring buffer (server is orbserver) Multiple simultaneous read and/or write clients Clients can be anywhere that is network reachable Data packets may be of any size, format, information content (all within the same ORB) Highly robust and error-free
7
Antelope Real-Time System
8
Seismic Information System
9
IGPP Real-Time Systems
ANZA Seismic Network (1981-present) 13 Broadband Stations 3 Borehole Strong Motion Arrays 5 Infrasound Stations 1 Bridge Monitoring System Kyrgyz Seismic Network (1991-present) 10 Broadband Stations IRIS PASSCAL Transportable Array (1997-Present) Broadband and Short Period Stations IDA Global Seismic Network (~1990 -Present) 38 Broadband Stations
10
SRB SDSC Storage Resource Broker & Meta-data Catalog Archives
HPSS, ADSM, UniTree, DMF Databases DB2, Oracle, Sybase File Systems Unix, NT, Mac OSX Application C, C++, Linux I/O Unix Shell Dublin Core Resource, User Defined Meta-data Remote Proxies DataCutter Third-party copy Java, NT Browsers Web Prolog Predicate MCAT HRM 18
11
Virtual Data Grid (SRB)
Features SRB Resource Transparency Local or Remote, Resource Type & Access Method Location Transparency Path Names, Schemas, Containers Cross-Domain Authentication Rich Access Control User Transparency Uniform User Name Space Uniform Data Name Space Segmented & Replicated Data Management Data Discovery User-defined Metadata Virtual Data Grid (SRB) MCAT Duke UCLA NCMIR CalTech SDSC
12
SRB Projects Digital Libraries NASA Information Power Grid
UCB, Umich, UCSB, Stanford,CDL NSF NSDL - UCAR / DLESE NASA Information Power Grid DOE ASCI Data Visualization Corridor Astronomy National Virtual Observatory 2MASS Project (2 Micron All Sky Survey) Particle Physics Particle Physics Data Grid (DOE) GriPhyN SLAC Synchrotron Data Repository Medicine Digital Embryo (NLM) Earth Systems Sciences ESIPS LTER Persistent Archives NARA LOC Neuro Science & Molecular Science TeleScience/NCMIR, Brain Images, BIRN SLAC, AfCS, …
13
VORB- A Real Time DataGrid Architecture
Aim #1: Virtualized Access to Real Time Data Streams Hide Physical Aspects of RTD Resources Handling Heterogeneity of Resources Plug and Play Uniform Protocol & API Common Authentication & Authorization Replication, Fault Tolerance, Load Distribution Caching, Scheduling, Data Placement Uniform Name Space – Persistence & Discovery
14
Federated VORB Aim #2: Virtualized Integration of Real Time Data
Integrate packets from multiple data streams Heterogeneous & Distributed RT Data Resources Hide Logical Aspects of VORB-accessed Resources Virtualized Schema Rule-based Integration Uniform Protocols & API Metadata-based Discovery
15
MyVORB Architecture Aim #3: Private Virtual Real Time Data Management
Configurable Integration Information Discovery Programmable Methods and Active Rules
16
Demand VORB Aim #4: Rapidly Configurable RT Data Networks
Based on situation and demands More sensors activated/brought online Changing VORB Federation Rapid Information Publication Fault tolerance
17
VORB Components VORB Archive Event-Condition- Action Rules Cat
Rule Engine SrcORB Client/App. virtual data transfer (ctrl msgs) actual data transfer
18
VORB Active Rule Engine
Archive SrcORB Client/App. ORB VORB Cat SrcORB Client/App. VORB Rule Engine Event-Condition- Action Rules SRC Events USR Events Condition Evaluation
19
Summary and Outlook VORB use cases!
VORB requirements and specification Design of event, condition, and action sublanguages for RT data Design of rule evaluation algorithm Implementation
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.