Personal Distributed Information Store Ken Rimey 1.6.2004 PDIS repository stores replicated collections of objects. Test applications: –Calendars (collections.

Slides:



Advertisements
Similar presentations
1 1999/Ph 514: Channel Access Concepts EPICS Channel Access Concepts Bob Dalesio LANL.
Advertisements

My first computer: The Apple ][ It wanted to be programmed.
WWG a Wide-Area Infrastructure for Groups Joan Manuel Marquès. Universitat Oberta de Catalunya (UOC) Leandro Navarro Universitat.
A Very Brief Introduction to iRODS
Page 1 Integrating Multiple Data Sources using a Standardized XML Dictionary Ramon Lawrence Integrating Multiple Data Sources using a Standardized XML.
Dynamo Highly Available Key-Value Store 1Dennis Kafura – CS5204 – Operating Systems.
ABCSG - Distributed Database 1 Data Management Distributed Database Data Replication.
Integrating data sources on the World-Wide Web Ramon Lawrence and Ken Barker U. of Manitoba, U. of Calgary
Tools and Services for the Long Term Preservation and Access of Digital Archives Joseph JaJa, Mike Smorul, and Sangchul Song Institute for Advanced Computer.
Team Collaboration across Business Value Chain – Approach of Internet Application Framework (IAF) Context Aware Collaboration in Mobile Enterprise Applications.
PENN Community Project SUG Presentation April 8, 2002.
Systems Architecture, Fourth Edition1 Internet and Distributed Application Services Chapter 13.
Archival Prototypes and Lessons Learned Mike Smorul UMIACS.
Dynamo: Amazon’s Highly Available Key-value Store Presented By: Devarsh Patel 1CS5204 – Operating Systems.
Digital Object: A Virtual Online Storage Solution 598C Course Project Huajing Li.
MAHI Research Database Data Validation System Software Prototype Demonstration September 18, 2001
Troubleshooting Replication and Geodata Services
Design and Implementation of a Module to Synchronize Databases Amit Hingher Reviewers: Prof. Dr. rer. nat. habil. Andreas Heuer Prof. Dr.-Ing. Hartmut.
Cognos TM1 Satya Mobile:
OASIS ebXML Registry Standard Open Forum 2003 on Metadata Registries 10:30 – 11:15 January 20, 2003 Kathryn Breininger The Boeing Company Chair, OASIS.
5.1 Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED.
Peer-to-Peer Data Integration Using Distributed Bridges Neal Arthorne B. Eng. Computer Systems (2002) Supervisor: Babak Esfandiari April 12, 2005 Candidate.
WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.
By Lecturer / Aisha Dawood 1.  You can control the number of dispatcher processes in the instance. Unlike the number of shared servers, the number of.
Fuego Future Mobile Computing Kimmo Raatikainen Helsinki Institute for Information Technology
Information Systems and Network Engineering Laboratory II DR. KEN COSH WEEK 1.
XML Registries Source: Java TM API for XML Registries Specification.
ILDG Middleware Status Chip Watson ILDG-6 Workshop May 12, 2005.
Some Design Notes Iteration - 2 Method - 1 Extractor main program Runs from an external VM Listens for RabbitMQ messages Starts a light database engine.
Adaptable Consistency Control for Distributed File Systems Simon Cuce Monash University Dept. of Computer Science and Software.
Implementing the XDS Infrastructure Bill Majurski IT Infrastructure National Institute of Standards and Technology.
Multi-Station and Fault Tolerance  A single computer controlling all features of the Home is problematic. –In multi-floor homes access to Home features.
FHIR Server Design Review Brian Postlethwaite HEALTHCONNEX October 2015.
Mobile Data Management Ken Rimey : Personal Distributed Information Store (PDIS) 2005-: Too Many Boxes - end-user digital asset management for.
Alternative Architecture for Information in Digital Libraries Onno W. Purbo
CS425 / CSE424 / ECE428 — Distributed Systems — Fall 2011 Some material derived from slides by Prashant Shenoy (Umass) & courses.washington.edu/css434/students/Coda.ppt.
From Digital Objects to Content across eInfrastructures Content and Storage Management in gCube Pasquale Pagano CNR –ISTI on behalf of Heiko Schuldt Dept.
DGC Paris WP2 Summary of Discussions and Plans Peter Z. Kunszt And the WP2 team.
EnsemBlue: Integrating Distributed Storage and Consumer Electronics Daniel Peek and Jason Flinn University of Michigan.
Write Conflicts in Optimistic Replication Problem: replicas may accept conflicting writes. How to detect/resolve the conflicts? client B client A replica.
DATABASE REPLICATION DISTRIBUTED DATABASE. O VERVIEW Replication : process of copying and maintaining database object, in multiple database that make.
Ubiquitous Access for Collaborative Information System Using SVG July Sangmi Lee, Geoffrey Fox, Sunghoon Ko, Minjun Wang, Xiaohong Qui
Eike Stepper Berlin, Germany CDO Model Repository Where Models Live SAP Modeling.
1 Channel Access Concepts – IHEP EPICS Training – K.F – Aug EPICS Channel Access Concepts Kazuro Furukawa, KEK (Bob Dalesio, LANL)
Institute for the Protection and Security of the Citizen HAZAS – Hazard Assessment ECCAIRS Technical Course Provided by the Joint Research Centre - Ispra.
Highly Available Services and Transactions with Replicated Data Jason Lenthe.
Esri UC 2014 | Demo Theater | Troubleshooting Replication and Geodata Service Issues Ken Galliher & Ben Lin.
Multimedia Retrieval Architecture Electrical Communication Engineering, Indian Institute of Science, Bangalore – , India Multimedia Retrieval Architecture.
Status of tests in the LCG 3D database testbed Eva Dafonte Pérez LCG Database Deployment and Persistency Workshop.
Ben - Gurion University Department Of Communication Systems Engineering DNS For Cell Phones Yoav Peer, Eugene Volchek Instructor: Dr. Chen Avin.
Information Systems and Network Engineering Laboratory I DR. KEN COSH WEEK 1.
Design and Implementation of a High-Performance distributed web crawler Vladislav Shkapenyuk and Torsten Suel Proc. 18 th Data Engineering Conf., pp ,
Detour: Distributed Systems Techniques
GeoNetwork OpenSource: Geographic data sharing for everyone
Information Systems and Network Engineering Laboratory II
Nomadic File Systems Uri Moszkowicz 05/02/02.
(on behalf of the POOL team)
Chapter 25: Advanced Data Types and New Applications
Flexible Extensible Digital Object Repository Architecture
Flexible Extensible Digital Object Repository Architecture
Database Access and Integration Services Working Group
Version Control System
CDO Model Repository Where Models Live
EECS 498 Introduction to Distributed Systems Fall 2017
EECS 498 Introduction to Distributed Systems Fall 2017
Event-Based Infrastructure for Reconciling Distributed Annotation Records Ahmet Fatih Mustacoglu Advisor: Prof. Geoffrey C. Fox.
Database Backup and recovery
Channel Access Concepts
Distributed Databases
Presentation transcript:

Personal Distributed Information Store Ken Rimey PDIS repository stores replicated collections of objects. Test applications: –Calendars (collections of calendar entries). –Digital media metadata. Two-year Tekes project ( ). Nokia, Movial, Fathammer, Innofactor. Commit

Device-to-Device Architecture We allow any number of replicas, which we treat as equals. Replicas are stored in repositories. Any repository can synchronize with any other. Changes propagate in epidemic fashion.

Immutable Object Versions Object versioning works well in distributed systems. PDIS headers encode the relationship between versions: –C supersedes B, –B supersedes C, or –B and C conflict. C B A B C A C B A CB A

Synchronization Synchronization is point-to-point. To bring disconnected replicas into sync: –Exchange IDs of current versions and fetch what is needed. –Optimize handling of large, almost identical data sets using hash trees (work in progress). To quickly propagate changes between connected repositories: –Use asynchronous change notification.

Flexible Conflict Resolution We have decided to decouple conflict resolution from synchronization: –Repositories can resolve simple conflicts immediately. –Client applications can resolve trickier conflicts. –Some conflicts must remain unresolved pending manual intervention. Must consistently arbitrate multiple attempts to resolve the same conflict.

Application-Independent Repository PDIS is a service, not just protocols: Objects are small XML documents. The repository wraps a native XML database. Client applications see an XPath live query interface: –Lazy query evaluation –Change notification

Digital Media Metadata Use a PDIS-based metadata repository to manage replicated digital media files. Specific test application: collaborative photo archive management. Main focus is on the underlying architecture for managing replicated immutable files.

PDIS on Symbian (PDOS) We are porting our Python prototype to Symbian OS in a separate, Nokia-funded project. Our first simple test application runs on the Nokia 6600 and talks to an external repository via GPRS. Next steps: –Move repository onto phone. –Use Bluetooth.