Download presentation
Presentation is loading. Please wait.
Published byMarvin Shelton Modified over 9 years ago
1
Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers MIT Libraries
2
cloud computing dynamic capacity: elastic high availability > storage: compute, database, more new programming model WOA - service bus in the sky lightweight protocols
3
problem space: replication replication != backup time decay of trust - needs maintenance coordination costs $$$$ who’s watching the detectives ? impermeable system boundaries sizing forecast uncertainty
4
reliable messaging enables asynchronous handling queue = list of messages coordination of work, non-persistent access controlled, encryptable cheap: $0.01 per 10k messages Amazon SQS + S3
5
roles decompose work into distinct replaceable agents archive = content home replicator = manages copies auditor = implements and enforces policy role != institution
6
process model a message queue for each role message post triggers activity asynchronously bucket brigade - message is a handoff or acknowledgment storage is abstracted (cloud in prototype)
7
workflow: replication archivereplicatorauditor S3
8
workflow: removal archivereplicatorauditor S3
9
workflow: audit archivereplicatorauditor S3
10
message semantics web-standard URI addressing entities: packages, ORE maps content model agnostic entity checksums for integrity standard identifiers for actors
11
self-managed deployment mit
12
peered deployment mitgatech
13
service provider deployment mitduracloudmit
14
todo plumbing only - replication requires more all policy definition and agreements OOB address business model content packaging/description expand skeletal prototype stress at scale
15
opportunities federated & large scale problems distributed registries metadata harvesting subject overlays preservation workflows, micro-services
16
thanks
17
extra credit
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.