Presentation is loading. Please wait.

Presentation is loading. Please wait.

Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers MIT Libraries.

Similar presentations


Presentation on theme: "Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers MIT Libraries."— Presentation transcript:

1 Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers MIT Libraries

2 cloud computing dynamic capacity: elastic high availability > storage: compute, database, more new programming model WOA - service bus in the sky lightweight protocols

3 problem space: replication replication != backup time decay of trust - needs maintenance coordination costs $$$$ who’s watching the detectives ? impermeable system boundaries sizing forecast uncertainty

4 reliable messaging enables asynchronous handling queue = list of messages coordination of work, non-persistent access controlled, encryptable cheap: $0.01 per 10k messages Amazon SQS + S3

5 roles decompose work into distinct replaceable agents archive = content home replicator = manages copies auditor = implements and enforces policy role != institution

6 process model a message queue for each role message post triggers activity asynchronously bucket brigade - message is a handoff or acknowledgment storage is abstracted (cloud in prototype)

7 workflow: replication archivereplicatorauditor S3

8 workflow: removal archivereplicatorauditor S3

9 workflow: audit archivereplicatorauditor S3

10 message semantics web-standard URI addressing entities: packages, ORE maps content model agnostic entity checksums for integrity standard identifiers for actors

11 self-managed deployment mit

12 peered deployment mitgatech

13 service provider deployment mitduracloudmit

14 todo plumbing only - replication requires more all policy definition and agreements OOB address business model content packaging/description expand skeletal prototype stress at scale

15 opportunities federated & large scale problems distributed registries metadata harvesting subject overlays preservation workflows, micro-services

16 thanks

17 extra credit


Download ppt "Cloud Task Replica Repository Preservation Tools Open Repositories 2009 - Atlanta Richard Rodgers MIT Libraries."

Similar presentations


Ads by Google