1. General Model of E-ARK Services
Istvan Alföldi
National Archives of Hungary
DLM Forum Members’ Meeting June 2014, Athens

2. E-ARK General Model Conceptual framework Used methodology
Agenda
E-ARK General Model
Conceptual framework
Used methodology
Results (not final)

3. General Model of E-ARK Services
”The scope of the E-ARK service is to provide a reference implementation, which integrates these currently non-interoperable tools into a replicable and scalable, common seamless workflow, allowing data owners and repositories to flexibly select and use the components most relevant for their specific situations. To achieve this, a set of common interfaces and information package formats will be defined by the E-ARK project and implemented using these tools.” (E-ARK DoW Part B Finalised version B1.3)
”The scope of the E-ARK service is to provide a reference implementation, which integrates these currently non-interoperable tools into a replicable and scalable, common seamless workflow, allowing data owners and repositories to flexibly select and use the components most relevant for their specific situations. To achieve this, a set of common interfaces and information package formats will be defined by the E-ARK project and implemented using these tools.” (E-ARK DoW Part B Finalised version B1.3)
”The scope of the E-ARK service is to provide a reference implementation, which integrates these currently non-interoperable tools into a replicable and scalable, common seamless workflow, allowing data owners and repositories to flexibly select and use the components most relevant for their specific situations. To achieve this, a set of common interfaces and information package formats will be defined by the E-ARK project and implemented using these tools.” (E-ARK DoW Part B Finalised version B1.3)

4. OAIS Reference Model Data and Content Management Producer Consumer
e-Document Archive
queries
result sets
Pre-Ingest
Ingest
Access
orders
SIP
AIP
AIP
DIP
Preservation Planning
Archival Storage
Administration

5. Preservation Planning
Conceptual Framework
Pre-Ingest
Ingest
Archival Storage
Preservation Planning
Administration
Data Management
Access
Recommended Practices
Processes and Use cases
Tools and Interfaces
Standards and Format Definitions

6. Conceptual Framework – Standards and Format Definitions
Pre-Ingest
Ingest
Archival Storage
Preservation Planning
Administration
Data Management
Access
Standards and Format Definitions
OAIS, METS, ISAD(G), Moreq2010, PREMIS, SIARD, CMIS, Bagit, InterPARES 2, EAD, EAD-CPF, etc.
E-ARK
SIP
SIP
AIP
E-ARK
AIP
DIP
E-ARK
DIP

7. Preservation Planning
Conceptual Framework
Pre-Ingest
Ingest
Archival Storage
Preservation Planning
Administration
Data Management
Access
Recommended Practices
Processes and Use cases
Tools and Interfaces
Standards and Format Definitions

8. Conceptual Framework – Tools and Interfaces
Pre-Ingest
Ingest
Archival Storage
Preservation Planning
Administration
Data Management
Access
Tools and Interfaces (already established)
DMS
RMS
Content and Records Management System
Alfresco
CMIS interface
Archival Repository
ESSArch Preservation Platform (EPP) , Safety Deposit Box (SDB), RODA, The National Danish Bit Repository (NDBR) DB
E-ARK
SIP
E-ARK
AIP
E-ARK
DIP
SOFIA
Scalable Computation Staging Area
Lily
ET, DBExport,
UAM, RODA-in
Apache Hadoop

9. Conceptual Framework – Tools and Interfaces
Pre-Ingest
Ingest
Archival Storage
Preservation Planning
Administration
Data Management
Access
Tools and Interfaces (to be developed)
AIP-DIP Conversion Comp.
Search, Access
and Display
Interface
SIP Creation Tools
SIP-AIP Conversion Component
DMS
RMS
Content and Records Management System
Alfresco
CMIS interface
Archival Repository
ESSArch Preservation Platform (EPP) , Safety Deposit Box (SDB), RODA, The National Danish Bit Repository (NDBR) DB
E-ARK
SIP
E-ARK
AIP
E-ARK
DIP
SOFIA
Scalable Computation Staging Area
Lily
ET, DBExport,
UAM, RODA-in
Data Mining Showcase
Apache Hadoop

10. Conceptual Framework – Tools and Interfaces
Pre-Ingest
Ingest
Archival Storage
Preservation Planning
Administration
Data Management
Access
Tools and Interfaces (to be developed)
AIP-DIP Conversion Comp.
Search, Access
and Display
Interface
SIP Creation Tools
SIP-AIP Conversion Component
DMS
RMS
Content and Records Management System
Alfresco
CMIS interface
Archival Repository
ESSArch Preservation Platform (EPP) , Safety Deposit Box (SDB), RODA, The National Danish Bit Repository (NDBR) DB
E-ARK
SIP
E-ARK
AIP
E-ARK
DIP
SOFIA
Scalable Computation Staging Area
Lily
ET, DBExport,
UAM, RODA-in
Data Mining Showcase
Apache Hadoop

11. Preservation Planning
Conceptual Framework
Pre-Ingest
Ingest
Archival Storage
Preservation Planning
Administration
Data Management
Access
Recomended Practices
Processes and Use cases
Tools and Interfaces
Standards and Format Definitions

12. Conceptual Framework – Processes and Use Cases
Process and Use Case Diagrams
Producer
Create SIP
GM-PI-6
Start transfer to archive
GM-PI-7
SIP
SIP Creator
(WP3)
UAM
RODA
ESSArch

13. Conceptual Framework – Processes and Use Cases
Process Diagrams

14. Conceptual Framework – Processes and Use Cases
Business Process Modeling Notation (BPMN)
Process Flow
Participant role
Activity

15. Conceptual Framework – Processes and Use Cases
Business Process Modeling Notation (BPMN)
Collapsed view

16. Conceptual Framework – Processes and Use Cases
Standard Process Diagrams (BPMN)
Detail view

17. Conceptual Framework – Processes and Use Cases
Use Case Diagrams
Producer
Create SIP
GM-PI-6
Start transfer to archive
GM-PI-7
SIP
SIP Creator
(WP3)
UAM
RODA
ESSArch
Used tool
Activity
Participant role
Input / Output

18. Conceptual Framework – Processes and Use Cases
Producer
Create SIP
GM-PI-6
Start transfer to archive
GM-PI-7
SIP
SIP Creator
(WP3)
UAM
RODA
ESSArch
Who does what?
In what order?
Using what kind of tool?
Required input?
Produced output?

19. Preservation Planning
Conceptual Framework
Pre-Ingest
Ingest
Archival Storage
Preservation Planning
Administration
Data Management
Access
Recomended Practices
Processes and Use cases
Tools and Interfaces
Standards and Format Definitions

20. Preservation Planning
Conceptual Framework
Pre-Ingest
Ingest
Archival Storage
Preservation Planning
Administration
Data Management
Access
Recomended Practices
To be added according to the
experiences of the Pilots

21. Used Methodology and Schedule
Surveys
Questionnaire 1 (11 February, 2014)
Infrastructure overview
Process overview
Data overview
Questionnaire 2 (3 March, 2014)
Detailed process information
Detailed tool description
General high-level requirements
Input data profile survey (30 May, 2014)
Draft model and Discussion
Draft model sent out (26 May, 2014)
Comments in
E-ARK technical meeting (12-13 June 2014, Athens)
Final model and approval (July 2014)

22. Results – Processes and Use cases
Pre-Ingest

23. Results – Processes and Use cases
Producer
Select data (manual)
GM-PI-3
Define SIP content
GM-PI-1
Select data (with rules)
GM-PI-2
Create SIP
GM-PI-6
Extract data from DB
GM-PI-4
Extract data from DMS/RMS
GM-PI-5
Start transfer to archive
GM-PI-7
SIP DB
DMS/RMS
DBExport
ESSArch
Alfresco
RODA
SIP Creator
(WP3)
UAM
Pre-Ingest

24. Results – Processes and Use cases
Ingest

25. Results – Processes and Use cases
Ingest
Technical stuff
Start AIP generation
workflow
GM-I-2
Upload SIP
GM-I-1
SIP
E-ARK
AIP
ESSArch PP
RODA
SDB
E-ARK SIP  AIP tool

26. Results – Processes and Use cases
Data Management

27. Results – Processes and Use cases
Data Management
Archivist
Select records to export
GM-DM-1
GM-DM-2
Manipulate records
GM-DM-3
Start export workflow
Archivee
CMIS
Lily

28. Results – Processes and Use cases
Access

29. Results – Processes and Use cases
Access
End user (Consumer)
Download DIP
GM-A-8
Search and select data
GM-A-1
Request data
GM-A-2
Archivee
AIP
E-ARK
Request access from presentation platform
GM-A-3
Presentation / Data
Mining Platform

30. General Model – Work package overview

31. General Model – Pilot overview

32. Cross Reference Tables – Use case view

33. Cross Reference Tables – Tools view

34. Thank you!