European Archival Records and Knowledge Preservation E-ARK: half-way there! Kuldar Aas DLM Forum Members Meeting Riga, 17 June 2015
THE E-ARK PROJECT ISCO-FUNDED BY THE EUROPEAN COMMISSION UNDER THE ICT-PSPPROGRAMME
The usual facts E-ARK = European Archival Records and Knowledge Preservation ICT PSP Call 7 (May 2013), grant agreement no Duration: 36 months, – Instrument: Pilot B –No R&D, only customisation of already available tools –At least six months of piloting in real-life scenarios
E-ARK Objectives Reduce the cost of transfer, preservation and access to digital information by –Standardising how agencies export and send information to digital archives –Providing open formats for the long-term preservation of various content –Exploring needs for accessing archives and providing novel interfaces for these
E-ARK standards and tools Format specifications for data transfer, preservation and reuse (SIP, AIP, DIP) Workflows and requirements for data preparation (pre- ingest), ingest and access Individual open-source tools to cover specific workflows and specific access scenarios Special „showcase“ items: database denormalisation and data mining, scalable storage and computing Integrated Platform: ecosystem of tools which preservation organisations can use as a full digital repository Knowledge Center (as presented by Ricardo Vieira)
Ingest, Data Management and Archival Storage Access E-ARK SIP SIP Creation Tools (db-pres-toolkit, ET, UAM, RODA-in) Exported content Source System Export (Alfresco Export Module, db-pres- toolkit) SIP – AIP Conversion (EPP ingest) E-ARK AIP CMIS Interface Data Mining Interface Digital preservation systems (EPP; Preservica, Roda, NDBR) AIP - DIP Conversion Scalable Computation (Hadoop: HDFS, Lily) E-ARK DIP Archival Search, Access and Display Tools (SOFIA, QGIS) Content Management Systems (Wordpress?) Data Mining Showcase Pre-Ingest Finding Aid (ICA-Atom, Blacklight?) Faceted Search (Solr)
Timeline Setting the scene: –July 2014: Best practice overview (D3.1, D4.1, D5.1) Doing „the Work“ –April 2015: First versions of E-ARK format specifications (D3.2, D4.2, D5.2) Digital Preservation Maturity Model (D7.1) –June 2015: First versions of E-ARK workflow specifications –September 2015: First versions of E-ARK tools Consultation and update –Autumn – Winter 2015: Extensive consultation and feedback phase –April 2016: Pilot versions of E-ARK specifications and tools Running the pilots and final effort –April – September 2016: running seven pilots in six countries –January 2017: Final release of E-ARK specifications and tools
Ingest, Data Management and Archival Storage Access E-ARK SIP SIP Creation Tools (db-pres-toolkit, ET, UAM, RODA-in) Exported content Source System Export (Alfresco Export Module, db-pres- toolkit) SIP – AIP Conversion (EPP ingest) E-ARK AIP CMIS Interface Data Mining Interface Digital preservation systems (EPP; Preservica, Roda, NDBR) AIP - DIP Conversion Scalable Computation (Hadoop: HDFS, Lily) E-ARK DIP Archival Search, Access and Display Tools (SOFIA, QGIS) Content Management Systems (Wordpress?) Data Mining Showcase Pre-Ingest Finding Aid (ICA-Atom, Blacklight?) Faceted Search (Solr)
E-ARK SIP SIP Creation Tools (db-pres-toolkit, ET, UAM, RODA-in) Exported content Source System Export (Alfresco Export Module, db-pres- toolkit) Pre-Ingest Todays E-ARK presentations about: –E-ARK Common Specification (Karin Bredenberg) –E-ARK SIP format and pre-ingest workflow (Tarvo Kärberg) –ERMS export and SIP (Angela Dappert) –DB archiving (Jan Dalsten Sørensen) –Data mining and database denormalisation (Janet Delve)
Last but not least … E-ARK Advisory Boards are open to everybody!