12-13. May 2011DLM Forum, Budapest1 The First OAIS-compliant Ingest of Digital Records Zoltán Lux The National Archives of Hungary web:www.mol.gov.hu.

Slides:



Advertisements
Similar presentations
Long-Term Preservation. Technical Approaches to Long-Term Preservation the challenge is to interpret formats a similar development: sound carriers From.
Advertisements

© 2009 Oracle Corporation Oracle APEX Forms Conversion Overview.
The future’s so bright…. DAITSS DIGITAL PRESERVATION SYSTEM: RE-ARCHITECTED, RE- WRITTEN, AND OPEN SOURCE Priscilla Caplan Florida Center for Library Automation.
Robert Sharpe, Operations Director METS in heterogeneous digital repositories.
Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.
Digital Preservation - Its all about the metadata right? “Metadata and Digital Preservation: How Much Do We Really Need?” SAA 2014 Panel Saturday, August.
Transformations at GPO: An Update on the Government Printing Office's Future Digital System George Barnum Coalition for Networked Information December.
Andrea Fojtu Charles University in Prague, National Library of the CR.
ISO & OAI-PMH By Neal Harmeyer, Amy Hatfield, and Brandon Beatty PURDUE UNIVERSITY RESEARCH REPOSITORY.
Archivematica-Islandora Integration Module Evelyn McLellan
Week 2 Lecture 2 Structure of a database. External Schema Conceptual Schema Internal Schema Physical Schema.
Long-term Archive Service Requirements draft-ietf-ltans-reqs-00.txt.
Project Implementation for COSC 5050 Distributed Database Applications Lab1.
Ingest and Dissemination with DAITSS Presented by Randy Fischer, Programmer, Florida Center for Library Automation, University of Florida DigCCurr2007.
Statewide Digitization and the FCLA Digital Archive Priscilla Caplan, Florida Center for Library Automation Statewide Digitization Planners Meeting OCLC,
“Filling the digital preservation gap” an update from the Jisc Research Data Spring project at York and Hull Jenny Mitcham Digital Archivist Borthwick.
1 The Universal Object Format - A METS Profile for an archiving and exchange format for digital objects.
Glen Robson Head of Systems Unit National Library of Wales
Recordkeeping for Good Governance Toolkit Digital Recordkeeping Guidance Funafuti, Tuvalu – June 2013.
OracleAS Reports Services. Problem Statement To simplify the process of managing, creating and execution of Oracle Reports.
DAITSS: Dark Archive in the Sunshine State Priscilla Caplan, Florida Center for Library Automation DCC Workshop on Long-term Curation within Digital Repositories.
Digital Long-term Preservation Service in Finland DLM Forum Members Meeting
Implementor’s Panel: BL’s eJournal Archiving solution using METS, MODS and PREMIS Markus Enders, British Library DC2008, Berlin.
Building a Digital Archives for the City of Vancouver Glenn Dingwall 14 September, 2011.
The FCLA Digital Archive Joint Meeting of CSUL Committees, 2005.
Digital Preservation: Current Thinking Anne Gilliland-Swetland Department of Information Studies.
Archival Workshop on Ingest, Identification, and Certification Standards Certification (Best Practices) Checklist Does the archive have a written plan.
WGISS /09/2015 DATA PRESERVATION – CNES APPROACH B. Chausserie-Laprée.
Fachstelle ARELDA Schweizerisches Bundesarchiv 1 SIARD: Software Invariant Archiving of Relational Databases at the Swiss Federal Archives Contents: 
Integrating metadata schema registries with digital preservation systems to support interoperability Michael Day UKOLN, University of Bath, UK
Persistent Digital Archives and Library System (PeDALS)
VITAL at the National Library of Wales Glen Robson
OAIS: From Requirements to Reality at OCLC FLICC / CENDI Symposium, Dec Pam Kircher Product Manager, Digital Archive OCLC Digital & Preservation.
Selene Dalecky March 20, 2007 FDsys: GPO’s Digital Content System.
OAIS Rathachai Chawuthai Information Management CSIM / AIT Issued document 1.0.
How to Implement an Institutional Repository: Part II A NASIG 2006 Pre-Conference May 4, 2006 Technical Issues.
Funded by: © AHDS Preservation in Institutional Repositories Preliminary conclusions of the SHERPA DP project Gareth Knight Digital Preservation Officer.
DAITSS: Dark Archive in the Sunshine State Priscilla Caplan Florida Center for Library Automation (FCLA)
Hussein Suleman University of Cape Town Department of Computer Science Digital Libraries Laboratory February 2008 Data Curation Repositories:
Metadata Input Tool for CADIS Scientists and Data Managers by D. Stott August 8, 2007.
Archiving microdata Standards and good practices United Nations Statistics Commission New York, February 26, 2009 Olivier Dupriez World Bank, Development.
Open Planets Foundation Hackathon Database Archiving Event Implementation of SIARD at the Danish National Archives.
OAI-PMH for Resource Harvesting Tutorial OAI4, October 20 th 2005, CERN, Geneva, Switzerland The American Physical Society Project: Standards-based Mirroring.
DAITSS and the Florida Digital Archive Priscilla Caplan Florida Center for Library Automation iPRES 2006.
ARIADNE is funded by the European Commission's Seventh Framework Programme Archiving and Repositories Holly Wright.
Florida Digital Archive PREMIS and DAITSS. Florida Digital Archive.
Lifecycle Metadata for Digital Objects November 15, 2004 Preservation Metadata.
CABLING SYSTEM WARRANTY REGISTRATION. PURPOSE OF CABLING REGISTRATION.
The OAIS model SEEDS meeting May 5 th, 2015, Lausanne Bojana Tasic.
The ECOST Web-based platform for data providers and for data users.
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
Preservation Functionality in a Digital Archive Erik Oltmans Koninklijke Bibliotheek Raymond J. van Diessen IBM Business Consulting Services Hilde van.
Meeting of the Member States Expert Group on Digitisation and Digital Preservation , Luxembourg European Archival Records and Knowledge Preservation.
European Archival Records and Knowledge Preservation Database preservation Format and toolkit Jan Dalsten Sørensen Danish National Archives DLM Forum Riga.
OAIS (archive) Producer Management Consumer. Representation Information Data Object Information Object Interpreted using its Yields.
Setting up long term digital preservation DLM Forum Member Meeting Luxembourg 14-15th October 2015.
ODP V2 Data Provider overview. 22 Scope Data Provider provides access to data and metadata of the local data systems. Data Provider is a wrapper, installed.
OAIS (archive) OAIS (archive) Producer Management Consumer.
R2R ↔ NODC Steve Rutz NODC Observing Systems Team Leader May 12, 2011 Presented by L. Pikula, IODE OceanTeacher Course Data Management for Information.
Data Management and Archival Storage Bojana Tasić FORS SEEDS Workshop I Belgrade, October.
Joint Meeting of CSUL Committees,
General Model of E-ARK Services
Metadata Issues in Long-term Management of Data and Metadata
Renewal of the 1956 Institute website and connecting it to the National Digital Data Archive (NDDA) Zoltán Lux The Institute for the History.
OAIS Producer (archive) Consumer Management
DAITSS and the Florida Digital Archive
Best practice survey on the current solutions for digital archiving
Statewide Digitization and the FCLA Digital Archive
Robin Dale RLG OAIS Functionality Robin Dale RLG
Best Practices in Higher Education Student Data Warehousing Forum
Presentation transcript:

May 2011DLM Forum, Budapest1 The First OAIS-compliant Ingest of Digital Records Zoltán Lux The National Archives of Hungary web:

May 2011DLM Forum, Budapest2 The Task  Transfer of data (ingest) from the BÜR system (data systems covering persons accused of or charged with crimes).  Preparation of a format for long-term storage.  Development of a suitable structure.  Preparation of a format for utilization and searchable.  Doing all this compatible with OAIS.  Making SIP, AIP and DIP packages.  Installation of frame systems at the Hungarian National Archives and the Budapest City Archives. Ensuring that further data can be incorporated as required.

May 2011DLM Forum, Budapest3 The OAIS Model

May 2011DLM Forum, Budapest4 Database of the Hungarian Prosecution Service DOS-based application, dBASE IV files and user program in Clipper 5 and with the development of it by the Chief Prosecutor’s Office. How digital storage suitable for long-term archiving and use can be produced from this. Results of the BÜR I. project (data systems covering persons accused of or charged with crimes):  Selection of the SIARD format and planning for the upcoming SIARD SUITE application for relational databases (MSSQL, Oracle, MS Access).  Preparation of submission specifications.  Creating a new/modified data model  Loading data into an Oracle database  Using the SIARD SUITE to convert data into the SIARD format

May 2011DLM Forum, Budapest5 Submission specification

May 2011DLM Forum, Budapest6 Planning the ingest  Creating CSV files from dBase files.  Appropriate format and packaging of these for long-term preservation.  Adding document files.  Adding metadata in XML format.  Appropriate structure.  Packing in ZIP format: SIP and/or AIP.  Making a searchable DIP.

May 2011DLM Forum, Budapest7 Implementation I Submission specification. Submission of the CSV data files along with special information on the data, other documents on software functionality, and some metadata. Loading this information into an Oracle database With an SQL program Applying SIARD SUITE to the database and creating a SIARD package. Creating an appropriate AIP by adding documents and metadata in specific and EAD XML format, all in an appropriate structure, and packaging them in a ZIP file. Manually Making an anonymous DIP by developing a web application with APEX.

May 2011DLM Forum, Budapest8 Implementation I

May 2011DLM Forum, Budapest9 Implementation II Submission specification Creating SIP packages. With SIPka application software Loading data into an Oracle database with the information on the data from the submission specifications. With BÜRke application software Applying SIARD SUITE to the database and creating a SIARD package. With SIARD SUITE called up by BÜRke application software Creating an AIP by adding documents, metadata in specific and EAD XML format, putting them into a structure, and zipping them. With SIPka application software Making an anonymous DIP with a devised APEX web application.

May 2011DLM Forum, Budapest10 Implementation II.

May 2011DLM Forum, Budapest11 Data for submission

May 2011DLM Forum, Budapest12 Creating an SIP

May 2011DLM Forum, Budapest13 Creating an SIP Loading data into the Oracle database. Assembly of various schemes in line with the task. Generating database schemes (META, STAGE, DW, SIARD, PUBLIC). Preparing PL/SQL programs. Loading data and journals, and preparing statistics.

May 2011DLM Forum, Budapest14 Applying the SIARD SUITE Producing a SIARD package for preparing SIP and AIP with SIARD SUITE.

May 2011DLM Forum, Budapest15 Applying SIARD SUITE Why we think SIARD FORMAT is appropriate for our task. Well-designed database. Tables and views. A lot of data-connection information can be stored in the database, e. g. with foreign keys, check constraints, triggers etc. Ability to store information about user program logic with their routines. Ability to add comments to almost every database object. These information vehicles can be transferred to the SIARD PACKAGE with other supplementary information on the database and user program. The format is package-independent.

May 2011DLM Forum, Budapest16 From SIP to AIP Producing the AIP with an application software (BÜRke). SIARD package, addicional documents, metadata information in XML format, appropriate structure, ZIP format.

May 2011DLM Forum, Budapest17 Producing the DIP Web-based user interface developed with APEX.

May 2011DLM Forum, Budapest18 Producing the DIP

May 2011DLM Forum, Budapest19 Producing the DIP

May 2011DLM Forum, Budapest20 Outcomes Completing the ingest process. Making the DIP searchable. Gaining experience with the SIARD SUITE, preparing the Hungarian version of it, and making some corrections to the software. Developing the software tools for ingest and long-term preservation of further BÜR records. Making the software tools applicable to other relational databases. Gaining experience with archiving digital records. Some further tasks and remaining problems.

May 2011DLM Forum, Budapest21 Thank you for your attention!