Preservation Planning An Overview Hans Hofman Planets project, Training Vilnius, 3 October 2007.

Slides:



Advertisements
Similar presentations
Max Kaiser: PLANETS Testbed
Advertisements

DRIVER Long Term Preservation for Enhanced Publications in the DRIVER Infrastructure 1 WePreserve Workshop, October 2008 Dale Peters, Scientific Technical.
Curating Research: problems and policy Dale Peters Scientific Technical Manager DRIVER II.
Introduction to Planets Hans Hofman Nationaal Archief Netherlands Prague, 17 October 2008.
Platter Planning Tool For Trusted Electronic Repositories
The Planets Preservation Planning workflow and the planning tool Plato Hannes Kulovits Vienna University of Technology
Introducing Significant Properties Stephen Grace and Gareth Knight Centre for e-Research.
Joint Information Systems Committee Digital Library Services BL/JISC Workshop Rachel Bruce JISC Programme Director The Digital Library and its Services,
A centre of expertise in data curation and preservation DigCCur2007 Symposium, Chapel Hill, N.C., April 18-20, 2007 Co-operation for digital preservation.
A centre of expertise in data curation and preservation DCC Workshop: Curating sApril 24 – 25, 2006 Funded by: This work is licensed under the Creative.
A centre of expertise in data curation and preservation UKOLN Open ForumIWMW June 2006 Funded by: This work is licensed under the Creative Commons.
A centre of expertise in data curation and preservation London :: ARK Group Workshop: Archiving the Web :: 28 Sept 2006 Funded by: This work is licensed.
Joint Information Systems Committee 11/03/07 | | Slide 1 Joint Information Systems CommitteeSupporting education and research JISC Conference 2007 Managing.
A centre of expertise in data curation and preservation SoA Annual Conference::York::August 2008 Funded by: This work is licensed under the Creative Commons.
A centre of expertise in data curation and preservation CETIS MDR SIG::28 June 2006::University of Bath Funded by: This work is licensed under the Creative.
EU-funded Digital Preservation Research APA 2014 Conference Brussels, 22 October 2014 Dr. Manuela Speiser European Commission DG CONNECT, unit "Creativity"
HATHI TRUST A Shared Digital Repository Digital Repositories for Preservation and Access Digital Directions 2013 Jeremy York July 22, 2013 Unless otherwise.
A centre of expertise in data curation and preservation MIS Seminar :: University of Edinburgh :: 2 October 2006 Funded by: This work is licensed under.
Transformations at GPO: An Update on the Government Printing Office's Future Digital System George Barnum Coalition for Networked Information December.
TRAC / TDR ICPSR Trustworthy Digital Repositories.
Selecting Preservation Strategies for Web Archives Stephan Strodl, Andreas Rauber Department of Software.
Choosing an Optimal Digital Preservation Strategy Andreas Rauber Department of Software Technology and.
Future Access to the Scientific and Cultural Heritage – A shared Responsibility Birte Christensen-Dalsgaard State and University Library.
Preservation and Long-term access through Networked Services Adam Farquhar, The British Library iPres2006 Cornell University, October 2006.
Lecture 13 Revision IMS Systems Analysis and Design.
© HATII, University of Glasgow Uncertainty, Risk, Trust, and Digital Persistency Seamus Ross, Director HATII University of Glasgow 2006 NHPRC Electronic.
Co-funded by the European Union under FP7-ICT Alliance Permanent Access to the Records of Science in Europe Network Co-ordinated by aparsen.eu #APARSEN.
Database System Development Lifecycle
Digital preservation Hydra Europe, LSE 24 April 2015 Anders Conrad.
Release & Deployment ITIL Version 3
The use and convergence of quality assurance frameworks for international and supranational organisations compiling statistics The European Conference.
Building a Case for Digital Migration Anna Stratton Director, Information Management Southwest Solutions Group 1 Created in partnership with ARMA International.
AICT5 – eProject Project Planning for ICT. Process Centre receives Scenario Group Work Scenario on website in October Assessment Window Individual Work.
Integrating Digital Curation in a Digital Library curriculum: the International Master DILL case study Anna Maria Tammaro University of Parma Florence,
Statewide Digitization and the FCLA Digital Archive Priscilla Caplan, Florida Center for Library Automation Statewide Digitization Planners Meeting OCLC,
Records Managers’ Forum 28 February Draft standard on the appraisal and disposal of State records Catherine Robinson Senior Project Officer, Government.
ERPANET pre-conference workshop, Glasgow 30 August 2004 Hans Hofman Nationaal Archief Netherlands Co-Director ERPANET ERPANET seminar Glasgow, 30 August.
Web (Website) Records Management. Agenda:  Brief Definitions and Outline – NARA  Vendors  Member Q & A  Who has formal policies for web/website management?
Preserving Digital Collections for Future Scholarship Oya Y. Rieger Cornell University
Caring and Sharing Collaboration in Digital Curation outside North America Ross Harvey Simmons College, Boston Curation Matters: 17 June 2010.
Relationships July 9, Producers and Consumers SERI - Relationships Session 1.
What is a Business Analyst? A Business Analyst is someone who works as a liaison among stakeholders in order to elicit, analyze, communicate and validate.
Simone Görl │ 18th may 2006 Preserving Authentic Electronic Records: The InterPARES Project & The InterPARES Model DIGITAL PRESERVATION.
A survey based analysis on training opportunities Dr. Jūratė Kuprienė Framing the digital curation curriculum International Conference Florence, Italy.
CLARIN work packages. Conference Place yyyy-mm-dd
Digital Preservation: Redefining Established Concepts Nancy Kunde UW Madison Records Officer Campus IT Committee February 15, 2008.
Digital Preservation: Current Thinking Anne Gilliland-Swetland Department of Information Studies.
Engineering Essential Characteristics Security Engineering Process Overview.
1 Strategic Plan for Digital Archives Programme DAP PROJECT SCOPE OVERVIEW STATUS.
Archival Workshop on Ingest, Identification, and Certification Standards Certification (Best Practices) Checklist Does the archive have a written plan.
WGISS /09/2015 DATA PRESERVATION – CNES APPROACH B. Chausserie-Laprée.
Incoming communication Diagram A0 Carry out business activity 2 Outgoing communication Manage records 3 Result, deliverable Mandate External requests.
Digital Preservation across the technologies, strategies, open standards & interoperability aspects including the legal issues Pratik Shrivastava Scientist.
United Nations Regional Seminar on Census Data Archiving for Africa, Addis Ababa, Ethiopia, September, 2011 Introduction to Census Archiving Session.
Aligning Digital Preservation Policies with Community Standards Nancy McGovern Digital Preservation Officer.
ARIADNE is funded by the European Commission's Seventh Framework Programme Archiving and Repositories Holly Wright.
Lifecycle Metadata for Digital Objects November 15, 2004 Preservation Metadata.
Hall, Accounting Information Systems, 8e ©2013 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly.
Institutional Repositories July 2007 DIGITAL CURATION creating, managing and preserving digital objects Dr D Peters DISA Digital Innovation South.
Organizations of all types and sizes face a range of risks that can affect the achievement of their objectives. Organization's activities Strategic initiatives.
COBIT. The Control Objectives for Information and related Technology (COBIT) A set of best practices (framework) for information technology (IT) management.
SciDataCon 2014, WDS Forum, Dehli WDS Certification Objective: building trust in the usage of data & data services Michael Diepenbroek Rorie Edmunds Mustapha.
CESSDA SaW Training on Trust, Identifying Demand & Networking
Building A Repository for Digital Objects
An Introduction to Tessella and The Safety Deposit Box Platform
Statewide Digitization and the FCLA Digital Archive
Digital Project Lifecycle Curating Across the Curriculum
Digital Preservation Planning:
AICT5 – eProject Project Planning for ICT
Nancy Y. McGovern Digital Preservation Officer, ICPSR IASSIST 2007
Presentation transcript:

Preservation Planning An Overview Hans Hofman Planets project, Training Vilnius, 3 October 2007

Overview What is the problem? Defining the issues The scope and role of Preservation Planning The Planets approach –The organisational/ business context –Usage requirements and collection profiles –Preservation plans and preservation actions

Why Preservation Planning? Who are the stakeholders? What is the issue? Why important? What are the objectives?

Stakeholders Memory institutions (content holders) (Scientific) data centres Government organisations Business companies Individuals

The issue / challenge The enormous and rapidly increasing amount of digital information –Fragile resources The rapid evolution in technology The risk of obsolescence and therefore corruption and/or loss of valuable information (Pro-)active and ongoing attention / maintenance required Potential solutions: still fragmented –infrastructure –not comprehensive

Objectives of Preservation Planning To identify and analyse the organisational context –including a risk assessment –define a framework for preservation (?) To support decision-making about digital preservation including –Identifying criteria for preservation within that context –Defining workflow for evaluating/ defining preservation plans –Developing methodologies for assessing the risks of applying different preservation strategies for different types of digital objects To enable formulation, evaluation and execution of high-quality and cost-effective preservation plans that suit the organisational (e.g. repository) needs

What is Preservation Planning? Defining criteria for preservation of specific digital objects (in the collection) based on risk analysis in a defined (business) context Following a systematic and structured workflow/ procedure in making decisions about the best possible approaches given the organisational context and the content of the repository Defining one or more appropriate preservation plan(s) –depending on the types of objects and available strategies Execute those plans when needed, and Be able to assess the quality of the results Document all these steps in order to be accountable Issue: scope includes preservation policy?

Preservation policy: what is it? Framework for maintaining digital objects over time Context (positioning the institution, legal and social context, user needs, …) Scope and objectives Principles Concepts Roles and responsibilities Strategies, rules, standards, and procedures ….

Context: mandate, business From preservation policy to action Policy/framework Plan Action/ execution Feedback/evaluation preservation planning process translate into executable workflow

Exercise

Groups A: Collection of scanned newspapers in a library –Egle, Renata, Grazina, Edvardas, Filip/Tomasz, Libor B: Sound archive (Archive of Dialects) –Thomas, Violeta, Hamid, Tomasz/Filip, Aiste C: Collection of electronic publications: Library –Journal publications, Theses and dissertations –Jurate, Jelena, Laima, Edgars, Elona D: Collection of electronic publications: Archive –Piret, Aadi, Raimonda, Marija, Bjorn Ragnolf

Exercise Determine what (external/internal) factors will influence a preservation policy for your context Identify what would be the main issues that have to be addressed or included for preserving the objects involved

Terminology Preservation vs. curation –recordkeeping, archiving Framework, policy, strategy Plan, action, method

The Planets approach Understanding the parameters of successful preservation strategy in different contexts, i.e archives, libraries and data centres, e- government, … –Understanding organisational policies What is happening in practice? What would a policy encompass? Policies may exist, but are hardly implemented –Understanding usage of digital objects Carrying out probes and interviews with selected researchers in different institutions –Collect information and experiences from researchers in several iterations –Let users talk as much as possible Analysis and structuring of results (affinity analysis) –Identification of areas of user interests –Interviews with futurologists

Planets approach (2) Collection profile –What types of objects (both technical and intellectual aspects)? –Technical: file formats registries (e.g. PRONOM, …) –Intellectual: for instance documentary form, look and feel, behaviour objective tree templates an (intellectual) object may consist of different computer files –what strategy then?

Planets Approach (3) Usage requirements –Performance –Usability, presentation –Authenticity –Understanding –Rights –Costs

Planets approach (4) Providing a decision-support workflow and mechanism capable of translating those parameters into best available strategy –Conducting case studies to identify sets of essential characteristics for different digital objects (objective trees) –Developing a decision support tool (software) 1st version, end of November 2007 (not public) 2d version publicly available, second half of 2008 –Systematic procedure for evaluating preservation strategies Based on evaluation of strategies create preservation plan

From policy to action: Preservation Plan Preservation context –legal and regulatory environment –mandate Roles and responsibilities Selected preservation strategy –based on evaluation –evaluation result (which alternatives have been compared, the outcome) Costs of applying the preservation plan Trigger(s) to initiate the execution of the plan more…?

Preservation planning Preservation Policy Collection Profile Usage Profile Preservation Planner Plans Plan Evaluator Plan Sample Content Preservation Actions

Planets functions Technology watch –Risk assessment service –Recommender services –Trigger for adapting preservation plans Comparison of preservation strategies based on organisational policies, usage information and collection profile(s) –Utility analysis: identifying essential characteristics (tomorrow) Developing and updating preservation plans according to (new) monitoring information and the available strategies evaluation –The plans will trigger preservation actions (preferredly in an automated fashion) –Tools and services registry Validation framework (+ metrics) for evaluating the results of preservation actions Testbed –experimenting, documented and comparable results. Characterisation –File format registry

Requirements for objects Objects: –documents, data sets, websites, databases, CAD-drawings, video, audio, … Authenticity Reliability Integrity Usability Accuracy … Tension between preservation and user requirements –not always compatible

Requirements for objects (2) Authenticity –to be what it purports to be, –to have been created or sent by the person purported to have created or sent it, and –to have been created or sent at the time purported Reliability –contents can be trusted as a full and accurate representation of the transactions, activities or facts to which they attest and can be depended upon in the course of subsequent transactions or activities Integrity –being complete and unaltered Usability –can be located, retrieved, presented and interpreted, so retrievable, readable, interpretable Accuracy –the degree to which data, information, documents or records are precise, correct, truthful, free of error or distortion or pertinent to the matter.

Relationship to OAIS model

OAIS Model

The OAIS Preservation Planning Function

OAIS Functions Develop preservation strategies and standards Develop Packaging designs and migration plans Monitor designated community/-ies Monitor technology

Alerts New Format Alert (NFA) –New format is accepted in the repository –New preservation strategy has to be identified and evaluated –Raised by: Monitor Designated Community –Changes in Designated Community –Frequent unanticipated submissions Alerts that can trigger a preservation planning activity

Change in the Designated Community For example use of a new file format NFA

Alerts New Requirement Alert (NRA) –Changes and development in technology –Change in preservation requirements –Re-evaluation of existing preservation strategies –Raised by Monitor Designated Community Monitor Technology Alerts that can trigger a preservation planning activity

New Requirements Alert NRA

Alerts Revision Alert (REA) –Periodical reviews help to improve and further develop existing preservation strategies –3 kinds: Periodical review Review depending on operational statistics Review for new developments Alerts that can trigger a preservation planning activity

Revision Alert Periodical REA Operational Statistic REA

Preservation Planning: an overview

Steps Understanding of context –analysis of organisational needs, user needs, legal requirements Identify criteria for preservation –how long, restrictions of formats, standards Determine what to keep/maintain –essential characteristics (objective trees), characterisation of computer files Evaluate available strategies (actions) against criteria –identify best strategy –well-founded and documented decision –create/finalise preservation plan Execute plan when needed Evaluate what happened/perfotrmance Re-iterate when technology changes or review when policy and/or collection and/or usage changes Automated process support (?)

Components Policy framework Collection profile: –profile model –profiling service –technology watch + risk assessment Usage requirements: –usage model –identification of requirements Essential characteristics –objectives trees, database of tree-modules to be collated in required tree Available tools –tools registry –quality of tools: testbed documentation Preservation actions –available services, services registry Validation framework –metrics

Preservation Planning Process Preservation Plans Usage profile model Collection profile model, Organisational requirements model Technology watch Collection profiling service, Objective trees Risk assessment service PC Registry Validation framework PC Registry Digital object- Corpora trigger

This work is licenced under the Creative Commons Attribution-Non-Commercial-No Derivative Works 3.0 Netherlands License. To view a copy of this licence, visit nc-nd/3.0/nl/ or send a letter to Creative Commons, 171 Second Street, Suite 300, San Francisco, California 94105, USA. nc-nd/3.0/nl/