Per Møldrup-Dalum State and University Library SCAPE Information Day State and University Library, Denmark, 2014-06-25 SCAPE Scalable Preservation Environments.

Slides:



Advertisements
Similar presentations
Introduction to Planets Hans Hofman Nationaal Archief Netherlands Prague, 17 October 2008.
Advertisements

Performance Testing - Kanwalpreet Singh.
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Dr. Ross King AIT Austrian Institute of Technology GmbH SCAPE/OPF Executive Seminar: Managing Digital Preservation The Hague, April 2, 2014 SCAPE Tools.
Hydra Partners Meeting March 2012 Bill Branan DuraCloud Technical Lead.
Gov 2.0: The Government’s Web 2.0 Platform Ramesh Ramakrishnan Division Director Citizant Ph: (703) x165
Jiten Bhagat University of myExperiment A Social VRE for Research Objects JISC Roadshow | February.
AceMedia Personal content management in a mobile environment Jonathan Teh Motorola Labs.
Tools and Services for the Long Term Preservation and Access of Digital Archives Joseph JaJa, Mike Smorul, and Sangchul Song Institute for Advanced Computer.
Advanced Data Mining and Integration Research for Europe ADMIRE – Framework 7 ICT ADMIRE Overview European Commission 7 th.
Presenter: Joshan V John Robert Dyer, Hoan Anh Nguyen, Hridesh Rajan & Tien N. Nguyen Iowa State University, USA Instructor: Christoph Csallner 1 Joshan.
Networks ∙ Services ∙ People John DYER TF-MSP Video Conference Community Procurement Support Building on the SPOT-ON Proposal Smart Procurement,
Microsoft Office Sharepoint Server 2007 (MOSS) Overview Momentum Microsoft November 15, 2007.
Digital Asset Management for All? Visualising a Flexible DAMS Solution for Small and Medium Scale Institutions Paul Bevan Llyfrgell Genedlaethol Cymru.
Ch 4. The Evolution of Analytic Scalability
Creating Business Workflow Using SharePoint Designer 2007 Presented by Tarek Ghazali IT Technical Specialist Microsoft SQL Server MVP Microsoft SQL Server.
Jisc Data Spring Pitch: Cloud Workbench Ben Butchart EDINA.
DuraCloud A service provided by Sandy Payette and Michele Kimpton.
Common Ground A Policy Framework for Open Access to Research Data Susan Reilly, LIBER Projects
DuraCloud Managing durable data in the cloud Michele Kimpton, Director DuraSpace.
Project Presentation.
Model Bank Testing Accelerators “Ready-to-use” test scenarios to reduce effort, time and money.
SCAPE Dr. Ross King AIT Austrian Institute of Technology GmbH APA Conference Frascati, November 7, 2012 SCAPE Scalable Preservation Tools and Infrastructure.
Building Scalable Web Archives Florent Carpentier, Leïla Medjkoune Internet Memory Foundation IIPC GA, Paris, May 2014.
Artur Kulmukhametov Vienna University of Technology SCAPE PW Training Event Aarhus, November 2013 Content Profiling and C3PO.
Project Presentation.
Co-funded by the European Union under FP7-ICT Co-ordinated by aparsen.eu #APARSEN Why persistent identifiers are crucial in digital preservation.
The role of Parthenos for CLARIN ERIC Steven Krauwer CLARIN ERIC Executive Director 1.
SCAPE Dr. Rainer Schmidt AIT Austrian Institute of Technology GmbH APA 2011 Conference London, 8-9 November, 2011 The SCAPE Project Overview, Objectives,
One Body, Many Heads for Repository-Powered Digital Content Applications Hydra Europe Symposium, Trinity College, Dublin, 7 th April 2014 Chris Awre Head.
SCAPE Scalable Preservation Environments. 2 Its all about scalability! Scalable services for planning and execution of institutional preservation strategies.
Presentation Path  Introduction to Ved Consultancy and OpenText  Current Challenges  The Valued Customers and Sectors  Our Solutions  Demo. Together,
The Eyeblaster ACM Advertising Campaign Management.
GIS On The Web: An Overview of ArcIMS. *The easy flow of geographic data can offer real-life solutions in many societal sectors, including municipal government,
2009 Federal IT Summit Cloud Computing Breakout October 28, 2009.
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Alastair Duncan STFC Pre Coffee talk STFC July 2014 The Trials and Tribulations and ultimate success of parallelisation using Hadoop within the SCAPE project.
SCAP E SCAPE Project EU project aimed at building a scalable platform for planning and execution of computation intensive processes for ingestion or migration.
Last Updated 1/17/02 1 Business Drivers Guiding Portal Evolution Portals Integrate web-based systems to increase productivity and reduce.
SCAPE Rainer Schmidt SCAPE Information Day May 5 th, 2014 Österreichische Nationalbibliothek The SCAPE Platform Overview.
Technical Update 2008 Sandy Payette, Executive Director Eddie Shin, Senior Developer April 3, 2008 Open Repositories 2008, Fedora User Group.
SCAPE Rainer Schmidt SCAPE Training Event September 16 th – 17 th, 2013 The British Library Building Scalable Environments Technologies and SCAPE Platform.
G ET A HEAD ON Y OUR R EPOSITORY Tom Cramer Chief Technology Strategist Stanford University Libraries.
Millman—Nov 04—1 An Update on Digital Libraries David Millman Director of Research & Development Academic Information Systems Columbia University
26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-71 DIMMI Project a DI gital M ulti M edia I nfrastructure.
DuraCloud Open technologies and services for managing durable data in the cloud Michele Kimpton, CBO DuraSpace.
PLANETS, OPF & SCAPE A summary of the tools from these preservation projects, and where their development is heading.
Per Møldrup-Dalum State and University Library SCAPE Information Day State and University Library, Denmark, A Weekend with Nanite Large scale.
Margret Plank 17th International Conference on Grey Literature 1st and 2nd December 2015, Amsterdam (Netherlands) Move beyond text – How TIB manages the.
EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant number EGI vision for the EOSC Tiziana.
ETICS An Environment for Distributed Software Development in Aerospace Applications SpaceTransfer09 Hannover Messe, April 2009.
1 This Changes Everything: Accelerating Scientific Discovery through High Performance Digital Infrastructure CANARIE’s Research Software.
Fedora Commons Overview and Background Sandy Payette, Executive Director UK Fedora Training London January 22-23, 2009.
© 2007 IBM Corporation IBM Software Strategy Group IBM Google Announcement on Internet-Scale Computing (“Cloud Computing Model”) Oct 8, 2007 IBM Confidential.
EGI-InSPIRE RI EGI Compute and Data Services for Open Access in H2020 Tiziana Ferrari Technical Director, EGI.eu
A Semi-Automated Digital Preservation System based on Semantic Web Services Jane Hunter Sharmin Choudhury DSTC PTY LTD, Brisbane, Australia Slides by Ananta.
Barbara Sierman SCAPE Training Statsbiblioteket, Aarhus, November 2013 Preservation Policy in SCAPE.
EGI-InSPIRE RI An Introduction to European Grid Infrastructure (EGI) March An Introduction to the European Grid Infrastructure.
Hadoop Javad Azimi May What is Hadoop? Software platform that lets one easily write and run applications that process vast amounts of data. It includes:
Accessing the VI-SEEM infrastructure
GISELA & CHAIN Workshop Digital Cultural Heritage Network
ISDA + OpenStack Rob Kooper.
? What is Institutional Repository for Rutgers University
An Introduction to Tessella and The Safety Deposit Box Platform
Joseph JaJa, Mike Smorul, and Sangchul Song
VI-SEEM Data Repository
Library Technology Conference: Building Exhibits
Ch 4. The Evolution of Analytic Scalability
Malte Dreyer – Matthias Razum
GISELA & CHAIN Workshop Digital Cultural Heritage Network
Presentation transcript:

Per Møldrup-Dalum State and University Library SCAPE Information Day State and University Library, Denmark, SCAPE Scalable Preservation Environments

What is SCAPE? What can it offer? Who are involved in SCAPE? Agenda 2 This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ).

Your collection of digital data is growing rapidly. Your preservation activities must become more efficient and more scalable. The SCAPE project has developed scalable solutions for long-term preservation of large-scale and heterogeneous data sets. 3 Digital Preservation – What do I need? This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ).

4 Scalability — 4 dimensions This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ). Heterogeneity of collections Complexity of objects Number of objects Size of objects

5 What is SCAPE? This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ).

6 Solutions Tested in Real Life This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ). Web Content Digital Repositories Data Centres Research Data Sets

Scalability In four dimensions: Heterogeneity of collections as well as number, size and complexity of objects Automation Through scalable, automated and simple to design preservation workflows Planning Answering core preservation planning questions Integration Through a robust, integrated, open source preservation system Centralised services Allowing content holders to share information globalising the basis for decision-making Solutions for Content Holders 7 This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ).

8 Overview: SCAPE Architecture This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ).

9 Overview: SCAPE Components This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ). The SCAPE Platform is a reference architecture for scalable preservation environments

10 Overview: SCAPE Components This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ). The SCAPE Preservation Components are tools which enhance the functionality of a digital preservation system in: Scalability Functional coverage Quality

11 Overview: SCAPE Components This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ). The SCAPE Planning and Watch components address the bottleneck of decision processes and processing information required for decision making

Examples of tools and services 12 This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ).

13 Scout – an Automated Preservation Watch System Scalable Planning and Watch This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ). Enables you to monitor your collections Lets you access community knowledge Collects relevant knowledge and enables automated notification

Taverna Workbench 14 This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ). Desktop application GUI Plug-in Framework Themed editions Intermediate results views Search for Web Services in catalogues Search and publish to myExperiment Taverna Server

15 ToMaR – let your Preservation Tools Scale Scalable Tools This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ). Run existing tools against large amounts of files Execute tools in a scalable fashion on a MapReduce cluster Enable scalable workflows which chain together a set of tools Process payloads too big to be computed on a single machine

16 Jpylyzer – Easy Validation of JPEG 2000 Preservation Components This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ). Automated JP2 validation and feature extraction Enables you to confirm whether an image is a valid, intact JP2 file Reports the key technical properties of the image

17 xcorrSound – Automate Sound Wave Analysis Preservation Components This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ). Compare two audio files and output the similarity Detect overlaps in audio files Detect occurrences of a smaller audio file (e.g. a jingle) within a larger audio file or an index of audio files

SCAPE tools are published as open source software. Tools and services from SCAPE are sustained by Open Planets Foundation - address core digital preservation challenges and engage with the community COPTR - Community Owned digital Preservation Tool Registry 18 Sustainability of Tools and Services This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ).

Ultimate Sustainability goal: Supporting communities of practice by enabling efficient collaboration during the project and beyond. Open Planets Foundation will take post-project ownership of the outputs, supported by other partners providing specific capabilities. Sustainability of SCAPE results 19 This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ).

EU-funded project under FP7 (Research and Technological Development) Project runtime: February 2011 to September partners from 10 countries - from memory institutions, data centers, research labs, universities, and industrial firms Public Project materials are licensed under a CC-BY-SA International License 20 About SCAPE This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ).

21 SCAPE Consortium This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ). 21

22 Additional Sources of Interest This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ). Development Infrastructure Code repository hosted by the Open Planets Foundation and GitHub Development Wiki Tools Experimental Workflows Publications Public Deliverables

23 More Information This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ). SCAPE website: Blog posts and more: Tools and Services: SCAPE #SCAPEProject SCAPE Newsletter: Sign up via All images © the SCAPE Project or its partners, except images on slides 3, 6 and 26 ©

24 This work was partially supported by the SCAPE Project. The SCAPE project is co‐funded by the European Union under FP7 ICT‐ (Grant Agreement number ).