F EDORA 4 – R UMORS & T HOUGHTS Mark Bussey Chief Information Leafblower.

Slides:



Advertisements
Similar presentations
EThOSnet Repositories and Web Services Workshop 2 nd June2009 Richard Green
Advertisements

The Hydra Framework as a Series of Diagrams Naomi Dushay Stanford University Libraries April,
An Introduction to Repositories Thornton Staples Director of Community Strategy and Alliances Director of the Fedora Project.
Usage of the memoQ web service API by LSP – a case study
The future’s so bright…. DAITSS DIGITAL PRESERVATION SYSTEM: RE-ARCHITECTED, RE- WRITTEN, AND OPEN SOURCE Priscilla Caplan Florida Center for Library Automation.
Triplestore Experiences Nathan Wilhelmi 11/27/2012 NCAR - CISL/TDD/VETS.
1 Mind Visual Diff An architecture comparison tool December 16 th, 2014 – v0.2.2 Seyvoz Stephane Assystem.
JMS messaging service  All write-only Fedora operations are published to subscribed clients  Messaging system can be durable – if client/consumer/subscriber.
The Vault Data Manager Derek Hower 2/10/2011. Summary This talk: – Is: A Conceptual overview & discussion – Is not: A Vault tutorial – Is not: Polished.
(1) Standardizing for Open Data Ivan Herman, W3C Open Data Week Marseille, France, June Slides at:
Funded by: © AHDS Sherpa DP – a Technical Architecture for a Disaggregated Preservation Service Mark Hedges Arts and Humanities Data Service King’s College.
Fedora 3: A Smooth Migration Michael Durbin. The Scenario  New versions of software promise exciting new capabilities and improvements.  They also present.
Depositing e-material to The National Library of Sweden.
Building a Digital Library with Fedora International Conference on Developing Digital Institutional Repositories Hong Kong December 9, 2004.
©Silberschatz, Korth and Sudarshan10.1Database System Concepts W3C Activities HTML: is the lingua franca for publishing on the Web XHTML: an XML application.
A Framework for Distributed Preservation Workflows Rainer Schmidt AIT Austrian Institute of Technology iPres 2009, Oct. 5, San.
US GPO AIP Independence Test CS 496A – Senior Design Team members: Antonio Castillo, Johnny Ng, Aram Weintraub, Tin-Shuk Wong Faculty advisor: Dr. Russ.
Open Repositories 2015 Sharon Farnel, University of Alberta
Mapping Physical Formats to Logical Models to Extract Data and Metadata Tara Talbott IPAW ‘06.
Different approaches to digital preservation Hilde van Wijngaarden Digital Preservation Officer Koninklijke Bibliotheek/ National Library of the Netherlands.
January 2013 CDMI: An Introduction. Big Data Complexity Volume Speed “Big Data” refers to datasets whose size is beyond the ability of typical tools to.
Linux Operations and Administration
Advances in Technology and CRIS Nikos Houssos National Documentation Centre / National Hellenic Research Foundation, Greece euroCRIS Task Group Leader.
Hydra from 35,000ft Chris Awre Hydra Europe Symposium London School of Economics, 23 rd April 2015.
“Filling the digital preservation gap” an update from the Jisc Research Data Spring project at York and Hull Jenny Mitcham Digital Archivist Borthwick.
H YDRA T ECHNICAL D IRECTIONS : L INKED D ATA, F EDORA 4, ETC. Mark Bussey Chief Information Leafblower.
M i SMob i S Mob i Store - Mobile i nternet File Storage Platform Chetna Kaur.
Rethinking Game Architecture with Immutability Jacob Dufault Faculty Advisor: Dr. Phil Bernhard, Dept of Computer Science, Florida Institute of Technology.
1 Country report 2014 – Statistics Norway PC-Axis Reference Group meeting
…using Git/Tortoise Git
Database Change Management One solution to an often complex problem Kevin Hurwitz Headspring Systems
Introduce Grid Service Authoring Toolkit Shannon Hastings, Scott Oster, Stephen Langella, David Ervin Ohio State University Software Research Institute.
App Dev with Documents, their Schemas and Relationships Tugdual Grall Technical Evangelist.
SONIC-3: Creating Large Scale Installations & Deployments Andrew S. Neumann Principal Engineer, Progress Sonic.
ClearCase Concepts and Terminology
May 2003National Coastal Data Development Center Brief Introduction Two components Data Exchange Infrastructure (DEI) Spatial Data Model (SDM) Together,
XML and Its Applications Ben Y. Zhao, CS294-7 Spring 1999.
SONIC-3: Creating Large Scale Installations & Deployments Andrew S. Neumann Principal Engineer Progress Sonic.
A Fedora 3 to 4 Migration Case Study for UNSW Australia Library Fedora 4 Training Workshop, eResearch Australasia 2015, Brisbane UNSW Library Arif Shaon,
A Fedora 3 to 4 Migration Case Study for UNSW Australia Library Fedora 4 Training Workshop, eResearch Australasia 2015, Brisbane UNSW Library Arif Shaon,
Semantic Phyloinformatic Web Services Using the EvoInfo Stack Speaker: John Harney LSDIS Lab, Dept. of Computer Science, University of Georgia Mentor(s):
SDMX IT Tools Introduction
XML and Object Serialization. Structure of an XML Document Header Root Element Start Tags / End Tags Element Contents – Child Elements – Text – Both (mixed.
WStore Programmer Guide Offering management integration.
DAP4, SOAP and THREDDS James Gallagher OPeNDAP Presented by Steve Hankin.
©Silberschatz, Korth and Sudarshan10.1Database System Concepts W3C - The World Wide Web Consortium W3C - The World Wide Web Consortium.
The library is open Digital Assets Management & Institutional Repository Russian-IUG November 2015 Tomsk, Russia Nabil Saadallah Manager Business.
Combine_and_stir (Aleph data + RDF + Python + other things) IGeLU 2015 Developer’s Day Budapest, Hungary Laura Akerman.
Aleksandar Drašković Enterprise Architect deroso Solutions GmbH Data shredding: a deep dive into SharePoint 2013 storage architecture.
Extending Karkinos for Linked Data Digital Innovation Group - Fall 2015 Tushar Jain
Fedora Service Framework Sandy Payette, Executive Director UK Fedora Training London January 22-23, 2009.
MarkLogic The Only Enterprise NoSQL Database Presented by: Aashi Rastogi ( ) Sanket Patel ( )
Metadata V1 By Dick M.A. Schaap – technical coordinator Oostende, June 08.
Oracle HFM Implementation Boot Camp Presented by Saravanan Singaravadivelan Developed by Saravanan Singaravadivelan Senior Consultant Qubix International.
A Web Services Journey on the .NET Bus
Java Beans Sagun Dhakhwa.
Generator Services planning meeting
Overview: Fedora Architecture and Software Features
Flexible Extensible Digital Object Repository Architecture
Flexible Extensible Digital Object Repository Architecture
NA4 Test Team Status Test meeting, 07/09/04
Database Processing with XML
The Re3gistry software and the INSPIRE Registry
Using Hydra to Model Sustainable Collections
SharePoint data access and LINQ to SharePoint
Moving from Studio to Atelier
LOD reference architecture
Metadata The metadata contains
Prepared by Peter Boško, Luxembourg June 2012
Use Cases Simple Machine Translation (using Rainbow)
Presentation transcript:

F EDORA 4 – R UMORS & T HOUGHTS Mark Bussey Chief Information Leafblower

Fedora ≠ preservation solution Preservation is the result of a well-thought set of systems and practices A single application on a single server cannot provide a complete preservation solution Fedora is a repository application Fedora is designed from the ground up to be integrated into a preservation ecosystem

No more data-streams?! Fedora 4 no longer has the concept of a datasteam Instead, Fedora 4 supports RDF resources Binary attachments XML is treated just like any other bit-stream Hydra 9 parses XML ‘attachments’ using OM identically to how Hydra 6/7/8 parsed XML ‘datastreams’

You have to use RDF?! You don’t have to use RDF for your metadata Hydra 9 parses XML ‘attachments’ using OM identically to how Hydra 6/7/8 parsed XML ‘datastreams’ System attributes are stored as RDF, but your descriptive metadata can be stored however you like: XML, JSON, Narrative text, emoticons – Fedora 4 is (mostly) agnostic You can mix and match RDF and XML objects in your repository You can even mix and match RDF and XML for individual terms on your objects

Versioning Versioning is an expensive (processing intensive) activity Fedora 4 does not automatically create versions on update Fedora 4 provides an API to mint snapshots of an object The application is responsible for determining when to make a snapshot Reference:

Fedora is not a Triple-Store Fedora is built on ModeShape – a standards compliant, open source, noSQL data storeModeShape ModeShape uses it’s own internal storage format to store RDF containers Fedora 4 / ModeShape stores binary attachments in a directory tree similar to Fedora 3 Preservation systems will need to implement a serializer to product human and/or machine readable metadata Fedora has hooks to integrate external triple-stores to support LOD activitiesexternal triple-stores

Code Migration Hydra hides much of the complexity and most of the changes from Fedora 3  Fedora 4 Many upgrade challenges come from other issues – like bootstrap upgrades in older versions of blacklight Good test coverage is your best ally The ScholarSphere team has done much work to prepare the way OM (Opinionated Metadata) – the gem that handles XML in Hydra is incredibly stable and has not changed significantly since June 2013incredibly stable

Hydra hides most of the changes Hydra provides a ruby object interface for repository objects Hydra is designed to provides simple, ActiveRecord-like methods to manipulate repository objects Those methods are largely unchanged across Hydra and Active Fedora versions since 6.x

Content Migration You don’t have to migrate your metadata to RDF You do have to migrate your data-streams to attachments Fedora tools are forthcoming, but not here yet AND This still might be a good time to think about cleaning up your metadata & data

Thank You