Fedora Service Framework Sandy Payette, Executive Director UK Fedora Training London January 22-23, 2009.

Slides:

Advertisements

Similar presentations

Richard Jones, Systems Developer Technical Issues for Repository Software Theses Alive! Edinburgh University Library SHERPA Nottingham.

Advertisements

Preservation Features in Repository Software PRESERV: Tim Brody University of Southampton.

Data Publishing Service Indiana University Stacy Kowalczyk April 9, 2010.

EThOSnet Repositories and Web Services Workshop 2 nd June2009 Richard Green

About store The Project - Phase I StORe StORe StORe stands for: Source-to-Output Repositories.

A PPARC funded project AstroGrid Framework Consortium meeting, Dec 14-15, 2004 Edinburgh Tony Linde Programme Manager.

Preservation as a Process of a Repository David Tarrant University of Southampton (UK) Preserv Repository Preservation and Interoperability.org.uk.

DuraSpace, Fedora and DuraCloud Triangle Research Libraries Network September, 2009.

Fedora Service Framework Simple Queue Services For fulfillment of the Mellon Grant June 29, 2009.

DuraSpace: Digital Information All Ways, Always Pretoria, South Africa May 14 th, 2009.

An Introduction to Repositories Thornton Staples Director of Community Strategy and Alliances Director of the Fedora Project.

Goals for RUcore o Flexible, extensible cyberinfrastructure for Rutgers University o Integrating platform for legacy information systems o Support preservation.

JMS messaging service  All write-only Fedora operations are published to subscribed clients  Messaging system can be durable – if client/consumer/subscriber.

The Fedora Project JA-SIG Winter Conference December 9, 2003 Tim Sigmon University of Virginia.

Repositories: Disruptive Technology or Disrupted Technology? Sandy Payette, Executive Director DORSDL Workshop at ECDL 2008 September 2008.

Transformations at GPO: An Update on the Government Printing Office's Future Digital System George Barnum Coalition for Networked Information December.

Depositing e-material to The National Library of Sweden.

Planning for Flexible Integration via Service-Oriented Architecture (SOA) APSR Forum – The Well-Integrated Repository Sydney, Australia February 2006 Sandy.

Fedora Commons: Introduction and Update Swedish National Library June 24, 2008.

Building a Digital Library with Fedora International Conference on Developing Digital Institutional Repositories Hong Kong December 9, 2004.

The Fedora Project April 28-29, 2003 CNI, Washington DC Thornton Staples University of Virginia Sandy Payette Cornell Information Science.

Update on the Fedora Project Where we’ve been and where we’re going Fedora Users Conference Rutgers University May Sandy Payette Co-Director.

Representing and Storing Complex Digital Objects Fedora CS 431 – April 11, 2005 Carl Lagoze – Cornell University Acknowledgements: Sandy Payette (Cornell)

The Fedora Project March 19, 2003 ISTEC Symposium, Brazil Sandy Payette Cornell Information Science.

The Fedora Project Where we’ve been and where we’re going Mellon OS Retreat March 2005 Sandy Payette Cornell University.

A Framework for Distributed Preservation Workflows Rainer Schmidt AIT Austrian Institute of Technology iPres 2009, Oct. 5, San.

Digital Asset Management for All? Visualising a Flexible DAMS Solution for Small and Medium Scale Institutions Paul Bevan Llyfrgell Genedlaethol Cymru.

DCC Conference, Glasgow November, Digital Archive Policies and Trusted Digital Repositories MacKenzie Smith, MIT Libraries Reagan Moore, San Diego.

DuraSpace, Fedora and DuraCloud Thorny Staples Director, Community Strategy and Alliances ESIP Meeting, July 8, 2009.

Update on the Fedora Project Common Solutions Group September 2005 Tim Sigmon University of Virginia Special thanks to the Fedora Team for these slides!

Statewide Digitization and the FCLA Digital Archive Priscilla Caplan, Florida Center for Library Automation Statewide Digitization Planners Meeting OCLC,

Adventures in Digital Asset Management: Fedora at the National Library of Wales Glen Robson National Library of Wales

1. 2 introductions Nicholas Fischio Development Manager Kelvin Smith Library of Case Western Reserve University Benjamin Bykowski Tech Lead and Senior.

Fedora Commons Overview and Future Plans Sandy Payette, Executive Director Cornell University Library Metadata Working Group June 13, 2008.

1 XML as a preservation strategy Experiences with the DiVA document format Eva Müller, Uwe Klosa Electronic Publishing Centre Uppsala University Library,

Fedora Content Models for the National Science Digital Library Data Repository Fedora User’s Group Meeting Copenhagen, September 28, 2005 Carl Lagoze Cornell.

Overview of IU Digital Collections Search Hui Zhang Jon Dunn Indiana University Digital Library Program IU Digital Library Brown Bag October 19, 2011.

Marc Santos / Ingo Dahn University Koblenz-Landau, Knowledge Media Institute Koblenz.

1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.

Use & Access 26 March Use “Proof of Concept” Model for General Libraries & IS faculty Model for General Libraries & IS faculty Test bed for DSpace.

Digital preservation activities at the NLW Sally McInnes 18 September 2009.

The Fedora Project April 28-29, 2003 CNI, Washington DC Thornton Staples University of Virginia Sandy Payette Cornell Information Science NOTE: CSG

Web Services and Fedora EDUCAUSE Mid-Atlantic Regional Conference January 14, 2003 Tim Sigmon University of Virginia.

Technical Update 2008 Sandy Payette, Executive Director Eddie Shin, Senior Developer April 3, 2008 Open Repositories 2008, Fedora User Group.

Selene Dalecky March 20, 2007 FDsys: GPO’s Digital Content System.

OAIS Rathachai Chawuthai Information Management CSIM / AIT Issued document 1.0.

How to Implement an Institutional Repository: Part II A NASIG 2006 Pre-Conference May 4, 2006 Technical Issues.

Funded by: © AHDS Preservation in Institutional Repositories Preliminary conclusions of the SHERPA DP project Gareth Knight Digital Preservation Officer.

A Fedora 3 to 4 Migration Case Study for UNSW Australia Library Fedora 4 Training Workshop, eResearch Australasia 2015, Brisbane UNSW Library Arif Shaon,

Fedora Content Modeling for Improved Services for Research Databases Open Repositories 2009 Mikael Karstensen Elbæk Alfred Heller Gert Schmeltz Pedersen.

DSpace System Architecture 11 July 2002 DSpace System Architecture.

The library is open Digital Assets Management & Institutional Repository Russian-IUG November 2015 Tomsk, Russia Nabil Saadallah Manager Business.

Carl Lagoze Digital Library Service Registry Workshop Services in a Scholarly Communication Framework.

The Mellon-Funded Fedora Project A Presentation to the European Digital Library Conference September 17, 2002 Sandy Payette and Thornton Staples.

What is Fedora Commons, and Why Should You Care? Cole Hudson and Graham Hukill.

Fedora An Architecture for Complex Objects and their Relationships Old Dominion University, VA April 7, 2005 Sandy Payette Cornell University.

Fedora Commons Overview and Background Sandy Payette, Executive Director UK Fedora Training London January 22-23, 2009.

Fedora Digital Object in a Nutshell Sandy Payette, Executive Director UK Fedora Training London January 22-23, 2009.

Building Foundations: Fedora, Fez, and the ADR prepared by Jessica Branco Colati ADR Project Director, Colorado Alliance of Research Libraries

Fedora, Fez, and the ADR an ePoster presented at Institutional Repositories: Disseminating, Promoting, and Preserving Scholarship Utah State University.

Building A Repository for Digital Objects

The Fedora Project March 19, 2003 ISTEC Symposium, Brazil

Statewide Digitization and the FCLA Digital Archive

Overview: Fedora Architecture and Software Features

Flexible Extensible Digital Object Repository Architecture

Flexible Extensible Digital Object Repository Architecture

An Architecture for Complex Objects and their Relationships

PRESERV PReservation Eprint SERVices

Fedora Filling the “Sweet Spot” in the Information Landscape

Robin Dale RLG OAIS Functionality Robin Dale RLG

Presentation transcript:

Fedora Service Framework Sandy Payette, Executive Director UK Fedora Training London January 22-23, 2009

Your Applications Supporting Services Repository Service (APIs) ManageAccessSearch RDF (Query) Access ServiceBind Manage Policy Ingest Validate Registry RDF Index Store Fedora Services Institutional Repo Web 2.0 Digital Library Archivist Workbench Asset Management e-Research OAI Etc. Search Ingest Service Framework (Notional View)

Core Repository Service

Persistence Logic Trust Interface How is the repository exposed?

Persistence Logic Trust Interface How can it ensure appropriate access?

Persistence Logic Trust Interface How is data manipulated to fulfill requests?

Persistence Logic Trust Interface How is the data stored?

Persistence Registries and Indexes Files Authentication Logic Trust Interface Consumer s Producers Functional View Manage API-M Access API-A Search (API-A) RDF Query Access ServiceBind Manage Policy Ingest Validate Registry RDF Index Store

Persistence Sun XACML Engine HTTP Basic AuthN Fedora "Module" Interface Logic Trust Interface Technical View HTTP / HTTPS Transport Message Format HTTP / SOAP / XML Storage Interface (via LLStore/Akubra plug- ins) JDBCTrippi Authentication Authorization FOXML and Binary Files Registries and Indexes RDBMS -File system -SRB/iRODS -Sun Open Storage -Amazon S3 -More coming… -Mulgara -MPTStore -MySQL -Postgres -Oracle -more

Repository Service APIs API-A - Fedora Access (SOAP) API-M - Fedora Management (SOAP) API-A-LITE - Fedora Access and Registry Search (REST) API-M-LITE – Selected Management Operations (REST) RISearch – Resource Index for RDF Query (REST) Fedora REST API – streamlined (new with Fedora 3.0)

Fedora Repository Service GSearch OAI Ingest Point-to-Point Service Integrations More… repository publishes events Services have configuration files to connect them with repository service

Fedora Service Framework Current Services OAI Provider Service –Based on PROAI –Multiple metadata formats; oai sets –Configure to harvest Fedora dissemination types Directory Ingest Service –Submit a directory of files with a METS manifest –Hierarchy preserved as object-to-object relationship

OAI Provider with Polling Update

Directory Ingest (DirIngest)

Fedora Search Service (GSearch) GSearch: Fedora Generic Search Service –Configure to index any datastreams –Configure to index any service-based dissemination –Plug in Lucene, Solr, or Zebra Developed by Gert Schmeltz Pedersen of DTU

GSearch Design

Fedora Repository Service GSearch OAI Ingest Simple JMS Simple JMS Messaging - Enables Service Integration More… First, we are providing simple messaging (via JMS using ActiveMQ) repository publishes events services listen and consume events or other messages Messaging introduced in Fedora 3.0…. GSearch is first service to become JMS enabled

Publish and subscribe –Core repository service can publish API-M events –Services can subscribe and listen to events –Services can publish their own events Provides a “glue” for the service framework –Services can listen for repository events to update themselves –Services can listen for events to do a job (e.g., format migration) Gsearch is enabled as listening/consumer in Fedora 3.0 We will adapt these services next: –OAI Provider – listen for API-M events to refresh cache –Fedora Journaling – listen for API-M events and replay Fedora Messaging Service

Future Services Preservation Validation and Integrity Service –Datastreams – validate the bytestream format –Digital Objects – validate based on content models Preservation Monitoring and Alerting Service –Listen to message broker for special events Checksum failure API-M modification events –Initiate actions preservation manager Kick off an automated process (e.g., migrate) Basic Workflow –Standards-based (e.g., BPEL) –Configurable –Univ of Hull’s RepoMan work as a model for the way forward

Fedora Services commons.org/documentation/3.0/use rdocs/index.html#services commons.org/documentation/3.0/use rdocs/index.html#services