DSpace and E-Learning June 2, 2006 DSpace and E-Learning William Reilly MIT Libraries Digital Library Research Group (DLRG) Presenting on behalf of several colleagues…

DSpace and E-Learning June 2, 2006 Agenda (high level) Another Domain… Libraries –Scholarly record –Digital Archives, Institutional Repositories Introduction to DSpace DSpace and E-Learning Sakai and DSpace

DSpace and E-Learning June 2, 2006 Digital Archives (agenda cont., 1 of 4) Open Archives Information System (OAIS) Reference Model JISC Repositories Deposit API RAMLET (IEEE LTSC) Packaging

DSpace and E-Learning June 2, 2006 DSpace per se (2 of 4) DSpace in General –Audiences, purposes, uses –DSpace architecture, information model –History –DSpace Federation, governance board DSpace and E-Learning –CWSpace (OpenCourseWare) –Stellar Images Tool

DSpace and E-Learning June 2, 2006 Sakai-related (3 of 4) Sakai + Repositories generally –Sakaibrary, Twin Peaks, Fedora, OKI DSpace + Sakai Integration Points –Forthcoming whitepaper, Univ. of Cambridge's CARET Centre for Applied Research in Educational Technologies

DSpace and E-Learning June 2, 2006 Other Speakers (4 of 4) Carnegie Foundation for the Advancement of Teaching –Olga Trusova –Knowledge Media Lab: KEEP Toolkit DSpace + Sakai Integration –Ian Boston –Early initiatives at Univ. of Cambridge's CARET

DSpace and E-Learning June 2, 2006 Scholarly Information Life Cycle

DSpace and E-Learning June 2, 2006 "Cosmic" View of the Repositories Space

DSpace and E-Learning June 2, 2006 Neil McLean's Observations The many different permutations of potential contexts are rarely articulated in a coherent fashion Some tension between managed and unmanaged environments No common methodologies as yet to deal with multiple permutations of context As linked to from JISC(UK)/DEST(Aust.):

DSpace and E-Learning June 2, 2006 Archives "Reference Model" (OAIS) Information Packages: SIP, AIP, DIP = Submission IP, Archival IP, Dissemination IP

DSpace and E-Learning June 2, 2006 Repositories: Variety. Convergence? JISC Deposit API – · WebDAV · OKI OSID · JSR 170 & 283 · SRW Update · Flickr Deposit API · Fedora Deposit API · ECL · Etc. EPrints DSpace Intrallect ARNO Fedora Greenstone HarvestRoad aDORe - LANL OCLC Digital Archive

DSpace and E-Learning June 2, 2006 JISC Deposit API Repository Stores, manages and makes available content and metadata Deposit interface Delete interface Search interface Harvest interface Obtain interface Deposit interface Intelligence: Data format, packaging standard. Data in: Deposit request (content, metadata, etc.) Data out: Deposit status (success, failure, pending, etc.) and content identifier Format checking, editorial control, quality assurance mechanisms, etc.

DSpace and E-Learning June 2, 2006 Universe of Content - WWW University –Academics: CLE, Depts Video Audio Image collection –Libraries Licensed Content $$ –E-Serials, Journals –Vendor Databases Locally-Owned Content –E-Reserves: digitized, scanned –Digital Library Collections –Image collections –Institutional Repository / Digital Archive »E-Scholarship »Image Collections –Learning Objects Repository »Courseware »Learning Objects

DSpace and E-Learning June 2, 2006 World View…

DSpace and E-Learning June 2, 2006 DSpace: Visually Explained Submission: Files | Metadata Organization: Bundle | Item | Collection | Community Curation: Preservation | Rights Mgt. | Admin. Use: Search | Browse | Disseminate | Retrieval

DSpace and E-Learning June 2, 2006 Information Model Item can be mapped to more than one Collection Bundles organize Bitstreams Little in way of associating Items

DSpace and E-Learning June 2, 2006 Eternal Bits MacKenzie Smith IEEE Review article (July 2005)

DSpace and E-Learning June 2, 2006 DSpace Architecture

DSpace and E-Learning June 2, 2006 Current development model

DSpace and E-Learning June 2, 2006 How Did We Get Here? Fast!!

DSpace and E-Learning June 2, 2006 DSpace Federation Governance Advisory Board Formed (March 2006) Digital Curation Centre, UK Australian Partnership for Sustainable Repositories Biomed Central, UK University of Rochester Rice University University of Michigan Coalition for Networked Information University of Toronto Harvard Business School Indian Statistical Institute HP Labs Carelliance BV, Netherlands MIT Libraries "The governance board was convened to draft a recommendation for governance and funding mechanisms… …to advance the DSpace community and ensure that the technology platform remains sound, protecting the investment that institutions have made."

DSpace and E-Learning June 2, 2006 Board Decisions (Mar. 31, 2006) Drafted a statement of mission Made a decision to form an independent foundation and initiated a planning process to accomplish that end Formed an interim steering committee chaired by Chris Rusbridge (Director, Digital Curation Centre, UK) Addressed the need for a technical working group and initiated a road map and white paper process to support that effort

DSpace and E-Learning June 2, 2006 Statement of Mission (Mar. 31, 2006) The draft mission of the DSpace foundation is: to lead the collaborative development of open source software for digital repositories that enables services for access, provision, stewardship and re-use of digital assets with a focus on educational and research materials; to promote the adoption of this technology; and to provide a platform for innovation in these areas with an overarching goal of promoting the dissemination and future utility of information and knowledge.

DSpace and E-Learning June 2, 2006 DSpace In Use Little world tour…

DSpace and E-Learning June 2, 2006

DSpace and E-Learning June 2, 2006

DSpace and E-Learning June 2, 2006

DSpace and E-Learning June 2, 2006

DSpace and E-Learning June 2, 2006

DSpace and E-Learning June 2, 2006

DSpace and E-Learning June 2, 2006

DSpace and E-Learning June 2, 2006

DSpace and E-Learning June 2, 2006

DSpace and E-Learning June 2, 2006

DSpace and E-Learning June 2, 2006 CWSpace Overview * CLE = Collaborative Learning Environment Goal: Archive MIT's OpenCourseWare to MIT’s DSpace –Also: Make content available to CLEs * MIT iCampus project, nearing completion Method: Interoperability of systems –Use Content Packaging standard –Use Web Services standard

DSpace and E-Learning June 2, 2006 OCW Materials in DSpace = New Ground Educational MaterialsDigital Archive New kind of content: educational, teaching, learning POLICY - Cost/merit evaluation of archival treatment. Preservation and IP considerations New emphasis (ideally) on re-use, re-purposing: aggregation, disaggregation GRANULARITY - Challenge to digital archive; how flexible can it be? (cf. CMS) New kind of structure, composition: website, compound digital object, rich metadata COMPLEXITY - Need to package multi-file content, plus metadata New needs for system-to-system access: CLEs, Image Tools BACK-END / FRONT-END - Need for networked access

DSpace and E-Learning June 2, 2006 OCW Materials in DSpace = New Ground Educational MaterialsDigital Archive New kind of content: educational, teaching, learning POLICY - Cost/merit evaluation of archival treatment. Preservation and IP considerations New emphasis (ideally) on re-use, re-purposing: aggregation, disaggregation GRANULARITY - Challenge to digital archive; how flexible can it be? (cf. CMS) New kind of structure, composition: website, compound digital object, rich metadata COMPLEXITY - Need to package multi-file content, plus metadata Content Packaging New needs for system-to-system access: CLEs, Image Tools BACK-END / FRONT-END - Need for networked access Web Services

DSpace and E-Learning June 2, 2006 OpenCourseWare as Content Normalized data model (out of chaos) –"Sections" fit well to publication organization Normalized content files (.PDF) –Reduced ability to disaggregate, re-purpose

DSpace and E-Learning June 2, 2006 Package Interchange File (PIF) IMS Content Package (IMS-CP) uses a.ZIP file with a Manifest XML file and all content files.

DSpace and E-Learning June 2, 2006 "RAMLET" Resource Aggregation Model for Learning Education and Training –IEEE Learning Technology Standards Committee (LTSC). "Conceptual model for digital aggregates of resources for learning, education, and training applications." Various Standards: IMS Content Package METS MPEG21-DIDL XFDU …

DSpace and E-Learning June 2, 2006 Interop: What’s Achievable

DSpace and E-Learning June 2, 2006 Interop: Challenges

DSpace and E-Learning June 2, 2006 InterOp: Possible Resolution?

DSpace and E-Learning June 2, 2006 DSpace dev: LNI & PKGers

DSpace and E-Learning June 2, 2006 DSpace Mapped to WebDAV

DSpace and E-Learning June 2, 2006 WebDAV Methods in LNI PROPFIND - very powerful request with multiple functions: –list names of properties –return property values –recurse through 1 or more levels of a "collection" resource. PROPPATCH - changes value of or deletes properties on one resource. GET - retrieves contents of a resource PUT - replace or add a new resource to a collection COPY - map a resource ("Item") to a different Collection. As noted, equivalent SOAP methods are provided Not Implemented: Locking, Versioning.

DSpace and E-Learning June 2, 2006 Initial Use: OpenCourseWare "Submit"

DSpace and E-Learning June 2, 2006 Current DSpace (pre-LNI) Content Provider, currently Batch import (& export) End user Web U/I dspace-admin Web U/I SRW, OAI-PMH DSpace Batch Importer OCW Comm. "Biology (7)" "Physics (8)" DSpace Object API Web U/I Web, but Non Auto- mated Non Std. Non Web Workflow Adm Item

DSpace and E-Learning June 2, 2006 DSpace with LNI Content Provider using LNI: LNI SOAP end-point URL LNI WebDAV URLs dspace-admin (partial) SRW, OAI-PMH –(Not replicated in LNI) Still available: –Batch import (& export) –End user Web U/I DSpace DSpaceLNI.class OCW Comm. "Biology (7)" DSpace Object API DSpace LNI WebDAV - Web. - Stds. - Batch- able. "Physics (8)" Item

DSpace and E-Learning June 2, 2006 Submission: Overview OpenCourseWare Client Needs 3 Values : 1.LNI SOAP end-point URL edu/dspace-lni/lni/DSpaceLNI 2.Handle for OCW Community = hdl:1721.1/125 3.Dept. Name (MIT "Course" Number) for Course to be submitted = "Physics (8)" DSpace DSpaceLNI.class OCW Comm /125 "Biology (7)" DSpace Object API DSpace LNI WebDAV Lang. - Indep. Platform - Indep. "Physics (8)" Item

DSpace and E-Learning June 2, 2006 Submission: 1. Lookup Request: OCW Comm. HANDLE LNI lookup() = lni/dav/lookup/handle/1721.1/125 Response: OCW Comm. LNI URL DSpace DSpaceLNI.class OCW Comm /125 dso_1721.1$125 "Biology (7)" dso_1721.1$197 "Physics (8)" dso_1721.1$253 DSpace Object API DSpace LNI WebDAV Lookup

DSpace and E-Learning June 2, 2006 Submission: 2. Collections Request: PROPFIND on LNI URL for children DSpace Collections' "displaynames": Response: MULTISTATUS Biology (7) Physics (8)... DSpace DSpaceLNI.class OCW Comm /125 dso_1721.1$125 "Biology (7)" dso_1721.1$197 "Physics (8)" dso_1721.1$253 DSpace Object API DSpace LNI WebDAV Iterate…

DSpace and E-Learning June 2, 2006 Submission: 3. Submit (PUT) Request: PUT to DSpace Collection LNI URL, including specification of Packager Type (IMS- CP): PUT /dspace/dav/dso_1721.1$253?package=OCW- IMSCP....package contents in body... Response: LNI URL for DSpace Item in "Location" Header: HTTP/ OK Location: other headers.... DSpace DSpaceLNI.class OCW Comm /125 dso_1721.1$125 "Physics (8)" dso_1721.1$253 DSpace Object API DSpace LNI WebDAV Ingest Item dso_1721.1$836

DSpace and E-Learning June 2, 2006 Submission: 4. Item Handle Request: PROPFIND on DSpace Item LNI URL for the DSpace Handle: Response: Properties Requested === PROPERTIES Successfully returned: dspace:handle = " hdl:1721.1/836 " DSpace DSpaceLNI.class OCW Comm /125 dso_1721.1$125 "Physics (8)" dso_1721.1$253 DSpace Object API DSpace LNI WebDAV Reverse Lookup Item dso_1721.1$ /836 OCW Content Mgt. System Stores DSpace Handle SQL Server Table: hdl:1721.1/836

DSpace and E-Learning June 2, 2006 Submission: Summary In this 4-step OpenCourseWare submission example, we've seen: SOAP endpoint URL DSpace Handles DSpace LNI URLs LNI Lookup() function WebDAV Properties WebDAV Methods PROPFIND (LNI request) MULTISTATUS (LNI response) LNI "Reverse Lookup" WebDAV Headers (Location; Success/Fail) DSpace DSpaceLNI.class OCW Comm /125 "Physics (8)" /253 DSpace Object API DSpace LNI WebDAV Item /836

DSpace and E-Learning June 2, 2006 Stellar Image Tool Dspace as "back-end" to Teaching & Learning application Stellar add-on tool + OKI + SRW + DSpace Also note: Sakai Tool (Berkeley) + t.b.d. (OKI?) + Fedora's Web Services

DSpace and E-Learning June 2, 2006 Sakai + Fedora Integration Posts (April 2006) Intersection between Sakai and Fedora –Idea: " … to make Fedora the content repository for Sakai, as opposed to a Sakai search/browse/retrieve/edit tool for Fedora. " Peter Murray, OhioLINK –

DSpace and E-Learning June 2, 2006 Further Discussion: Sakai + Repository Integration JSR-170? No longer. "You must implement ContentHostingService API" –Wide implications –Plugin pattern better idea OKI OSID DR = secondary interface to repositories Alternative: Extend ContentHosting… repository gateway –Implementation at CARET (IMS-CP player)

DSpace and E-Learning June 2, 2006 Sakai Content: Resource Tool

DSpace and E-Learning June 2, 2006 Sakai Content: "The" Repository

DSpace and E-Learning June 2, 2006 Sakai Content: External Repositories

DSpace and E-Learning June 2, 2006 Sakai + DSpace Integration forthcoming whitepaper

DSpace and E-Learning June 2, 2006 Sakai + DSpace: Integration Report (CARET) Preliminary ideas from a forthcoming whitepaper - Univ. of Cambridge CARET Background, sources Focus group results: Areas of interest (Use Cases) (Models) Tools, Projects Roadmap, Recommendations Source: Univ. of Cambridge CARET Whitepaper (forthcoming)

DSpace and E-Learning June 2, 2006 Where to "Intervene"? Background to Integration Report –Case studies reviewed –Projects interviewed –Interventions: technical, non-technical –For DSpace, for Sakai –Gaps, enabling technologies identified Source: CARET Whitepaper (forthcoming)

DSpace and E-Learning June 2, 2006 Current View Web Services exposed, not (yet) exercised (extensively) Source: CARET Whitepaper (forthcoming)

DSpace and E-Learning June 2, 2006 E-Learning View? For a CLE/CMS, what is exact relation of "Repository" notion to "Storage" needs … ? Source: CARET Whitepaper (forthcoming)

DSpace and E-Learning June 2, 2006 Peer Systems View Web Services for loosely coupled peer systems Note the CMS W/S point to Repository business, not storage. Source: CARET Whitepaper (forthcoming)

DSpace and E-Learning June 2, 2006 Focus Group Results Time pressure, chaos Search within CMS; not web Hurdle in publication process Multi-homed work Imaging and visualization tools valued Continued importance of face-to-face meetings Overoptimistic re: own preservation "Disinterest" in repositories, archives Repository "fear" Metadata fear Source: CARET Whitepaper (forthcoming)

DSpace and E-Learning June 2, 2006 Related Topics of Interest Cross-pollination talks: CLEs and IRs "Rebranding" of repository svcs. "Unrolling" repository svcs. (separating out) Policy Manifestation transferability Metadata quality mismatch Breaking the preprint model Supporting informal meetings (PPW Personal Professional Webpage) Source: CARET Whitepaper (forthcoming)

DSpace and E-Learning June 2, 2006 Some Guiding Principles Tools available at multiple locations Authors should feel in control: –Preservation –Dissemination –Metadata –Availability, access Metadata implicitly collected where possible Permit librarians to manage metadata of differing quality Convey to depositors nature of qualified acceptance of some materials Source: CARET Whitepaper (forthcoming)

DSpace and E-Learning June 2, 2006 Options for Tools, Projects 1.Extending Sakai Resource Tool 2.Site Archive 3.Collections Workflow 4.Policy Manifestation Source: CARET Whitepaper (forthcoming) 5.Showcase Tool 6.Bibliography Tool 7.Learning Object Creation Tools 8.Search Tool 9.PPWs 10.Ad hoc Collections 11.Realtime Discovery 12.Sakai-delegated Permission 13.Erobots 14.Item History 15.Migration Services

DSpace and E-Learning June 2, Extending Sakai Resource Tool (briefly) Ian Boston, CARET, will describe… – "…a plugin into ContentHostingService … Once it 'owns' the node, it takes responsibility for providing ContentResources for that node and all child nodes. …implemented an IMS-CP plugin, that 'plays' IMS-CP files …could use to 'mount' a repository"

DSpace and E-Learning June 2, Site Archive (briefly) Dan Sheppard, CARET, may implement Leverage CWSpace

DSpace and E-Learning June 2, Collections Workflow Motivation: need to accept submissions of varying quality. Partitioned to separate collections; not all visible Put Items into workflow: maintains a state re: –Dissemination, preservation guarantees –Metadata quality requirements Events trigger workflow actions –Add to OAI-PMH set –Migration –Add to or retract from public catalogue Extends existing DSpace Workflow to fuller lifecycle Source: CARET Whitepaper (forthcoming)

DSpace and E-Learning June 2, Policy Manifestation (1 of 3) (not briefly (!)) "Handshake" at beginning of Web Services connection –Layer above LNI or DR OSID Machine-readable exchange of policies –Available collections –Restrictions on Epersons –Collections using specialist tools –Required notices, agreements to/from Sakai user –Copyright, licensing, preservation, dissemination requirements –Required metadata, mandatory keys, acceptable ranges –Extra metadata searches by collection Source: CARET Whitepaper (forthcoming)

DSpace and E-Learning June 2, Policy Manifestation (2 of 3) Fragments: simple, uncontroversial action-based policy snippets –E.g. Creative Commons license four constraints Expressed in RDF = extensible Example ideas: –Special structure or contents of collections Contact details for collection's maintainer Programs under which collection is managed –Repository status E.g. Patches available for special image gallery handling Source: CARET Whitepaper (forthcoming)

DSpace and E-Learning June 2, Policy Manifestation (3 of 3) Sakai functionality: –Ability to display (repository-defined) notices to user at ingest –Ability to display (negotiated) drop-downs, re: collections, metadata –Ability to check Sakai IP properties are consistent with repository IP –Ability to modify search per abilities of search tools –Ability to associate items pulled notices (e.g. bibliography tool) –Ability to fulfill license requirements (CC and metadata fields) "Sticky" folders could help with implicit or default values inheritance… Source: CARET Whitepaper (forthcoming)

DSpace and E-Learning June 2, 2006 Summary Table (1 of 2) Variety of quite preliminary ideas surfaced… Source: CARET Whitepaper (forthcoming)

DSpace and E-Learning June 2, 2006 Summary Table (2 of 2) Some work to be commissioned this summer Source: CARET Whitepaper (forthcoming)

DSpace and E-Learning June 2, 2006 DSpace and E-Learning: Other Observations… Olga Trusova, Carnegie Foundation for the Advancement of Teaching Ian Boston, Univ. of Cambridge (CARET)

DSpace and E-Learning June 2, 2006 DSpace and E-Learning: Discussion, Questions William Reilly MIT Libraries Digital Library Research Group (DLRG) Presenting on behalf of several colleagues… MacKenzie Smith, Julie Walker, Rob Tansley, Larry Stone v _1000 PDT

DSpace and E-Learning June 2, 2006 DSpace & E-Learning: Abstract An introductory presentation to DSpace, the digital archive system and open source community. The precise relation of a digital archive to a collaboration and learning environment (CLE) like Sakai is a topic very much in development. Preliminary ideas on potential integration points will be presented, from a forthcoming whitepaper [1]. These will be discussed within the context of recent Sakai discussion group activity on closely related topics (e.g. Sakaibrary, Twin Peaks, Fedora, OKI, repositories generally). Comparison of "repository" as a component of the architectural stack of a CLE (akin to Sakai's Resource Tool and ContentHosting API), vs. "repository" or digital archive as a peer system to a CLE, whereby interoperation is achieved via Web Services. General topics include: DSpace's architecture, information model, its other (non E- Learning) audiences & purposes, its open source community, and the DSpace Federation governance board. E-Learning-related topics include: CWSpace: archiving MIT's OpenCourseWare (OCW) to DSpace; and the Stellar Image Tool, using DSpace as backend. Contributing speakers to include some remarks from Indiana University vis-a-vis repositories as they relate to the current scope of Sakaibrary; remarks from Univ. of Cambridge initial experiments with Sakai and DSpace integration; and a report from the Carnegie Foundation for the Advancement of Teaching exploration of DSpace as candidate back- end and dissemination platform (non Sakai-related) for their KEEP Toolkit (see Technical Demos). [1] Univ. of Cambridge, CARET, "DSpace/Sakai Integration Report" (draft May 16, 2006)