16th International Seminar CASLIN Open Access and Institutional Repositories from local initiatives to global strategies Friedrich Summann Bielefeld University Library 16Th International Seminar CASLIN 2009

16th International Seminar CASLIN Overview Local initiatives - Open Access strategy and implementation National Projects - Funded projects (DFG, German Science Foundation) International Projects - BASE, DRIVER, PEER

16th International Seminar CASLIN Open Access in Bielefeld University Archiving Electronic Dissertations (1996 -) First Repository System (2004) University Resolution for Open Access Publishing (2005) Establishing Postprint Server (2006 -) CIO for Scientific Publishing (2006 -)

16th International Seminar CASLIN UNIBI repositories: BieSON (Dissertations, 2004) (1121 docs) BieTAS (Distributed material, 2005) (330 docs) BieColl (Proceedings, 2007) (2530) BiPrints (Scientific Output, 2008) (2367)

16th International Seminar CASLIN BieSOn

16th International Seminar CASLIN BieTAS (Bielefeld Text Archiv Server)

16th International Seminar CASLIN BieColl (Bielefeld eCollections)

16th International Seminar CASLIN BiPrints

16th International Seminar CASLIN Visibility of Repositories

16th International Seminar CASLIN Current Library and University Activities BioMed Central Contract DINI partner Electronic Journal Publishing –DIPP NRW –OJS installation Cooperation Research Database - Repository

16th International Seminar CASLIN DIPP journal frontpage for UNIBI journal

16th International Seminar CASLIN University Research Database (FODA)

16th International Seminar CASLIN National Projects Open-Access.net OPUS4 PubLister Automatic Classification Extraction Funded by the DFG (Deutsche Forschungsgemeinschaft, German Science Foundation)

16th International Seminar CASLIN Open-Access.net

16th International Seminar CASLIN PubLister DFG Project (18 months) Goals: Integration of scientists personal publications lists into the university publishing process Extracting metadata Storing the postprint (repository) Producing a university bibliography Organizational and technical framework for the creation of publication lists

16th International Seminar CASLIN Automatic Enrichment of OAI Metadata DFG-Project (German Science Foundation) Duration: 24 months Partners: Bielefeld University Library (coordination) Bielefeld University, Computer Linguistics Department Leipzig University, Institute for Computer Science

16th International Seminar CASLIN Automatic Enrichment of OAI-Metadata Current status of Classification Information in OAI metadata: Only 1 % with classification codes Different classification systems Depth is not sufficient

16th International Seminar CASLIN Automatic Enrichment of OAI-Metadata Work packages Extraction of Classification codes and related information from OAI metadata Building a knowledge base Structured text mining Delivering DDC codes for documents Designing an open interface Integrating into Services (BASE, DRIVER)

16th International Seminar CASLIN Extraction of Classification codes and related information from OAI metadata 370 Fremdsprachenlernen Deutschunterricht Ausl nder Lerner-Uptake Kurzzeitiger Fremdsprachenerwerb Education ger bielefeld.de/volltexte/2002/97/pdf/3_versicherung.pdf

16th International Seminar CASLIN Automatic Enrichment of OAI-Metadata Work packages Extraction of Classification codes and related information from OAI metadata Building a knowledge base Structured text mining Delivering DDC codes for documents Designing an open interface Integrating into Services (BASE, DRIVER)

16th International Seminar CASLIN OPUS4 8 Partners (libraries and library networks) DFG project ( – ) Modernized and enhanced software release Bielefeld UL work packages DRIVER Interoperability Collections CRIS – IR integration

16th International Seminar CASLIN International Projects BASE (Bielefeld Academic Search Engine) DRIVER PEER

16th International Seminar CASLIN BASE (Bielefeld Academic Search Engine) Commercial software (FAST backend) Local server farm PHP frontend (Bielefeld UL) OAI Harvesting / Web Crawling Few library people Content worldwide OA-focused

16th International Seminar CASLIN Repositories –> 22,000,000 metadata records Harvested/analyzed 1260 Repositories –> 19,700,000 aggregated/indexed BASE (Bielefeld Academic Search Engine)

16th International Seminar CASLIN BASE – Advanced Search

16th International Seminar CASLIN BASE – Search features Truncation Search History Drilldown Linguistic Search Features –Thesauri –Lemmatizing DDC Browsing Sorting Google Scholar Link

16th International Seminar CASLIN BASE – Result Display

16th International Seminar CASLIN BASE – Common interface Currently used by Metager (German meta search engine) KVK (Karlsruhe Virtual Catalogue) Digital Library NRW (metasearch portal) Local Library Catalogue

16th International Seminar CASLIN BASE – OPAC integration

16th International Seminar CASLIN DRIVER - the Project (1) DRIVERI: – Building a Testbed for a Future Knowledge Infrastructure in Europe based on Scientific Publications in Repositories DRIVER = Digital Repository Infrastructure Vision for European Research

16th International Seminar CASLIN DRIVER - the Project (2) DRIVERII: Establishing a Productive Infrastructure Expansion of Geographic Coverage Extension of Metadata and Data Formats Extension of Services

16th International Seminar CASLIN DRIVER – Partners Phase 1 10 Partners from 8 Countries (D, GB, IT, F, NL, B, PL, GR) Phase 2 3 additional project partners (PT, DK, SI) Additional partners (S, N, FI, LT, ES, IRL) Co-ordination: Univ. Athens, SUB Göttingen

16th International Seminar CASLIN DRIVER – Bielefeld UL Technical Activities (Technical Group) –Harvesting/Aggregation –Storing –Indexing Network Activities –Guidelines Definition –Harvesting/Aggregation (Feedback) OPUS4 Project (DRIVER Interoperability)

16th International Seminar CASLIN DRIVER: Repository Infrastructure Phase 1: –51-Testbed Repositories (DINI, DARE, SHERPA, CNRS, Univ. Gent) Phase 2: –Plus further DRIVERI countries –DRIVERII countries –Other European Countries

16th International Seminar CASLIN DRIVER – Core aspects Open source software SOA structure Based on OAI harvesting Network of partners Academic content from Europe OA documents only

16th International Seminar CASLIN DRIVER Repository Workflow Registration of Repository Managers Proposals from Country Correspondents Observing Registries Analysis/Validation Harvesting/Aggregating/Indexierung Activation

16th International Seminar CASLIN DRIVER: OAI Aggregation Goal: Data Quality Improvement Normalisation (Vocabulary-based) –dc:type –dc:date –dc:language Language Detection Extraction of Document Link Rules Definition Scripting

16th International Seminar CASLIN Data Quality (Example dc:type) Text text TEXT Dataset Image image Electronic Thesis or Dissertation Tese ou Dissertacao Eletronica article Article Artikel Other still image Rezension preprint NonPeerReviewed NULL Clippings Text This record contains content Dark Item Photographs; Mosaics; photographic print mounted on cardboard: b&w; 22 x 16 in Section V Flow Control - 1 Acrylic on board: 63 x 114 cm Colored graphite on paper: 47 x 63 cm. - 1 texts, vocabulary ('stories, monologues, word list' ,542,177 Entries Values

16th International Seminar CASLIN DRIVER - Aggregator (1)

16th International Seminar CASLIN DRIVER – Aggregator (2)

16th International Seminar CASLIN DRIVER – Aggregator (3)

16th International Seminar CASLIN DRIVER Guidelines

16th International Seminar CASLIN DRIVER Guidelines and OAI usage OAI-PMH : Protocol Requirements –Stability, Protocol compliance, XML validity –Incremental Harvesting OAI-PMH: Additional Requirements –Deleting strategy –Set für OA-Dokumente, Fulltext link –Batch size DRIVER DC Metadata Requirements –Content Recommendations (creator, subject, source) –Standardized Contents (type, language, date)

16th International Seminar CASLIN DRIVER – Validator tool

16th International Seminar CASLIN DRIVER – Aggregational Results

16th International Seminar CASLIN DRIVER network of academic repositories …

16th International Seminar CASLIN DRIVER – Support Network

16th International Seminar CASLIN

16th International Seminar CASLIN PEER = Publishing and the Ecology of European Research Focus: relationship between publishers, repositories and the research community evaluate the bi-directional influence of the different strategies of publications (publishers journal, open access publication)

16th International Seminar CASLIN PEER (2) More than 50,000 European accepted manuscripts from up to 300 journals will become available for archiving within repositories BiPrints will serve as OA repository Comparing access log files

16th International Seminar CASLIN Conclusion All these listed activities are related to open access publishing There are strong bi-directional impacts between each other It makes no difference on which level Integration will produce benefit for scientists and end-users

16th International Seminar CASLIN Thank You !