Data Acquisition and Data Publishing with eSciDoc Matthias Razum DataCite Summer Meeting Hannover June 7-8, 2010

Slide Agenda Data Acquisition and Data Publishing with eSciDoc - DataCite Summer Meeting2 eSciDoc in a nutshell How to get the data into the repository Data publication

Slide Continuum of Data Idea Exploration Idea Exploration Data Acquisition Experiment Data Acquisition Experiment Aggregation Analysis Aggregation Analysis Publication Archival Publication Archival eSciDoc Infrastructure eSciDoc Solutions, Services, and exisiting Tools Collaboration eSciDoc Vision 3Data Acquisition and Data Publishing with eSciDoc - DataCite Summer Meeting

Slide Detour 4: eSciDoc Services Data Acquisition and Data Publishing with eSciDoc - DataCite Summer Meeting4 User Account Handler Role Handler Group Handler Security Statistics Manager Object Manager Item Service Container Service Organizational Unit Service Policy Enforcement Point Context Service Set Service Content Model Service Aggregation Definition Service Statistics Data Service Scope Service Report Service Report Definition Service Admin Service Technical Metadata Extraction Search and Indexing Digilib PID Service Duplicate Detection Admin Tool OAI-PMH Control of Named Entities Data Acquisition Service Transformation Citation Style Service Deposit (SWORD) Validation

Slide Item Item Resource ThumbnailWeb ResolutionOriginal ResolutionThumbnailWeb ResolutionOriginal Resolution Metadata Container 5Data Acquisition and Data Publishing with eSciDoc - DataCite Summer Meeting

Slide Agenda Data Acquisition and Data Publishing with eSciDoc - DataCite Summer Meeting6 eSciDoc in a nutshell How to get the data into the repository Data publication

Slide Data in the Publication Process Today Library Publication Manuscript Private Files Data Metadata J. Helly, H. Staudigel, and A. Koppers, Scalable models of data sharing in Earth sciences, Geochem. Geophys. Geosyst., 4(1),1010, doi: /2002GC000318, 2003 Research 7Data Acquisition and Data Publishing with eSciDoc - DataCite Summer Meeting

Slide BW-eLabs Data Acquisition and Data Publishing with eSciDoc - DataCite Summer Meeting8 BW-eLabs gives access to virtual and remote experiments in the field of nano technology and holography. Key concepts include: reproducability of experiments discoverability of and access to primary data storage and curation of all artifacts that emerge throughout the research process Project partners Universität Stuttgart HdM Stuttgart Universität Freiburg FIZ Karlsruhe

Slide Preparation BW-eLabs: Collecting Data throughout the Research Process Synthesis and Online Analysis Offline Analysis and Visualisization Publication Common Data Infrastructure Experiment Data Objects Experiment Data Objects Experiment Data Objects 9Data Acquisition and Data Publishing with eSciDoc - DataCite Summer Meeting

Slide Data Center OfficeLaboratory BW-eLabs: Data Acquisition in the Lab Data Acquisition and Data Publishing with eSciDoc - DataCite Summer Meeting10 Infrastructure eSync Daemon Deposit Service Data files from online analysis Monitored folder Instrument (e.g. spectroscope) Replicated data files Metadata Extractor MD Data file for metadata extraction Extracted metadata eLab Solution eSciDoc Items Creates new experiment (Container) POSTs new configuration to eSync daemon

Slide Core Scientific Metadata Model Data Acquisition and Data Publishing with eSciDoc - DataCite Summer Meeting11 B. Matthews et al. Using a Core Scientific Metadata Model in Large-Scale Facilities. 5th International Digital Curation Conference. London, 2009.

Slide BW-eLabs: Metadata Model Data Acquisition and Data Publishing with eSciDoc - DataCite Summer Meeting12 Institution Study Investigator Dataset Rig Instrument Related Datafile Datafile Sample Investigation

Slide Data Acquisition and Data Publishing with eSciDoc - DataCite Summer Meeting13 Organizational Unit Work Group Context Nano Lab Container Study X Container Investigation 1 Other Investigations for Project X Item Datafile Container Dataset User Account Organizational Unit Institut Other StudiesRig Descriptions Context Rigs Other Datasets for Investigation 1 Instrument Descriptions Context Instruments Item Sample Item Configuration

Slide Data Acquisition and Data Publishing with eSciDoc - DataCite Summer Meeting14 Organizational Unit Work Group Context Nano Lab Container Study X Container Investigation 1 Other Investigations for Project X Item Datafile Container Dataset User Account Organizational Unit Institut Other StudiesRig Descriptions Context Rigs Other Datasets for Investigation 1 Instrument Descriptions Context Instruments Item Sample Item Configuration isConfigurationOf requires consistsOf isMeasuredWith

Slide Agenda Data Acquisition and Data Publishing with eSciDoc - DataCite Summer Meeting15 eSciDoc in a nutshell How to get the data into the repository Data publication

Slide Data Publication Support in eSciDoc Object Lifecycle Versions Persistent Identifiers Authentication and Authorization Linking Resources Data Acquisition and Data Publishing with eSciDoc - DataCite Summer Meeting16

Slide Item/Container Lifecycle Data Acquisition and Data Publishing with eSciDoc - DataCite Summer Meeting17 Quality control/ editorial process Creator cannot modify the object any longer Metadata may still be enriched Quality control/ editorial process Creator cannot modify the object any longer Metadata may still be enriched Object publically accessible Version is fixed Metadata can be harvested Full-text indexed Object publically accessible Version is fixed Metadata can be harvested Full-text indexed Access to object is restricted Only metadata is publically accessible Access to object is restricted Only metadata is publically accessible Only the creator can access and modify the object Collaborators may be invited Object may be deleted Only the creator can access and modify the object Collaborators may be invited Object may be deleted pending released withdrawn in-revision submitted

Slide Lifecycle, Versions, and Persistent Identifiers Data Acquisition and Data Publishing with eSciDoc - DataCite Summer Meeting18 version-status public-status Version released 3 pending released 4 submitted released 4 4 pendingsubmittedpendingsubmitted Resource Visible version for unprivileged users (role default) Visible version for creator (role depositor) submit() release() Creator contiues to work on resource submit() release() Creator saves and contiues to work on resource Object PID /1 Version PID /2 Version PID /3

Slide Authentication and Authorization Scope Policies Roles Actions Groups User Resource Policy Decision Point 19Data Acquisition and Data Publishing with eSciDoc - DataCite Summer Meeting

Slide Discipline-specific Data Repositories Data Acquisition and Data Publishing with eSciDoc - DataCite Summer Meeting20

Slide eSciDoc Linking Resources PID Service PID 1 PID 2 PID 3 PID 4 Other Repositories Shibboleth LDAP OAI-PMH OAI-ORE OpenSearch SRU/W 21Data Acquisition and Data Publishing with eSciDoc - DataCite Summer Meeting

Thank you!