Dataverse at Scholars Portal Alan Darnell Director, Scholars Portal.

Slides:



Advertisements
Similar presentations
Texas Digital Library Services Preservation Network.
Advertisements

Preserv Preservation Eprint Services Scenario: Digital lifecycle begins with author creation and deposit of paper or data content into the institutional.
Data Publishing Service Indiana University Stacy Kowalczyk April 9, 2010.
Preservation as a Process of a Repository David Tarrant University of Southampton (UK) Preserv Repository Preservation and Interoperability.org.uk.
The Future of Scholarship in the Digital Age: The Role of Institutional Repositories Ann J. Wolpert Director of Libraries Massachusetts Institute of Technology.
Data Management: Metadata, Repositories and Curation Tony Mathys, Anne Robertson Eddie Boyle, Guy McGarva GeoForum, 4 th November, York.
The future’s so bright…. DAITSS DIGITAL PRESERVATION SYSTEM: RE-ARCHITECTED, RE- WRITTEN, AND OPEN SOURCE Priscilla Caplan Florida Center for Library Automation.
Ontario University Library Consortia Activity Ontario University Library Consortia Activity Gwendolyn Ebbett Dean of the Library University of Windsor.
First Year in Focus at Canadian Colleges and Universities.
Archivematica-Islandora Integration Module Evelyn McLellan
Robust Tools for Archiving and Preserving Digital Data Joseph JaJa, Mike Smorul, and Mike McGann Institute for Advanced Computer Studies Department of.
Durable Digital Repositories: The DSpace Project Bill Jordan University Libraries.
Data Management Plans For Universities and Institutes of Higher Education and Research Ray Uzwyshyn, Ph.D. MBA MLIS Director, Collections and Digital Services,
August 14, 2015 Research data management – an introduction Slides provided by the DaMaRO Project, University of Oxford Research Services.
EZID (easy-eye-dee) is a service that makes it simple for digital object producers (researchers and others) to obtain and manage long-term identifiers.
Digital Asset Management for All? Visualising a Flexible DAMS Solution for Small and Medium Scale Institutions Paul Bevan Llyfrgell Genedlaethol Cymru.
ETD Repositories Using DSpace Software Andrew Penman The Robert Gordon University 27 th September 2004.
Digital Library Architecture and Technology
Scholars Portal Project Ontario Council of University Libraries Scholars Portal in 2007 A Progress Report Leslie Weir Université d’Ottawa - University.
#watitis2014 ONTARIO LIBRARY RESEARCH CLOUD: BUILDING A PROVINCE-WIDE RESEARCH CLOUD FOR ONTARIO’S ACADEMIC LIBRARIES.
DuraCloud A service provided by Sandy Payette and Michele Kimpton.
 EPrints & Preservation David Tarrant University of Southampton (UK) Preserv Repository Preservation and Interoperability.org.uk.
METS-Based Cataloging Toolkit for Digital Library Management System Dong, Li Tsinghua University Library
David Tarrant University of Southampton Applying Open Storage to Institutional Repositories.
Taking Ownership of Electronic Journals & Books: A Tale of Two Repositories CNI Spring 2012 Meeting Alan Darnell Director, Scholars Portal.
Ontario Library Research Cloud: Building A Province-Wide Research Cloud for Ontario’s Academic Libraries Pascal V. Calarco, University of Waterloo IGeLU.
Using the Open Metadata Registry (openMDR) to create Data Sharing Interfaces October 14 th, 2010 David Ervin & Rakesh Dhaval, Center for IT Innovations.
Big Data Challenges in the Federal Government July 8, 2013.
Introduction to Apache OODT Yang Li Mar 9, What is OODT Object Oriented Data Technology Science data management Archiving Systems that span scientific.
Collaborative Markup of Library and Research Data Examples from Ontario Council of University Libraries (OCUL)
A Journey in Data Discovery Wendy Watkins TSES October, 2007.
IASSIST 2008 Collection, Communication, Access and Preservation IASSIST 2008 – session E3 Yesterday, Today and Tomorrow: Data on the Web from Vision to.
File format registries - a global infrastructure for local persistence Andreas Aschenbrenner, ERPANET.
EPrints 10 Years of Digital Preservation. What is EPrints For?  EPrints offers a safe, open and useful place to store, share and manage material in the.
The Canadian Information Network for Research in the Social Sciences and Humanities Tim Au Yeung and Mary Westell Libraries.
June 3, 2016 Research data management – an introduction Slides provided by the DaMaRO Project, University of Oxford Research Services.
Developing strong data roots in fertile library soil: e-science in canadian libraries Geoff Harder Canadian eResearch Community, CLA, 2013.
Digital library infrastructure -- systems Repositories for storing digital resources protect, manage, deliver, and preserve digital resources over time.
The Mint Mapping tool The MoRe aggregator Vassilis Tzouvaras, Dimitris Gavrilis National Technical University of Athens Digital Curation Unit - IMIS, Athena.
Institutional Repositories: the DSpace Experience Ann J. Wolpert Director of Libraries Massachusetts Institute of Technology.
Improving User Access to Metadata for Public and Restricted Use US Federal Statistical Files William C. Block Jeremy Williams Lars Vilhuber Carl Lagoze.
Standards and the digital life cycle NOF Digitisation Workshops September 2000 Alice Grant Consulting Including additional notes and.
Data Wrangling: Developing Local Best Practice for Born Digital Metadata Tracy Popp, Digital Preservation Coordinator Ayla Stein, Metadata Librarian University.
USGS ScienceBase Making Connections with Metadata Integration GSA2011 R. Sky Bristol.
Making the Case for Curation: The Practical Experiment of DSpace Managing Digital Assets February 5-6, 2005 Charleston, SC Ann J. Wolpert, Director of.
Developing a Dark Archive for OJS Journals Yu-Hung Lin, Metadata Librarian for Continuing Resources, Scholarship and Data Rutgers University 1 10/7/2015.
Digital Preservation What, Why, and How? Dan Albertson’s Digital Libraries Class April 13, 2016 Jody DeRidder Head, Metadata & Digital Services University.
Durable Digital Repositories: The DSpace Project Bill Jordan University Libraries.
Mission: Be a leader in the digital curation research and education fields, and foster interdisciplinary partnerships using Big Records and Archival Analytics.
Jeff Moon Data Librarian &
Accessing the VI-SEEM infrastructure
Scholars Portal Update UTL Reference Services Committee June 2004
Data Sharing We all need data
DI4R, 30th September 2016, Krakow
CFI John R Evans Leaders Fund Digital Data Management
Jay Bhatt Drexel University Libraries
The Institute of Quantitative Social Science
The API Advantage Utilizing Cloud Data Sources for Transit Modeling
End-to-End Machine Learning with Apache AsterixDB
Odum Institute iRODS Policies to Support Preservation
Caitlin Tillman University of Toronto
Print & Digital Preservation: Current Status, Future Opportunity
Portage Progress Report
Metadata to fit your needs... How much is too much?
Bulk Data Task Force Update Government Publishing Office
Dataverse for citing and sharing research data
Research data lifecycle²
Vancouver Public Library
AUC’s Role In Facilitating Access To Knowledge In The Arab World
Presentation transcript:

Dataverse at Scholars Portal Alan Darnell Director, Scholars Portal

Ontario Council of University Libraries (OCUL) Scholars Portal is the technology support service of OCUL … Tackle problems that are too big for any one institution 21 Libraries 450,000 FTE

Numeric Data Published data, highly curated

Geospatial Data Published data, highly curated

SP Research Data Repository Thank you IQSS ! dataverse.scholarsportal.info

Dataverse 3 Open to any researcher – 77 published datasets – 472 studies – 6,357 files Slow but growing uptake from libraries – 12 institutional dataverses Wide range of file formats – WARC files, Twitter feeds, spreadsheets, documents, historical census data, survey files, image files, weather data, etc…

Dataverse 4 Stronger institutional focus DataCite DOIs Shibboleth Canadian Access Federation Internationalization (coming soon) September 2016

A wish list

Ontario Library Research Cloud Utilize existing network and data center facilities in Ontario universities to build a PB-scale distributed storage network using OpenStack object storage (Swift) and commodity storage hardware cost-effective long-term storage for digital assets 5 nodes / 370 TB Ottawa, Queens, York, Toronto, Guelph

Wish 1 : Big Data Support for in place ingestion of files stored in the cloud Storage Model that supports block and object services – OpenStack Swift & S3 – ownCloud and DropBox

Dataverse > Archivematica > Swift Image Credit: Julie Allinson, University of York Storage Service Dashboard OLRC

Wish 2 : Digital Preservation PREMIS – Standard vocabulary to record preservation actions like ingest, transformation PRONOM – Enhanced file identification – droid, Siegfried, FIDO METS – Structural representation of complex digital objects Native XML Export – Concern about JSON as a preservation format

Wish 3 : Plugin Architecture Allow domain specialists to extend file support through a plugin architecture – Encourage and enable community contributions Methods – Describe – Thumbnail – View – Download – Explore – Transform My New File Format

Wish 4 : Tools for Analysis Jupyter and Zeppelin are interactive web based tools used for analysis of a wide range of data formats Use of Apache Spark as a processing engine for big data