Dam It ! Larry Gall Peabody Museum of Natural History Yale University.

Slides:



Advertisements
Similar presentations
DELOS Highlights COSTANTINO THANOS ITALIAN NATIONAL RESEARCH COUNCIL.
Advertisements

Access and Operations Transforming the University of St Andrews Photographic Collection KE EMu European User Group Meeting April, 2012.
An Introduction to Repositories Thornton Staples Director of Community Strategy and Alliances Director of the Fedora Project.
EMu in extremis Larry Gall Peabody Museum of Natural History Yale University.
“Can you digitise this for me please?” The University of Auckland's approach to managing digitisation proposals John Garraway Digital Services & Information.
The Caught and Coloured website: its EMu origins Alex Chubaty – Collection Information Systems Craig Churchill – IT Software Development Museum Victoria.
Best Practices for Managing & Motivating the Digitizers Larry Gall Computer Systems Office Yale Peabody Museum of Natural History.
Deploying CollectionSpace for the UC Botanical Garden Innovations for Museums & Research Collections Chris Hoffman UC Berkeley – Research IT UCCSC 2013.
Collections Digital Strategy Alan Hart. Collections Digital Strategy Science Strategy: Challenge: A new generation of natural history museums – revolutionise.
Common Administration "We work together because we have the same employer.“ Ann T. Speyer Chief Information Officer Smithsonian Institution.
MIDESS Management of Images in a Distributed Environment using Shared Services. Dr Stephen Charles MIDESS Project Manager.
ISO & OAI-PMH By Neal Harmeyer, Amy Hatfield, and Brandon Beatty PURDUE UNIVERSITY RESEARCH REPOSITORY.
Going Virtual: Using EMu to organize and present Canada’s cultural heritage.
DSpace Devika P. Madalli DRTC, ISI Bangalore.
Cross Collection Discovery in the Yale Digital Commons Youn Noh November 19, 2010.
Chronopolis: Preserving Our Digital Heritage David Minor UC San Diego San Diego Supercomputer Center.
ENCompass at Cornell Prepared by Karen Calhoun for the ARL Meeting on Portal Implementations ALA, Atlanta GA June 14, 2002 ~Cornell University Library.
Internet Resources Discovery (IRD) IBM DB2 Digital Library Thanks to Zvika Michnik and Avital Greenberg.
National Digital Library of Finland: How to Enable Access to Digital Cultural Material to Users of Today and to Future Generations Minna Karvonen IASSIST.
Exploring archives online Joanne Fitton and Jonathan Ainsworth EMu Users Conference 23 April 2015.
Asset Management System for CoolStateLA Thesis Presentation Winter 2008 Farrukh Shakil CS Dept., CalStateLA Advisor: Dr. Russ Abbott.
A Framework for Distributed Preservation Workflows Rainer Schmidt AIT Austrian Institute of Technology iPres 2009, Oct. 5, San.
MIDESS Dr Stephen Charles MIDESS Project Manager /Repository Manager, University of Leeds MIDESS Management of Images in a Distributed Environment using.
Fundamentals of Digital Asset Management (DAM) John Horodyski, MLIS, MAS Partner, Information Management Optimity Advisors Special Libraries Association.
January 19, 2011 IU Communications & Marketing Conference New Tools 1: Digital Asset Management System Greg Polit IU Public Affairs & Government Relations.
Collection vs Media, Digital vs Analogue Adrian Kingston, Digital Asset Manager Museum of New Zealand Te Papa Tongarewa.
XenData Digital Archives Simplify your video archive workflow XenData LTO Video Archive Solutions Overview © Copyright 2013 XenData Limited.
Digital Object: A Virtual Online Storage Solution 598C Course Project Huajing Li.
Digital Library Architecture and Technology
Yours, Mine, Ours Leadership Through Collaboration OCLC Forum Meg Bellinger September
SobekCM’s Community Ecosystems & Socio-Technical Practices Presented by Mark V. Sullivan June 10 th, 2014 Sobek image created by Jeff Dahl and is shared.
Adventures in Digital Asset Management: Fedora at the National Library of Wales Glen Robson National Library of Wales
Integrating museum systems: Accessing collections information at the Victoria and Albert Museum Christopher Marsden Sarah Winmill, Frances Lloyd-Baynes.
Black Box Larry Gall -- Peabody Museum of Natural History.
1. 2 introductions Nicholas Fischio Development Manager Kelvin Smith Library of Case Western Reserve University Benjamin Bykowski Tech Lead and Senior.
Edward M. Corrado: ELAG | |
Implementing an Integrated Digital Asset Management System: FEDORA and OAIS in Context Paul Bevan DAMS Implementation Manager
ECHO DEPository Project: Highlight on tools & emerging issues The ECHO DEPository Project is a 3-year digital preservation research and development project.
Digital Preservation 101, or, How to Keep Bits for Centuries Julie C. Swierczek Digital Asset Manager and Digital Archivist Harvard Art Museums.
San Diego Supercomputer Center SDSC Storage Resource Broker Data Grid Automation Arun Jagatheesan et al., San Diego Supercomputer Center University of.
Personal Information Management Vitor R. Carvalho : Personalized Information Retrieval Carnegie Mellon University February 8 th 2005.
The Global Video Grid: DigitalWell Update & Plan For SRB Integration Myke Smith, Manager Streaming Media Technologies University of Washington / ResearchChannel.
Joshua Harris, Zachary Boerger, Kyle Rimkus Department of Preservation and Conservation, University Libraries, University of Illinois at Urbana-Champaign.
OAIS Rathachai Chawuthai Information Management CSIM / AIT Issued document 1.0.
EVIA Digital Archive New Tools William G. Cowan Mike Durbin Digital Library Program EVIA Digital Archive DLP Brown Bag 20 September 2006.
Building the Mother of all Collections: the future of the National Library’s discovery services Warwick Cathro Assistant Director-General, Innovation National.
NMNH EMu DAMS Integration Project Rebecca Snyder Smithsonian, NMNH.
OAIS Rathachai Chawuthai Information Management CSIM / AIT Issued document 1.0.
Enterprise Solutions Chapter 10 – Enterprise Content Management.
Collecting History: Profiles in Science Alexa T. McCray National Library of Medicine Bethesda, MD Stanford University August 21, 1999.
Millman—Nov 04—1 An Update on Digital Libraries David Millman Director of Research & Development Academic Information Systems Columbia University
A superior collections management system for the world’s largest: Museums Art Galleries Historical Societies Herbaria Botanic Gardens KE EMu.
DSpace - Digital Library Software
Softwaretechnologie für Fortgeschrittene Teil Eide Stunde III: Introducing the media server (with contributions from Christian-Emil Ore, Jon Holmen, and.
ARCH-IT Symposium, EVA London, 23 rd July 2003 Outline of Overview  ARCO Project goals  Prototype systems and components  Digitisation of artefacts.
Digital Asset Management Systems and Digital Preservation EUAN COCHRANE – DIGITAL PRESERVATION MANAGER YALE UNIVERSITY LIBRARY.
CollectionSpace: Collaborations in support of UC museum collections Chris Hoffman Patrick Schmitz Research Information Technologies UC Berkeley.
Data Stewardship Lifecycle A framework for data service professionals Protectors of data.
The world’s libraries. Connected. CONTENTdm ® Digital Collection Management Solutions Learn what to consider when outsourcing your library’s digitization.
CMU Libraries’ Digital Assets Preservation Strategy Presenter Gabrielle V. Michalek Principal Archivist and Head, Archives/Digital Library Initiatives.
A Semi-Automated Digital Preservation System based on Semantic Web Services Jane Hunter Sharmin Choudhury DSTC PTY LTD, Brisbane, Australia Slides by Ananta.
An Overview of Data-PASS Shared Catalog
UNC Digital Library Project
Flexible Extensible Digital Object Repository Architecture
Flexible Extensible Digital Object Repository Architecture
Data catalogues and the data repository ADMIRe JISC MRD
Ahmet Fatih Mustacoglu
Multimedia Training Kit
DAMmed if you Do or Don’t
Introduction to Data Warehousing
Presentation transcript:

Dam It ! Larry Gall Peabody Museum of Natural History Yale University

Dam It !

You crashed my EMu client again, you %}&$ ! It wasn’t me, you loser !

Dam It ! You crashed my EMu client again, you %}&$ ! It wasn’t me, you loser !

Dam It !

noun

Dam It ! noun

Dam It ! noun am AM

Dam It ! noun am AM

Dam It ! noun am AM S ^

About DAM Peabody

About DAM Peabody DAM Brief DAM Review

About DAM Peabody DAM Brief DAM Review DAM Yale & DAM EMu

Peabody Collections Counts & Functional Cataloguing Unit Anthropology 325,000Lot Botany 350,000Individual Entomology 950,000Lot / Individual Invertebrate Paleontology 325,000Lot Invertebrate Zoology 325,000Lot Mineralogy 35,000Individual Paleobotany 150,000Individual Scientific Instruments 4,000Individual Vertebrate Paleontology 125,000Individual Vertebrate Zoology 185,000Lot / Individual 2.7 million database-able units => ~12 million items

Peabody Collections Functional Units Databased Anthropology 325, % Botany 350, % Entomology 950, % Invertebrate Paleontology 325, % Invertebrate Zoology 325, % Mineralogy 35, % Paleobotany 150, % Scientific Instruments 4, % Vertebrate Paleontology 125, % Vertebrate Zoology 185, % 1,331,000 of 2.7 million => 49 % overall

About DAM Peabody

About DAM Peabody DAM Brief DAM Review

DAM: management tasks and decisions surrounding the ingestion, annotation, cataloguing, storage, retrieval and distribution of digital assets. MAM: sub-category of DAM, mainly for audio, video and other media content. ECM: enterprise content management describes solutions which address similar features but in a wider range of industries or applications.

DAM: management tasks and decisions surrounding the ingestion, annotation, cataloguing, storage, retrieval and distribution of digital assets.

MAM: sub-category of DAM, mainly for digital photographs, audio, video and other media content.

DAM: management tasks and decisions surrounding the ingestion, annotation, cataloguing, storage, retrieval and distribution of digital assets. MAM: sub-category of DAM, mainly for digital photographs, audio, video and other media content.

DAM: management tasks and decisions surrounding the ingestion, annotation, cataloguing, storage, retrieval and distribution of digital assets. MAM: sub-category of DAM, mainly for digital photographs, audio, video and other media content.

DAM: management tasks and decisions surrounding the ingestion, annotation, cataloguing, storage, retrieval and distribution of digital assets. MAM: sub-category of DAM, mainly for digital photographs, audio, video and other media content. [CIA] assets

DAM: management tasks and decisions surrounding the ingestion, annotation, cataloguing, storage, retrieval and distribution of digital assets. MAM: sub-category of DAM, mainly for digital photographs, audio, video and other media content.

DAM: management tasks and decisions surrounding the ingestion, annotation, cataloguing, storage, retrieval and distribution of digital assets. MAM: sub-category of DAM, mainly for digital photographs, audio, video and other media content. Asset preservation, [CIA] assets

DAM: management tasks and decisions surrounding the ingestion, annotation, cataloguing, storage, retrieval and distribution of digital assets. MAM: sub-category of DAM, mainly for digital photographs, audio, video and other media content. Asset preservation, not deletion [CIA] assets

DAM: management tasks and decisions surrounding the ingestion, annotation, cataloguing, storage, retrieval and distribution of digital assets. MAM: sub-category of DAM, mainly for digital photographs, audio, video and other media content.

DAM: management tasks and decisions surrounding the ingestion, annotation, cataloguing, storage, retrieval and distribution of digital assets. MAM: sub-category of DAM, mainly for digital photographs, audio, video and other media content.

DAM: management tasks and decisions surrounding the ingestion, annotation, cataloguing, storage, retrieval and distribution of digital assets. MAM: sub-category of DAM, mainly for digital photographs, audio, video and other media content. ECM: enterprise content management describes solutions which address similar features but in a wider range of industries or applications.

Large heavyweight DAMs, small lightweight DAMs

DAM architectures complex & variable

DAM architectures complex & variable - DAM vendor/integrator relevant

About DAM Peabody DAM Brief DAM Review

About DAM Peabody DAM Brief DAM Review DAM Yale & DAM EMu

Motivation - why give a DAM ?

Yale actively pursuing a campus-wide strategy for all digital assets whose architecture includes DAM and cross-domain discovery/search mechanisms Get YPM assets into new contexts for scholarly engagement; cost share Place YPM non-biological collections in proximity to their Yale peers Items in e.g., YPM Anthropology and Instruments Departments more closely related to Art Department & Art Gallery than to YPM biological collections Integrate all of YPM’s digital assets into a common environment Digital collections assets managed in EMu, but no such “curatorial system” exists for non-collections assets (e.g., Events, Exhibits, Public Education) as these are scattered widely on CDs, hard drives, shoe boxes, et al.

Motivation - why give a DAM ? Yale actively pursuing a campus-wide strategy for all digital assets whose architecture includes DAM and cross-domain discovery/search mechanisms Get YPM assets into new contexts for scholarly engagement; cost share Place YPM non-biological collections in proximity to their Yale peers Items in e.g., YPM Anthropology and Instruments Departments more closely related to Art Department & Art Gallery than to YPM biological collections Integrate all of YPM’s digital assets into a common environment Digital collections assets managed in EMu, but no such “curatorial system” exists for non-collections assets (e.g., Events, Exhibits, Public Education) as these are scattered widely on CDs, hard drives, shoe boxes, et al.

Motivation - why give a DAM ? Yale actively pursuing a campus-wide strategy for all digital assets whose architecture includes DAM and cross-domain discovery/search mechanisms Get YPM assets into new contexts for scholarly engagement; cost share Place YPM non-biological collections in proximity to their Yale peers Items in e.g., YPM Anthropology and Instruments Departments more closely related to Art Department & Art Gallery than to YPM biological collections Integrate all of YPM’s digital assets into a common environment Digital collections assets managed in EMu, but no such “curatorial system” exists for non-collections assets (e.g., Events, Exhibits, Public Education) as these are scattered widely on CDs, hard drives, shoe boxes, et al.

Motivation - why give a DAM ? Yale actively pursuing a campus-wide strategy for all digital assets whose architecture includes DAM and cross-domain discovery/search mechanisms Get YPM assets into new contexts for scholarly engagement; cost share Place YPM non-biological collections in proximity to their Yale peers Items in e.g., YPM Anthropology and Instruments Departments more closely related to Art Department & Art Gallery than to YPM biological collections Integrate all of YPM’s digital assets into a common environment Digital collections assets managed in EMu, but no such “curatorial system” exists for non-collections assets (e.g., Events, Exhibits, Public Education) as these are scattered widely on CDs, hard drives, shoe boxes, et al.

Motivation - why give a DAM ? Yale actively pursuing a campus-wide strategy for all digital assets whose architecture includes DAM and cross-domain discovery/search mechanisms Get YPM assets into new contexts for scholarly engagement; cost share Place YPM non-biological collections in proximity to their Yale peers Items in e.g., YPM Anthropology and Instruments Departments more closely related to Art Department & Art Gallery than to YPM biological collections Integrate all of YPM’s digital assets into a common environment Digital collections assets managed in EMu, but no such “curatorial system” exists for non-collections assets (e.g., Events, Exhibits, Public Education) as these are scattered widely on CDs, hard drives, shoe boxes, et al.

Motivation - why give a DAM ? Yale actively pursuing a campus-wide strategy for all digital assets whose architecture includes DAM and cross-domain discovery/search mechanisms Get YPM assets into new contexts for scholarly engagement; cost share Place YPM non-biological collections in proximity to their Yale peers Items in e.g., YPM Anthropology and Instruments Departments more closely related to Art Department & Art Gallery than to YPM biological collections Integrate all of YPM’s digital assets into a common environment Digital collections assets managed in EMu, but no such “curatorial system” exists for non-collections assets (e.g., Events, Exhibits, Public Education) as these are scattered widely on CDs, hard drives, shoe boxes, et al.

So, which DAM did Yale select ?

YUAG YCBA

YUAG YCBA

xxxxxxxxxxxxxx YUAG YCBA Artesia application programming interface (API) was well exposed

xxxxxxxxxxxxxx YUAG YCBA Artesia application programming interface (API) was well exposed

About DAM Peabody DAM Brief DAM Review DAM Yale & DAM EMu

Synopsis of the path to YPM

Synopsis of the path to YPM DAM Politics ^

Only a small percentage of digital projects are using any recognized metadata standards Long-term maintenance and support is a critical but largely unrecognized need No current mechanism exists for disseminating information on existing digital projects

Only a small percentage of digital projects are using any recognized metadata standards Long-term maintenance and support is a critical but largely unrecognized need No current mechanism exists for disseminating information on existing digital projects

Only a small percentage of digital projects are using any recognized metadata standards Long-term maintenance and support is a critical but largely unrecognized need No current mechanism exists for disseminating information on existing digital projects

Only a small percentage of digital projects are using any recognized metadata standards Long-term maintenance and support is a critical but largely unrecognized need No current mechanism exists for disseminating information on existing digital projects

Only a small percentage of digital projects are using any recognized metadata standards Long-term maintenance and support is a critical but largely unrecognized need No current mechanism exists for disseminating information on existing digital projects

Only a small percentage of digital projects are using any recognized metadata standards Long-term maintenance and support is a critical but largely unrecognized need No current mechanism exists for disseminating information on existing digital projects

Only a small percentage of digital projects are using any recognized metadata standards Long-term maintenance and support is a critical but largely unrecognized need No current mechanism exists for disseminating information on existing digital projects

Yale Digital Commons (YDC)

Yale-wide partnership led by ODAI between Museums, Libraries …

YUAG YCBA YPMYUL

YUAG YCBA YPMYUL All partners looking for lots of asset storage and cross-domain asset discovery

YUAG YCBA YPMYUL All partners looking for lots of asset storage and cross-domain asset discovery EssentialBeyond Critical Important

YUAG YCBA YPM Phase I partners

Cross Collections Discovery (CCD)

OAI-PMH

Cross Collections Discovery (CCD) Harvest /store XML from native schemas (e.g., DwC, CDWA) Crosswalk all schemas to a “Yale CCD Common Discovery Model” Deliver Yale collections items in one-stop-shopping environment OAI-PMH

Cross Collections Discovery (CCD) OAI-PMH Q BETA Harvest /store XML from native schemas (e.g., DwC, CDWA) Crosswalk all schemas to a “Yale CCD Common Discovery Model” Deliver Yale collections items in one-stop-shopping environment

Artesia DAM

Harvest /store XML into a common Artesia-specific model That model mirrors “Yale CCD Common Discovery Model” Use Library of Congress BagIT to deliver assets to DAM

Artesia DAM Harvest /store XML into a common Artesia-specific model That model mirrors “Yale CCD Common Discovery Model” Use Library of Congress BagIT to deliver assets to DAM Q2 2010

Artesia DAM Harvest /store XML into a common Artesia-specific model That model mirrors “Yale CCD Common Discovery Model” Use Library of Congress BagIT to deliver assets to DAM Q2 2010

Artesia DAM Harvest /store XML into a common Artesia-specific model That model mirrors “Yale CCD Common Discovery Model” Use Library of Congress BagIT to deliver assets to DAM Q2 2010

ODAI adopted BagIt to move stuff around the entire YDC

XML

OAI-PMH

MD5

Tag

“hot folder” in the DAM where an ingest monitor grabs it

“Holey” bag

^&*($

Select a multimedia IRN Select operation (e.g., new, update) Decide contents of bag based on operation Build the bag using BagIt Drop bag into DAM hot folder DAM monitor ingests the bag/asset DAM monitor provides logging/messages Retrieve and parse the messages for the bag Round-trip DAM info into multimedia IRN ^&*($

Select a multimedia IRN Select operation (e.g., new, update) Decide contents of bag based on operation Build the bag using BagIt Drop bag into DAM hot folder DAM monitor ingests the bag/asset DAM monitor provides logging/messages Retrieve and parse the messages for the bag Round-trip DAM info into multimedia IRN ^&*($

Select a multimedia IRN Select operation (e.g., new, update) Decide contents of bag based on operation Build the bag using BagIt Drop bag into DAM hot folder DAM monitor ingests the bag/asset DAM monitor provides logging/messages Retrieve and parse the messages for the bag Round-trip DAM info into multimedia IRN ^&*($

Select a multimedia IRN Select operation (e.g., new, update) Decide contents of bag based on operation Build the bag using BagIt Drop bag into DAM hot folder DAM monitor ingests the bag/asset DAM monitor provides logging/messages Retrieve and parse the messages for the bag Round-trip DAM info into multimedia IRN ^&*($

Select a multimedia IRN Select operation (e.g., new, update) Decide contents of bag based on operation Build the bag using BagIt Drop bag into DAM hot folder DAM monitor ingests the bag/asset DAM monitor provides logging/messages Retrieve and parse the messages for the bag Round-trip DAM info into multimedia IRN ^&*($

Select a multimedia IRN Select operation (e.g., new, update) Decide contents of bag based on operation Build the bag using BagIt Drop bag into DAM hot folder DAM monitor ingests the bag/asset DAM monitor provides logging/messages Retrieve and parse the messages for the bag Round-trip DAM info into multimedia IRN ^&*($

Select a multimedia IRN Select operation (e.g., new, update) Decide contents of bag based on operation Build the bag using BagIt Drop bag into DAM hot folder DAM monitor ingests the bag/asset DAM monitor provides logging/messages Retrieve and parse the messages for the bag Round-trip DAM info into multimedia IRN ^&*($

Select a multimedia IRN Select operation (e.g., new, update) Decide contents of bag based on operation Build the bag using BagIt Drop bag into DAM hot folder DAM monitor ingests the bag/asset DAM monitor provides logging/messages Retrieve and parse the messages for the bag Round-trip DAM info into multimedia IRN ^&*($

Select a multimedia IRN Select operation (e.g., new, update) Decide contents of bag based on operation Build the bag using BagIt Drop bag into DAM hot folder DAM monitor ingests the bag/asset DAM monitor provides logging/messages Retrieve and parse the messages for the bag Round-trip DAM info into multimedia IRN ^&*($

Select a multimedia IRN Select operation (e.g., new, update) Decide contents of bag based on operation Build the bag using BagIt Drop bag into DAM hot folder DAM monitor ingests the bag/asset DAM monitor provides logging/messages Retrieve and parse the messages for the bag Round-trip DAM info into multimedia IRN ^&*($

Select a multimedia IRN Select operation (e.g., new, update) Decide contents of bag based on operation Build the bag using BagIt Drop bag into DAM hot folder DAM monitor ingests the bag/asset DAM monitor provides logging/messages Retrieve and parse the messages for the bag Round-trip DAM info into multimedia IRN ^&*($ Resize the EMu copy of asset to small derivative

YUAG YCBA YPM

YUAG YCBA YPM Since early mid summer, >250,000 assets ingested, many exceeding 100 mB

YUAG YCBA YPM DAM timeframe was not without anxiety…

YUAG YCBA YPM

YUAG YCBA YPM

YUAG YCBA YPM

YUAG YCBA YPM

YUAG YCBA YPM

YUAG YCBA YPM

YUAG YCBA YPM Hey, I’ve seen her before …

YUAG YCBA YPM

YUAG YCBA YPM

Yale Digital Silos

Yale Digital Silos X

Dam It !

^&*($

Dam It ! ^&*($

Dam It !