Ingest Processing Explained
General Overview Ingest Processor ImageProc Toolset Fedora The preprocessor calls the actual ingest after sorting files into individual items Signals readiness by placing a flag file in the dropbox Collection Dropbox Master files Derivatives Metadata files TEI … Ingest Processor ImageProc Toolset Fedora Item Dropbox Master files Derivatives Metadata TEI … Ingest Preprocessor Started either manually or a by a cron job
Ingest Pre-processor Ingest Preprocessor Item Dropbox for VAA1234 VAA1234-001 VAA1234-001.tif VAA1234-001-thumb.jpg VAA1234-001-screen.jpg VAA1234-001-mods.xml VAA1234-002 VAA1234-002.tif VAA1234-002-thumb.jpg VAA1234-002-screen.jpg VAA1234-002-mods.xml Imageproc Dropbox Masters VAA1234-001.tif VAA1234-002.tif … VAA1234-finished Derivatives VAA1234-001-thumb.jpg VAA1234-001-full.jpg VAA1234-001-screen.jpg TEI files VAA1234.xml Ingest Preprocessor Takes source files which is laid out in a flat file structure (depending on the type of the content source files include master files, derivatives, TEI, XML metadata, etc.) and sorts the files into a directory hierarchy expected by the Ingest Processor So, it turns a flat directory into many item-level directories. Calls the ingest process which handles the actual creation and modification of the Fedora objects in the repository
Ingest Processor Ingest Processor Collection VAA1234 VAA1234-001 METS Thumb Screen Full VAA1234-002 … Item Dropbox for VAA1234 VAA1234-001 VAA1234-001.tif VAA1234-001-thumb.jpg VAA1234-001-screen.jpg VAA1234-001-mods.xml VAA1234-002 VAA1234-002.tif VAA1234-002-thumb.jpg VAA1234-002-screen.jpg VAA1234-002-mods.xml Ingest Processor Each item dropbox corresponds to a conceptual item. For example, for the “Paged Content Model”, an item is a book, for the “Journal Content Model”, it is a journal volume and so on. The Ingest Processor takes this directory structure and creates the corresponding object hierarchy in the repository It also creates a METS document that includes similar structural description of the item