W. Brent Seales Jim Griffioen Kevin S. Kiernan The Digital Atheneum: New Techniques for Restoring, Searching and Editing Digital Collections W. Brent Seales Jim Griffioen Kevin S. Kiernan Today I am going to present a new algorithm for generating seamless panoramic video imagery for immersive teleconferencing. University of Kentucky

The Digital Atheneum Project Goals Develop new techniques for digital preservation, restoration, and presentation of damaged manuscripts University of Kentucky Principal Investigators: Jim Griffioen and Brent Seales (Computer Science) Kevin Kiernan (English) Partners The British Library IBM

Damaged Manuscripts Problems: Requires extensive editorial involvement Manuscript is fragile Single images mean little without metadata Need new restoration tools and techniques

Research Areas Digitization techniques 3D shape many types of illumination Content-based searching and access Extensible/flexible editorial tools Distributed execution of tools and services Restoration techniques Mosaicing Digital flattening/shape visualization

Illumination Techniques Visible light, Ultraviolet light, Laser scanning, Fiber-optic back-lighting

Three-Dimensional Scanning Digital photography is used to provide patrons electronic facsimiles of library materials 2D images do not provide shape information Insufficient in providing a realistic “look and feel” of non-planar materials We present a technique that augments current digitization setups to acquire 3D information

Digitization of Materials Special Collections: Culturally significant, unique, damaged, restricted materials Patrons are passionate about the look and feel of the original Want more than just “textual content” It is typical to provide the patron images alone (no 3D information)

Digitizing “Manuscripts” We address digitization of manuscripts and similar objects Objects are ill-suited for flat-bed scanners Photographed with digital camera

Typical Digitization Setup High-resolution digital camera Camera positioned above the “artifact” Image is captured fsjerjwee ael Worjt ileke sldkfj Mwiee kerlkerlk <wiel Wmekle wle e Wmeiwlwl wlwle Michae S. Brown is one cool dude and you wilsd asd -00 A

Multiple Lighting Conditions Common to illuminate same object under several lighting conditions Natural fsjerjwee ael Worjt ileke sldkfj Mwiee kerlkerlk <wiel Wmekle wle e Wmeiwlwl wlwle Michae S. Brown is one cool dude and you wilsd asd -00 A

Multiple Lighting Conditions Common to illuminate same object under several lighting conditions White fsjerjwee ael Worjt ileke sldkfj Mwiee kerlkerlk <wiel Wmekle wle e Wmeiwlwl wlwle Michae S. Brown is one cool dude and you wilsd asd -00 fsjerjwee ael Worjt ileke sldkfj Mwiee kerlkerlk <wiel Wmekle wle e Wmeiwlwl wlwle Michae S. Brown is one cool dude and you wilsd asd -00 A A

Multiple Lighting Conditions Common to illuminate same object under several lighting conditions UV fsjerjwee ael Worjt ileke sldkfj Mwiee kerlkerlk <wiel Wmekle wle e Wmeiwlwl wlwle Michae S. Brown is one cool dude and you wilsd asd -00 fsjerjwee ael Worjt ileke sldkfj Mwiee kerlkerlk <wiel Wmekle wle e Wmeiwlwl wlwle Michae S. Brown is one cool dude and you wilsd asd -00 fsjerjwee ael Worjt ileke sldkfj Mwiee kerlkerlk <wiel Wmekle wle e Wmeiwlwl wlwle Michae S. Brown is one cool dude and you wilsd asd -00 A A A

Limitation of 2D imagery When imaging non-flat objects Objects can appear crinkled or warped Difficult to disambiguate if the warping is part of the original or an artifact of the object’s shape 2D imagery is limited in what it can convey to the patron

Beyond 2D images With non-planar materials 2D images can prove insufficient in providing “look and feel” 3D representations provide better electronic facsimiles Goal: provide a textured 3D model to patron

Our Goal Provide a 3D acquisition system that can be integrated into current digitization setup Curator decides when to acquire “3D” Otherwise operates as usual No special-purpose equipment Uses equipment already available Minimum overhead

3D Acquisition setup for library materials Introduce a light projector Projector mathematics behaves same as camera Projector and camera are used to triangulate 3D points on the artifact’s surface A 3D model can be acquired (and 2D image) x y z

Current Implementation Prototype system Uses standard NTSC camera (low-resolution) XGA light projector (1024x768) Mirror is used to direct the light onto the materials Camera and projector are controlled from the same computer (provides synchronization) Produces 3D model with several textures

Results with low-resolution camera Current Implementation Acquisition Timing 5 minutes to calibrate 1-3 minutes per object Can scan several objects after calibration Scan Density typically less than 0.5mm along projector X&Y Accuracy 0.25mm Results with low-resolution camera

Results Materials from U. Kentucky’s Special Collection Non-planar materials 13th century wax seals Washington Coin Book binding (inset)

Editing and Searching Content Data components to manage: Images Text (transcription, edition) Glossaries Metadata Embedded content

Toolkit Objectives Integrated interface visualization editing/creation content-based search Adaptable to new problem domains Extensible Distributed Collaborative (multi-user access)

Distributed Service-base Architecture The set of services can be easily modified and extended Base Services SQL-style DB service, Image and Transcript viewer/editor service, Correspondence service, Display service, Access/Security service Example Extended Services Navigation services, Template-based Image Search services, Model-based Search services, Enhancement and Restoration services, Glossary services, Annotation service, ... Current implementation based on Java/Jini allows services to be run locally or at the server

The Editor’s Tool - Example

The Editor’s Tool (1)

The Editor’s Tool (2)

The Editor’s Tool (3)

The Editor’s Tool (4)

The Editor’s Tool (5)

The Editor’s Tool (6)

The Editor’s Tool (7)

The Editor’s Tool (8)

The Editor’s Tool (9)

The Editor’s Tool (10)

The Editor’s Tool (11)

Enhance content-based search functionality Future Work Digitize British Library Cottonian collection Enhance content-based search functionality Integrate 3D data Develop restoration techniques

University of Kentucky The Digital Atheneum: New Techniques for Restoring, Searching and Editing Digital Collections www.digitalatheneum.org University of Kentucky