Digital Asset Management Systems & Application Jim DeRoest, Director Streaming Media Technologies
Development Original focus broadcast-streaming integration. –ResearchChannel, UWTV, KEXP –Automation: encode, ingest, metadata, schedule, deliver –Scalable standard def, high def, uncompressed streams –Support commodity bit rates and formats Focus expanded to include institutional collections –High-quality and accessible resources to research information. –Educational outreach –Interoperate with other digital repositories Why quality matters … Original focus broadcast-streaming integration. –ResearchChannel, UWTV, KEXP –Automation: encode, ingest, metadata, schedule, deliver –Scalable standard def, high def, uncompressed streams –Support commodity bit rates and formats Focus expanded to include institutional collections –High-quality and accessible resources to research information. –Educational outreach –Interoperate with other digital repositories Why quality matters …
Hours Viewed Increases 200% since Jan 2002 Breakout by Bandwidth Hours Viewed Increases 200% since Jan 2002 Breakout by Bandwidth Webcast and Video OnDemand
Average Viewing Time Duration longer for VOD, higher bandwidths
DigitalWell Project Digital Asset Management System –Hierarchical, clustered infrastructure - Scaling –Pluggable components – Tech Evolution –Interoperation – Auth, Metadata, API –Preservation –Rights – Higher Education Digital Asset Management System –Hierarchical, clustered infrastructure - Scaling –Pluggable components – Tech Evolution –Interoperation – Auth, Metadata, API –Preservation –Rights – Higher Education
What We Built Hardware –Clustered servers – encode, stream, … –NAS Online Storage 12TB Isilon IQ Multi-node, load balancing, single mount point –SAN Nearline Storage STK Silos – 9840 (20GB/cart), 9940 (200GB/cart) –Mirrored architecture Hardware –Clustered servers – encode, stream, … –NAS Online Storage 12TB Isilon IQ Multi-node, load balancing, single mount point –SAN Nearline Storage STK Silos – 9840 (20GB/cart), 9940 (200GB/cart) –Mirrored architecture
What We Built Software –HSM: HPSS, UW Karc (bucket service) –Metadata: MS SQL –Web: IIS –Encoding: Flipfactory, Virage –Streaming: WM, Real, Quicktime, MP3, VideoCharger (MPEG2 5.6mbps,19.2mbps), UW HDCAM/SDTI 270mbps –Multicast: Amnis –DigitalWell State & Redirector Service Software –HSM: HPSS, UW Karc (bucket service) –Metadata: MS SQL –Web: IIS –Encoding: Flipfactory, Virage –Streaming: WM, Real, Quicktime, MP3, VideoCharger (MPEG2 5.6mbps,19.2mbps), UW HDCAM/SDTI 270mbps –Multicast: Amnis –DigitalWell State & Redirector Service
Backend Diagram Insert diagram image - mass store system
Interoperability Metadata –Dublin Core, MPEG7, Custom –OAI, possibly METS –API migration to OKI –LDAP Collection Service – LC/AMIA MIC Access Controls –Pubcookie, Institutional Groups –Shibboleth under development Preservation –OAIS? Metadata –Dublin Core, MPEG7, Custom –OAI, possibly METS –API migration to OKI –LDAP Collection Service – LC/AMIA MIC Access Controls –Pubcookie, Institutional Groups –Shibboleth under development Preservation –OAIS?
Application: Broadcast ResearchChannel, UWTV –Automated Encoding Dub time Mav70 capture 50mbps i-frame MPEG2 Transcode farm – Flipfactory, Virage hrs of standard def 5.6mbps MPEG2 –Broadcast Scheduling Integration Protrack, DW metadata -> Dynamic web schedule Integrated with DW On-Demand library –Standard def MPEG2 multicast International rebroadcast support – ResearchChannel, UWTV –Automated Encoding Dub time Mav70 capture 50mbps i-frame MPEG2 Transcode farm – Flipfactory, Virage hrs of standard def 5.6mbps MPEG2 –Broadcast Scheduling Integration Protrack, DW metadata -> Dynamic web schedule Integrated with DW On-Demand library –Standard def MPEG2 multicast International rebroadcast support –
Application: KEXP Digital Audio Infrastructure Live Broadcast Stream –Uncompressed 1.4mbps –Commodity bit rates Archived Live Broadcast –2 weeks, all formats Realtime Broadcast Playlist –Dynamic web update integrated with DJ console –Archived with live broadcast Digital Audio Infrastructure Live Broadcast Stream –Uncompressed 1.4mbps –Commodity bit rates Archived Live Broadcast –2 weeks, all formats Realtime Broadcast Playlist –Dynamic web update integrated with DJ console –Archived with live broadcast
Institutional Collections Agnostic to data type –Text, docs, photos, video, audio, dataset, … Collection Admin Tool –Metadata profile support –Custom metadata Interoperation: D-Space, ContentDM, … Integration with Catalyst teaching tools Available to UW campus summer qtr 2003 Agnostic to data type –Text, docs, photos, video, audio, dataset, … Collection Admin Tool –Metadata profile support –Custom metadata Interoperation: D-Space, ContentDM, … Integration with Catalyst teaching tools Available to UW campus summer qtr 2003
Outreach & Collaborations Pacific Lighthouse –CENIC, UW, I2 K20 –High quality audio/video to K20 –Content Partners: Densho, Conversations with History, Jason Project, Exploratorium, Cell Systems Initiative, ResearchChannel, KEXP Pacific Lighthouse –CENIC, UW, I2 K20 –High quality audio/video to K20 –Content Partners: Densho, Conversations with History, Jason Project, Exploratorium, Cell Systems Initiative, ResearchChannel, KEXP
Collaboration Moving Image Collections –NSDL, Library of Congress, AMIA –Video collection directory and union catalog – Viewing the Future –NSDL MERIT Michigan Teachers Network –Audio Video Metadata for K12 Multi University Research Library –Computer Science Lecture Collection – Convergence Consortium –CPB, PBS, education collaboration –MARS project – Metadata profile for PBS – Moving Image Collections –NSDL, Library of Congress, AMIA –Video collection directory and union catalog – Viewing the Future –NSDL MERIT Michigan Teachers Network –Audio Video Metadata for K12 Multi University Research Library –Computer Science Lecture Collection – Convergence Consortium –CPB, PBS, education collaboration –MARS project – Metadata profile for PBS –
Projects & Experiments 1.5mbps uncompressed HD over IP 270mbps HD/SDTI live, on-demand 270mbps standard def I2 multicast Desktop HD – 19.2mbps ATSC MPEG2 Interested? –I2 ResearchChannel working group 1.5mbps uncompressed HD over IP 270mbps HD/SDTI live, on-demand 270mbps standard def I2 multicast Desktop HD – 19.2mbps ATSC MPEG2 Interested? –I2 ResearchChannel working group
iGrid Video Across the Atlantic International Partnerships
iGrid Demo