DigitalWell Digital Asset Management Systems & Applications Jim DeRoest, Director Streaming Media Technologies
Who We Are – Streaming Media, Video & TV Technologies Campus –Institutional repository/Asset Management – Digitalwell Project –Streaming – Distance education, eLearning Television – UWTV, uw2.tv, ResearchChannel –Cable & Satellite broadcast 17.1million homes –+2500hrs modem to SD to HD on-demand programming –Live multicast internationally to 30mbps DV Radio – KEXP –Analog and Digital broadcast –Streaming audio to 1.4mbps –On demand broadcast & playlist archive Video/Audio Research –iHDTV – desktop to uncompressed HD over the Internet Campus –Institutional repository/Asset Management – Digitalwell Project –Streaming – Distance education, eLearning Television – UWTV, uw2.tv, ResearchChannel –Cable & Satellite broadcast 17.1million homes –+2500hrs modem to SD to HD on-demand programming –Live multicast internationally to 30mbps DV Radio – KEXP –Analog and Digital broadcast –Streaming audio to 1.4mbps –On demand broadcast & playlist archive Video/Audio Research –iHDTV – desktop to uncompressed HD over the Internet
Mission Exploit Next Generation Network Bandwidth High Quality, Low Latency Interactive Systems Deliver Realism - Quality & Latency Matter –Health Sciences, Biology, Performance Arts System Integration & Automation – End to End Television, Radio, Internet Technologies Middleware Standards Intellectual Property, Discovery, Metadata Research & Outreach National/International Consortia, K20 Digital Media Asset Management On Demand Access, DLib Interoperation, Preservation Exploit Next Generation Network Bandwidth High Quality, Low Latency Interactive Systems Deliver Realism - Quality & Latency Matter –Health Sciences, Biology, Performance Arts System Integration & Automation – End to End Television, Radio, Internet Technologies Middleware Standards Intellectual Property, Discovery, Metadata Research & Outreach National/International Consortia, K20 Digital Media Asset Management On Demand Access, DLib Interoperation, Preservation
Broadcast, Streaming, On-Demand
ResearchChannel Nationwide 7x24 Hour Television Channel on Cable and Satellite International Retransmission Research Consortia
ResearchChannel Participants Research Universities: Duke University George Mason University Johns Hopkins University Massachusetts Institute of Technology National University of Singapore Oregon State University Penn State University Rice University Rutgers, The State University of New Jersey Stanford University Tufts University Universidad de Puerto Rico Universitat Politècnica de Catalunya University of Alaska Fairbanks University of Chicago University of Hawaii University of Houston University of Maryland - College Park University of Pennsylvania University of Southern California University of Virginia University of Washington University of Wisconsin-Madison Virginia Tech Yale University Research Universities: Duke University George Mason University Johns Hopkins University Massachusetts Institute of Technology National University of Singapore Oregon State University Penn State University Rice University Rutgers, The State University of New Jersey Stanford University Tufts University Universidad de Puerto Rico Universitat Politècnica de Catalunya University of Alaska Fairbanks University of Chicago University of Hawaii University of Houston University of Maryland - College Park University of Pennsylvania University of Southern California University of Virginia University of Washington University of Wisconsin-Madison Virginia Tech Yale University Research Organizations: Howard Hughes Medical Institute Internet2 National Academies National Academy of Engineering National Academy of Sciences National Institute of Standards and Technology National Institutes of Health National Institute of Nursing Research National Library of Medicine National Science & Technology Medals Foundation National Science Foundation National Sea Grant College Program Pacific Northwest Gigapop Stanford Hospital & Clinics Wisconsin Public Television Corporate Research Centers: Corporation for Education Network Initiatives in California IBM Corporation Johnson & Johnson Microsoft Research Sony Electronics Inc. Vulcan Inc.. RC Global Initiative Australia Brazil Chile China Finland Korea Netherlands Portugal Spain
Broadcast Subscribers 9.0 million - Dish Network 8.1 million - Individual cable systems 9.0 million - Dish Network 8.1 million - Individual cable systems 17.1 million - Total
International On-Demand & Multicast KEXP Listener: “Filipino listeners have a limited music resource. Your online audio streams are able to satisfy hungry listeners such as myself. Thank god for the internet!”
Regional distribution outside U.S. * Webtrends: October U.S. is 75% of Total, this shows remaining 25%
Collaborators Research & Standards Development Educational Outreach Content Sharing Network Test Beds
DigitalWell: Digital Asset Management Project focus –Broadcast-”Intercast” integration. –Automation – End to End capture, describe, deliver –High quality, Realism Commodity, Standard def, High def Next generation networks –Asset agnostic Doc, pic, audio, video, data blobs –Middleware Metadata, DRM/IPMP, API –Scalable/Pluggable Architecture Evolve with Technology –Federated DAMS Interoperation –Storage/Preservation Project focus –Broadcast-”Intercast” integration. –Automation – End to End capture, describe, deliver –High quality, Realism Commodity, Standard def, High def Next generation networks –Asset agnostic Doc, pic, audio, video, data blobs –Middleware Metadata, DRM/IPMP, API –Scalable/Pluggable Architecture Evolve with Technology –Federated DAMS Interoperation –Storage/Preservation
OA I DigitalWell Architecture Access APIs Drivers Storage Pool Abstraction Databases DB2, SQLServer Servers Windows, Unix File systems HSM HPSS, ADSM Data Transport/Streams Federation Broadcast Automation WS API DW Admin API Metadata Abstraction Metadata Services Broadcast, Dlib, eLearning WebISO, Shibboleth, PKI Stream State Manager SRB Authorization-Authentication-Access Control LDAP Request Director OAI
Internet Streaming Service Internet Multicast Service DV, MPEG2, WM Satellite & Cable International Retransmission Web Broadcast Schedule Program Library Video On Demand DigitalWell End to End Automation Environment Broadcast Traffic System Metadata Digital Asset Repository VoD Metadata Synchronization Video Capture Single Pass Tape Dub & Encoding MPEG2 SD HD WM, Real, QT
Instantiation Dub time automation –Single pass ingest Virage/Flipfactory 15mbps MPEG2 master Format transcoding Keyframe, metadata creation Queued for review Archive & publish –Scheduling Protrack/Digitalwell Metadata synchronization Automated monitoring Ingest to delivery Dub time automation –Single pass ingest Virage/Flipfactory 15mbps MPEG2 master Format transcoding Keyframe, metadata creation Queued for review Archive & publish –Scheduling Protrack/Digitalwell Metadata synchronization Automated monitoring Ingest to delivery
Automated Encoding Process
Middleware Metadata –Dublin Core, MPEG7, Custom –OAI, possibly METS –WS API –Collection Directory – LoC/AMIA MIC Access Controls –Web ISO (Pubcookie), –Institutional Groups –Collection and Asset level ACLs –Shibboleth under development Preservation –OAIS? Metadata –Dublin Core, MPEG7, Custom –OAI, possibly METS –WS API –Collection Directory – LoC/AMIA MIC Access Controls –Web ISO (Pubcookie), –Institutional Groups –Collection and Asset level ACLs –Shibboleth under development Preservation –OAIS?
Broadcast Scheduling Integration Broadcast Traffic & Web Integration –Program metadata store (DigitalWell) –Broadcast schedule (ProTrack, Louth) –Daily extract ProTrack list metadata –Synchronize metadata (ProTrack, DigitalWell) Tape number and program name –Dynamic generation of ResearchChannel Web Broadcast schedule VoD library Broadcast Traffic & Web Integration –Program metadata store (DigitalWell) –Broadcast schedule (ProTrack, Louth) –Daily extract ProTrack list metadata –Synchronize metadata (ProTrack, DigitalWell) Tape number and program name –Dynamic generation of ResearchChannel Web Broadcast schedule VoD library
Delivery – Little Video … Big Video Clustered Load Sharing Server Architecture –WM9, Real10, Quicktime, Shoutcast, VideoCharger, VideoLAN Little Video – Smartphones, PDAs, –Path 1, WM, Shoutcast –Audio/Video streaming, VoD Middle Video – Desktop –Modem, DSL, Broadband environments –Audio: 32kbps to 1.4mbps Uncompressed –Video: 56kbps to 5.6mbps SD, 19.2mbps HD –DVTS DV 30mbps –Unicast and Multicast Big Video –Studio Quality SDI delivery 250mbps (SD, HDCAM) –Uncompressed HD 1.5mbps VoD Demo APAN 2004 International VC Demo SC’04 Clustered Load Sharing Server Architecture –WM9, Real10, Quicktime, Shoutcast, VideoCharger, VideoLAN Little Video – Smartphones, PDAs, –Path 1, WM, Shoutcast –Audio/Video streaming, VoD Middle Video – Desktop –Modem, DSL, Broadband environments –Audio: 32kbps to 1.4mbps Uncompressed –Video: 56kbps to 5.6mbps SD, 19.2mbps HD –DVTS DV 30mbps –Unicast and Multicast Big Video –Studio Quality SDI delivery 250mbps (SD, HDCAM) –Uncompressed HD 1.5mbps VoD Demo APAN 2004 International VC Demo SC’04
Interactive High Definition Video SC’04 Network Routes
Internet SDTV to Desktop Servers, Players, Codecs –VidoeLan, IBM Videocharger –ffmpeg, Elecard 5.6mbps Content stored and streamed from UW DigitalWell architecture All UWTV, ResearchChannel programming available – over 2000 hrs. UWTV, ResearchChannel SD multicast at 2mbps
Internet HDTV to Desktop Servers, Players, Codecs –VidoeLan, IBM Videocharger, MS WM9 –ffmpeg, Elecard –1080i 19.2mbps –720p 5mbps Content stored and streamed from UW DigitalWell architecture Developing HDTV card integration for component out display to HD plasmas, projectors, LCDs Servers, Players, Codecs –VidoeLan, IBM Videocharger, MS WM9 –ffmpeg, Elecard –1080i 19.2mbps –720p 5mbps Content stored and streamed from UW DigitalWell architecture Developing HDTV card integration for component out display to HD plasmas, projectors, LCDs
Storage Management Pluggable Hierarchical Infrastructure –Hardware – NAS/SAN/Robotic Tape 30 TB NAS – Isilon IQ 2 TB SAN staging – EMC Symetrix STK robotic tape silos – 9840, 9940 –Software – Mass Store System HPSS, TSM –Disaster recovery - offsite copies Content Sharing –Mirroring/Synchronization –Peer to Peer Federated/Disparate Digital Repositories SRB OAI Pluggable Hierarchical Infrastructure –Hardware – NAS/SAN/Robotic Tape 30 TB NAS – Isilon IQ 2 TB SAN staging – EMC Symetrix STK robotic tape silos – 9840, 9940 –Software – Mass Store System HPSS, TSM –Disaster recovery - offsite copies Content Sharing –Mirroring/Synchronization –Peer to Peer Federated/Disparate Digital Repositories SRB OAI
Open Federated Archives NSDL UW CDL Media Repositories Targeted Media Portals DigitalWellOther DAMS, DLS SRB/OAI
DigitalWell Institutional R1 Institutional Repository Services Broadcast Migration –KEXP, UWTV, ResearchChannel –Two Previous Broadcast DW Implementations Production 1QTR 2005 Institutional Repository Services Broadcast Migration –KEXP, UWTV, ResearchChannel –Two Previous Broadcast DW Implementations Production 1QTR 2005
DigitalWell R1 What’s New … –Enhanced Content Upload Batch Collection Ingest: Assets and XML Metadata –Validation Assets to Metadata –Recoverable Upload –Metadata Profiles DWLite – File System Metadata, Limited Search Extended Dublin Core – Search PBCore – Broadcast Support Advanced Custom Fields What’s New … –Enhanced Content Upload Batch Collection Ingest: Assets and XML Metadata –Validation Assets to Metadata –Recoverable Upload –Metadata Profiles DWLite – File System Metadata, Limited Search Extended Dublin Core – Search PBCore – Broadcast Support Advanced Custom Fields
DigitalWell R1 What’s New … –WS API Interface Development, Teaching Tools –System Admin Tool User Account Management Automated Account Creation/Expiration User Quotas Collection Management –Selectable per Asset Delivery Option Stream only, Download or Both What’s New … –WS API Interface Development, Teaching Tools –System Admin Tool User Account Management Automated Account Creation/Expiration User Quotas Collection Management –Selectable per Asset Delivery Option Stream only, Download or Both
DigitalWell R1 New Non-broadcast Collections –Health Sciences – MRI imaging –School of Music – 15k hrs Ethnomusicology –College of Forestry – Sat images old growth –Experimental Education – SD video to K12 –iEARN – International student video collab –PETTT VideoTraces – Collab video tool New Non-broadcast Collections –Health Sciences – MRI imaging –School of Music – 15k hrs Ethnomusicology –College of Forestry – Sat images old growth –Experimental Education – SD video to K12 –iEARN – International student video collab –PETTT VideoTraces – Collab video tool
Sharing PBS Programming Over the Internet between 8 stations
Microsoft Research MURL Goals: Increase awareness among researchers everywhere about the recent advances in the availability of streaming video technologies Provide access anywhere, at any time, to the rich, distinctive seminars of the partner institutions Investigate the potential of streaming video and collaborative technologies to change, and improve, the delivery of information and education Explore the social and communication issues that may arise from increasing the audience for seminars that are traditionally targeted to smaller, face-to-face groups
DigitalWell - What’s next… Content Sharing/Synchronization –SRB prototype with AARNET Advanced Search –CRIM MADIS MPEG7 Video Object Search Encoding –Closed Caption, Transcripts –User Initiated Batch Transcoding Network and Storage Scaling –Bandwidth > 1.5gbps per stream –Cost 1Hr Broadcast HD ~9GB 1Hr HDCAM/SDI~120GB 1Hr Studio HD ~670GB Video Conferencing –Low Latency HD and Plasma Resolution Tarari HPC hardware SDI Firewire Capture Card –Access Grid and Video Presence integration Content Sharing/Synchronization –SRB prototype with AARNET Advanced Search –CRIM MADIS MPEG7 Video Object Search Encoding –Closed Caption, Transcripts –User Initiated Batch Transcoding Network and Storage Scaling –Bandwidth > 1.5gbps per stream –Cost 1Hr Broadcast HD ~9GB 1Hr HDCAM/SDI~120GB 1Hr Studio HD ~670GB Video Conferencing –Low Latency HD and Plasma Resolution Tarari HPC hardware SDI Firewire Capture Card –Access Grid and Video Presence integration
? Questions ? ? Questions ?