1. Físchlár Digital Video Library
Hyowon Lee
26 October 2002
Centre for Digital Video Processing
Dublin City University

2. In short... Físchlár : digital video library
plug in the technical development
monitor the usage
in a real, long-term, user environment
“online VCR” (TV recording/playback facility)
Campus-wide user base (via LAN)
operational for 3 years now
more than 1,600 registered users (around active users at one point in time): user study

3. What is the system like?

20. The System Capacity
300 hours of video at any given time (queue storage - content changes)
Average 22 hours of video per day recorded & analysed
200+ simultaneous video streams

21. Digital Video Technology
Video Content Analysis
Shot Boundary Detection
: the very core of video indexing
Keyframe Extraction
: for the browser interfaces

22. Shot Boundary Detection
Original video
shot boundary detection
Camera shot
Keyframe extraction
Keyframe-based video browsers

23. Digital Video Technology
Video Content Analysis
Shot Boundary Detection
: the very core of video indexing
Keyframe Extraction
: for the browser interfaces
Heavy computation
For providing Video Browsers to users
Overview of a video content
Searching for a particular segment

24. XML Architecture
On web request, an XML information is generated internally, dynamically
Pre-defined XSLT then uses the XML to render appropriate HTML on the web browser
The XML information contains:
User information (id, , access history)
MPEG-7 description for the video content
Allows us to develop a system for different platforms (desktop PC, PDA)
Now the diagram

25. Web Server / Video Server
User’s web browser
recording request
browsing keyframes / searching teletext
Web interface generator
Web Server / Video Server
XSLT definitions
XML generator
recording
request
XML description, containing:
- User information
- MPEG-7 description of a video content
Shot Boundary Detection, keyframe info, teletext info
TV Tuner
MPEG-1 Encoder
Video Storage
Video anaysis
Video encoding /
Storage /
Analysis
Broadcaster
broadcast
video + teletext
signal
encoded
MPEG file

26. Web Server / Video Server
User’s web browser
PDA access
recording request
browsing keyframes / searching teletext
Web interface generator
Web Server / Video Server
XSLT definitions
XML description, containing:
- User information
- MPEG-7 description of a video content
XML generator
recording
request
Shot Boundary Detection, keyframe info, teletext info
TV Tuner
MPEG-1 Encoder
Video Storage
Video anaysis
Video encoding /
Storage /
Analysis
Broadcaster
broadcast
video + teletext
signal
encoded
MPEG file

27. Físchlár Family
Variations catered for different usage - architecturally easy to implement & maintain variations
Sharing the same underlying architecture
Físchlár-TV (the one we saw)
Físchlár-News archive (for media/journalism students)
Físchlár-Nursing (for nursing study in the university)
Físchlár-TREC
Developed for TREC Video Track 2002
Closed set of 40 hours of video collection
11 automatically-derived features
Extensive use of XSLT and SVG (Scalable Vector Graphics)

36. Conclusion: Físchlár approach
Fully automatic - no human intervention for 24/7
Keeps used by large number of users: “living lab” environment
New technical ideas/development plugged in
face/music/speech detection in video
architecture for video asset (XML + MPEG-7 compliant)
automatic video summarisation (esp. Football highlight generation)
scene segmentation (grouping of shots)
object-based linking…
Monitor how users react to them
More information:

40. 1/30

41. 1/30

42. During 28 days (1-28 November 2001) in RTE1 Nine O’Clock News
231 stories (8.25 / day)
115 unique stories
Average 3.89 newly appeared stories
Average 2.89 stories / day are updates from previous day
Average 1.46 stories / day re-appeared from past

43. Today (16 November): a user accesses mFíschlár-NEWS
12 November: Last time this user accessed the archive (either desktop or mobile)
Today (16 November): a user accesses mFíschlár-NEWS
These stories are presented to the user

44. The Approach
Pre-processing & pro-active searching at the back-end by the system for the right piece of information to a user in concern
As a result, simple user interaction:
no awkward text query input
no elaborate navigation
no sophisticated options or different ways of accessing
Most suitable for mobile environment
CENTRE FOR DIGITAL VIDEO PROCESSING, DUBLIN CITY UNIVERSITY

46. Usage study Active system advertisement within campus
Pamphlets in the foyer
including 25 free PCs for residence students
reached 1,500 users (September 2001)
Automatic logging of all individual interaction
Statistic generation
Selective user interview
Opinions, complaints, new ideas
Voluntary feedback

47. Monitoring the Usage By automatic logging and user feedback
e.g. Users’ channel access for...
...Recording
* Statistic: Dec ‘01 - Feb ‘01
...Watching
- Only minority requests recording, the rest only watch
- Users want to watch NOW

48. Monitoring the Usage By automatic logging and user feedback
e.g. Use of Video browsers:
* Statistic: Dec ‘01 - Feb ‘01
- Dedicated users have a favourite browser and use them
- Awkward to jump between Browse and Playback, so end up playback only, even in ad break

49. Monitoring the Usage By automatic logging and user feedback
Recording screen
Frequency of access :
Watching screen
* Statistic: Dec ‘01 - Feb ‘01
2/3 of all ratings is explicit thumbs indication
Users do not know what the thumbs are for
=> need for better visibility to promote the use

50. 1,462 users in total since deployment (11 months, until 31 Oct ‘01)
Monitoring the Usage
By automatic logging and user feedback
1,462 users in total since deployment (11 months, until 31 Oct ‘01)
In the beginning one month of this semester (24 Sep - 31 Oct ‘01):
251 new registered users
792 programs recorded & analysed
431 users accessed
41 users accessed in one day (1 Nov ‘01)

51. TECHNICAL DEVELOPMENT
PROJECT START
TECHNICAL DEVELOPMENT
Físchlár v1
Físchlár v2
Físchlár v3
Físchlár v4
SYSTEM DEPLOYMENT
User-Interface concern
STUDY OF USAGE

52. Different details (granularity) of content
1. Layeredness
Different details (granularity) of content
Layer 1
Layer 2
Layer 3

53. Different details (granularity) of content
1. Layeredness
Different details (granularity) of content
Single
Layer
Multiple Layer
with
Navigational Link
Multiple Layer
without
Navigational Link

54. How time information is to be presented?
2. Temporal Orientation
How time information is to be presented?
Relative
Time
Absolute
Time
No Time provided

55. 3. Spatial vs. Temporal presentation
How is a set of temporally ordered pictures
to be presented?
Spatial
Presentation
Temporal
Presentation

56. 3-D Representation 3 dimensions at a glance - in “design space”
Browser with :
Multiple Layer with Link
Absolute Time
Spatial presentation
Layeredness
Multi Layer with Link
Multiple Layer without Link
Spatial
Single Layer
Temporal
Spatial vs. Temporal
Presentation
Relative Time
Absolute Time
No Time
Temporal Orientation

57. Físchlár browser example 1
Single layer
Relative time
Temporal
Layeredness
“Slide Show Browser”
Multi Layer with Link
Multiple Layer without Link
Single Layer
Temporal
Spatial
Spatial vs. Temporal
Presentation
Relative Time
Absolute Time
No Time
Temporal Orientation

58. Físchlár browser example 2
Multiple layer with Link
No Time
Spatial
Layeredness
“Hierarchical Browser”
Multi Layer with Link
Multiple Layer without Link
Spatial
Single Layer
Temporal
Spatial vs. Temporal
Presentation
Spatial vs. Temporal
Presentation
Relative Time
Absolute Time
No Time
Temporal Orientation

59. Físchlár browser example 3
Multiple layer with Link
Relative time
Spatial & Temporal
Layeredness
“Dynamic Overview Browser”
Multi Layer with Link
Multiple Layer without Link
Spatial
Single Layer
Temporal
Spatial vs. Temporal
Presentation
Relative Time
Absolute Time
No Time
Temporal Orientation

60. Current Físchlár browsers
Designing
Implementing
Refining
by usability testing (interview, think-aloud...)
Layeredness
Multi Layer with Link
Multiple Layer without Link
Spatial
Single Layer
Temporal
Spatial vs. Temporal
Presentation
Relative Time
Absolute Time
No Time
Temporal Orientation