1. Paper Reading part 2
Seo Seok Jun

2. 1.6 Streaming Synchronized Views
Issue : multiple views of the same video
switch between views without lossing context
context?
current position in the current view
keep the context?
new view takes from the point left by previous view

3. 1.6 Streaming Synchronized Views
Problem : views have different duration and playback rate!
but user should view as synchronized
This paper looks into three methods
same approach as common video player
real-time stream manipulation on the server
keep individual views as a sperate stream and switch between streams at a playback time

4. 1.6 Streaming Synchronized Views
First approach
common video player
provide fast forward and backward
skip next shot and scene
BUT require to be local file
rapidly accessed at any arbitrary frame numbers
manipulated in real time during playback time
cannot be applied to remote video!!
apply to real-time manipulation to streaming media
rather complicated
frames -> consecutive order
how to fast playback?

5. 1.6 Streaming Synchronized Views
Second approach
not easy either
videos are usually compressed
then how to access to arbitrary frame?
server cannot compute complicate computation
if do so, catastrophe...

6. 1.6 Streaming Synchronized Views
Third approach
different versions are stored on the server
requires only standard bandwith
load on the server?
but more storage
limitation of chossing the speed
this paper user this!

7. 1.6 Streaming Synchronized Views
how to keep the context when switching between views
Pause the current view
Get the current position
Close the current stream
Compute corresponding position in the selected view
Opne the selected view
Seek to the corresponding position
Play the selected view

8. 1.6 Streaming Synchronized Views

9. 1.6 Streaming Synchronized Views
Step 4
web page with embedded player
streaming server cannot compute
computation -> application server
then how to compute?
solution
perform entire computation on client
using Javascript code

10. 1.6 Streaming Synchronized Views

11. 1.6 Streaming Synchronized Views
step 6
actual seek process
Real Media player
play request delay
can be ignored!
solution

12. 1.6 Streaming Synchronized Views
Others
the storyboard
select one of the keyframe -> take him to that shot
Mail Current
send a capture as URL via

13. 1.7 Browsing Multiple Videos (MovieDNA)
Issue : navigating large collection of linear data
directly apprehend at on glance?
single document
storyboard is efficient
multiple videos
is storyboard efficient?
able to navigate between videos quickly
movieDNA

14. 1.7 Browsing Multiple Videos (MovieDNA)
visualization and navigation tool
etymology(origin of the term)
provide an overview
general approach
user brush
by moving the cursur over the movieDNA
fold-out window trigger

15. 1.7 Browsing Multiple Videos (MovieDNA)

16. 1.7 Browsing Multiple Videos (MovieDNA)
first level
video is single selected unit
next level
selected video expands into a loger DNA
providing finer details
last level
keyframe is shown

17. 1.7 Browsing Multiple Videos (MovieDNA)
aggregated DNAs
aim to convey as much information about second level as possible
aggregation function is relatively straightforward
movieDNA
display an arbitrary number of features as the second level
not an iron cast rule
make it compact
design has to ascertain that first level contains enough info to allow users to navigate

18. 1.8 Usability Study
Topic : How audio TSM affects peech comprehension in several aspects
how deos speedup affect speech comprehension
is video is better understood than speech along?
then, how is the MSB doing relative to these two extreme cases

19. 1.8 Usability Study three different videos
broadcast news
technical talk
company technical training videos
Eight short, Eight long clips
48 segments
mostly speech(in Enlish)
complete sentese
four different speeds
[0.6944, , , ]
[0.8333, , , ]

20. 1.8 Usability Study each speed clip was genereated in three view
full video
MSB
audio-only
24 human subjects
17 men
7 women
20-50
native English speaker : 10
English as second language : 14

21. 1.8 Usability Study listen one variation of each clips
order, speed, media are mixed and reordered
no training before
three questions
how comfortable he/she feels with the clip speed
comprehension fo speech(objective)
summarize the main points in the clip(subjective)
with GUI program
subject cannot select speedup, nor media type

22. 1.8 Usability Study

23. 1.8 Usability Study User's speed assessment
speedup ratio is plotted against the actual ratio
both analyze show linear model
result in
a : constant
S : actual speedup ratio
S0 : natural speed speedup ratio at which linear model cross 0

24. 1.8 Usability Study natural speeds are different from domain
no single "average" speedup factor which will be optimal for all types of videos
but if normalized
normalize
there is a fixed natural speed that can be used to normalize the video

25. 1.8 Usability Study no measurable difference between media
but indivisual difference
design point of veiw
provide a flexibility

26. 1.8 Usability Study

27. 1.8 Usability Study

28. 1.8 Usability Study 2. User speech comprehension
technical talk -> hardest to understand
other two remain high level even in fast speed
while subjects feel uncomfortable they still do not loose the content until about 1.7x (subjective -> about 1.5x)

29. Summary
some of the techinques for supporting fast and efficient browsing
streaming with allowing user to switch
challenge!
there are many techinques
but untill huge challenge of visual indexing is resolved, browsing will continue to play major role.