1. Storied Navigation Edward Shen Hector Beltran Donyun Kim 12/15/06

2. Story Analogy character Acharacter B character type studentteacher situation not knowing where to go for the future willing to give guidance to character A emotion / attitude anxious, lost, hoping for help, pessimistic caring, insightful, appreciatory, advisory character Acharacter B character type Studentteacher situation Thought that she was clear where to go for the future willing to give suggestion to character A emotion / attitude Confused, hesitated encouraging, insightful, advisory

3. Idea Build system that allows users to tell different stories from sequences of video clips with meaningful relationships between clips (using analogies to other stories)

4. Original System Design What’s the story about? Presidential election 1.Who were the candidates? 2.When was the election? 3.What was the outcome of the election? 4.What were the issues? Video Corpus 1.How do you feel about him? 2.What has he done in the past?

5. Challenges for Q/A scenario How to derive context-relative questions based on provided information How to derive plausible annotations for a video sequence based on the context of using it How to design representation for video sequence such that the above can be conducted more easily

6. Generating Questions Assume video sequences annotated with Roger Schank’s form of indexing stories (theme,goal,plan,result,lesson) Questions come from:  Generic question templates  Common sense reasoning  Story analogies

7. Curiosity Ask questions people tend to be more curious about Introduce new pieces of information that produce effect of new direction of navigation

8. Curiosity Relationship between people Why do people do what they do?  External forces  Values/Beliefs  Internal desire

9. New System Design Different users  Users that know video corpus very well  Users that are seeing videos for first time Help new users create stories by using information first set of users have already entered (system developers)

10. New system design 1 Q1 Q2 Q3 System Developer End User 2 3 Q4 Q5 Q6 4 4 5 Q7 Q8 Q9 2 Why is Mary sad? Using semantic similarity and common sense 4 4 3 View suggested questions Q7 Q8 Q9 555

11. System Developer 1. System Developer types in story Gustave is one of the dancers. He likes to suggest ideas for the dance. He gets very frustrated that he can only do what he is told. 2. Sentence/Sentences attached to clips 123 3. Question set developed for each sequence 1 2 3 Q1 Q2 Q3 Q1 Q2 Q3 Q1 Q2 Q3 4. Generate Q/A sets between video sequences 1 2 Q1 Q2 Q3Q4 4

12. Steps 1 – Segment Stories Gustave is one of the dancers. He gets very frustrated that he is only allowed to do what he is told. At one point he was crying. This happened during the first week. The second week was different. Dancers were encouraged to design their own dance. Gustave had a wonderful time. He likes to suggest ideas for the dance. 1. Always include topic sentence 2. Try topic sentence with new sentence, if sentence does not return 4/5 same clips as previous sentence/segment, start new segment. Otherwise, add to previous sentence/segment 3/5 4/5 3/5 4/5

13. Step 2 – Assign clips He gets very frustrated that he is only allowed to do what he is told. At one point he was crying. This happened during the first week. The second week was different. Dancers were encouraged to design their own dance. Gustave had a wonderful time. He likes to suggest ideas for the dance. 1 2 3 Gustave is one of the dancers.

14. Step 3 – Question Generation Gustave is one of the dancers. He gets very frustrated that he is only allowed to do what he is told. At one point he was crying. This happened during the first week. The second week was different. Dancers were encouraged to design their own dance. He likes to suggest ideas for the dance. 1 2 3 Gustave is one of the dancers. Gustave had a wonderful time. 1.General templates What,when,how,why How does Gustave dance? What are Gustave’s ideas? Why did Gustave have a wonderful time? 2.Emotions – why…? Ever feel the opposite? Why was Gustave frustrated? Is Gustave ever happy? 3. Conflict – ask for resolution How was the conflict resolved? Common Sense