1. Beyond Pencil and Paper Topics for today – Interactive texts – Integrating paper and digital content What, where, and how do you read? Interviews with people indicated they tend to discount reading on the computer. – When asked if they read online they said no but ignored email, web news, etc. – Do you think this has this changed? Why?

2. Interactive Texts Many forms of interactive text – Hypertext – Chatterbots – Computer- generated texts – Social texts (email, etc.) are for next class so let’s ignore them for now How do these forms of text change the connection between the author and reader? What are they good for?

3. Fluid Texts Stretchtext Fine grained hypertext structure – Differs from the web Novel animated text to maintain reader context – Differs from traditional hypertext where the new lexia replaces (or opens in a separate window) from the prior lexia Authoring is still a challenge

4. Fluid Reader

5. Fluid Reader (2)

6. Fluid Reader (3)

7. Fluid Structure

8. Fluid Writer

9. Fluid Writer (2)

10. Character Development in Fluid Texts

11. Beyond Strings

14. Paper-Based Spatial Expression

15. Understanding Spatial Expression

16. Integrating Paper and Digital We see it all the time – Barcodes – QR codes – TAG codes Characteristics – Visible – Takes space from other content – No features of the link are human interpretable – May not fit into the aesthetic of linked content

17. Code-base Invisible Links We don’t see it all the time – RFID – Data glyphs – Anoto Characteristics – Rely on special hardware – Not human interpretable – Does not take space – Does not interfere with aesthetic

18. Paper++

19. Authoring in Paper++

20. Recap of Last Lecture Stretchtext – extensible/collapsible strings Virtual Notebook System – integrated reading/writing interface Hyper-Object Substrate – object-oriented authoring with proactive support for incremental formalization VIKI/VKB – expression via spatial/visual structure with system recognizing structures Visible and invisible links from paper to digital content

21. Links from Content Can we create links from standard paper content without augmented technology or visible marks? 1 st possibility: Use the text (OCR) – What are the limitations? 2 nd possibility: Treat as a photo – How to index?

22. The Big Issue Relying on a camera – Scale, skew, parallax Scale Invariant Feature Transform – Features that are resilient to different angles – Used for lots of image recognition tasks

23. Links Using SIFT (or Similar) Features Links can be from text and image content but – Printed text is not good for distinctive SIFT features – Could combine with lossy OCR Readers – Do not know where there is a link and where there is not a link – Do not know the boundary of links

24. Embedded Media Markers (EMMs)

25. EMM Characteristics Printed as an layer on top of existing content – Does not take space but can impact aesthetics – Readers know where links are – Readers have some information about results of taking a link Challenges – Recognition still has problems of SIFT features – Need authoring support for unambiguous EMMs

26. EMM Authoring Tool

28. Merging Paper and Digital Older and Newer technologies – E Ink – Flexible OLED