Spatiotemporal Information Processing No.7 Information-oriented real space Augmented Reality and wearable computer ～ What is brought by miniaturization of computer ～ Kazuhiko HAMAMOTO Dept. of Information Media Technology, School of Information and Telecommunication Eng., Tokai University, Japan

Today’s Contents  Mixed Reality  What is brought by miniaturization of computer ?  Qualitative transition by wearable computer  Wearable computer and AR

Mixed Reality  Mixture of virtual environment and real environment  To get augmented information which cannot be got in only one environment  Augmented Reality Real space is augmented by virtual infor.  Augmented Virtuality Virtual space is augmented by real infor.

What is brought by miniaturization of computer ?  Ability of computer 100 times – 1000 times in 10 years The same spec. in a smaller computer  “Miniaturization” = “quantitative transition”  “Mobile” = “qualitative transition”  Computer is spread over the space Information occurs anywhere Information is processed at its position. The process is “natural”. It can be realized. Information – oriented real space

What is brought by miniaturization of computer ?  Computer is spread over the space.  Release of “zoning” of time and space  What is “spatiotemporal zoning” ? To keep “specialized space” and “scheduled time” for a purpose.  Phone call at “telephone box”  Go to a factory and work

What is brought by miniaturization of computer ?  What is realized by “release of spatiotemporal zoning” ? If a space is connected to another space, Either of spaces should be a space which has special information Classroom – field, laboratory, etc.  Keyword = mobile, wearable

What is brought by miniaturization of computer ?  Essence of miniaturization = integration of computer and human body  Computer, as a device which augments physical ability  “institutional” -> “personal” -> “intimate” by A.Kay

What is brought by miniaturization of computer ?  What is “intimate computer” ? A computer has a deep relationship with individual information. The computer doesn’t work, even if other person wants to use it. The computer is unified with an individual.

What is brought by miniaturization of computer ?  “Intimate” and “human interface” Man – machine interface 1 st interface  Human body – artificial object (machine) 2 nd interface  Surface between computer and network  Surface between OS and application “Intimate” means “interface is shifted to machine side” 1 st interface is integrated into human body

network OS ・ device driver application 1 st interface 2 nd interface Physical interface System - user More conceptual level interface “Intimate” means interface is shifted to machine. 1 st interface is internalized into human body. What is brought by miniaturization of computer ?

Conventional human interface Organized by average value Task management Efficiency ・ human action is decomposed into basic action component ・ standard working schedule is assigned. ・ work and schedule simulation is possible. Subdivision of work and shcedule Mixture of semantics Standardization is difficult. What is brought by miniaturization of computer ?

Next generation human interface （ for intimate device ） ・ adaptation to diversity of individual ・ no standardization on 1 st interface ・ standardization on 2 nd interface ・ intimate device is a new uniform ・ the uniform can be operated by “wearing it” ・ there is network protocol outside the uniform What is brought by miniaturization of computer ?

InstitutionalPersonalIntimateImplant Wearable computer The famous professor, Dr. Masahiko Tsukamoto ・ Its metaphor is “cloth” ・ When a man wears computer, he / she can join network society （ When a man wears clothes, he / she can go out public society ） What is brought by miniaturization of computer ?

Qualitative transition by wearable computer  Always ON Because of subdivision of period of use.  “Task unit” becomes very small. An interface which can be used with another work is needed. Hands free interface  Sound interface  One-hand operation keyboard (for example, mobile phone) Unconscious interface  Unconscious input by GPS, RFID, etc.

 Meaning of GPS interface Question From here to Tokai U., how long does it take ? If No “from here” Wide retrieve area 10min Hon-atsugi 9hours Bangkok ? 1hour 10min shinjuku 4 hours Fukuoka 4hours half Hokkaido Unconscious input of Position by GPS From here 30 min. Despite no perceived input Narrow retrieve area From Here Qualitative transition by wearable computer

 The meaning of GPS interface Huge capacity information compression is realized For example, the difference between mobile phone mail and conventional mail Mobile phone mail is usually shorter than conventional mail.  A new media develops a new culture, its original style as time passes. Qualitative transition by wearable computer

Wearable computer and AR  Use with GPS, gyro, ubiquitous computing, or environment-embedded computer. Information of an object in front of eyes is displayed in real space Information of a building or encyclopedia information such as view or flower Superimpose work manual on work area Life log Position information with GPS and RFID, for not only outside but inside building  Information-oriented real space

Application of AR with GPS and Gyro  Measurement of position and direction of viewpoint  Computer has a database of the town  When use looks up at a building, the information of the building is displayed Micro Display GPS, Gyro computer

GPS Forest Field Science Education  User has PDA with GPS and Wi-Fi  User can know a position of user-own position (navigation). User can walk though no road in woods  User can get information related to user’s position (contents). For example, user can learn what tree it is. PDA GPS

GPS Forest : System Field Science Education forest server Wireless LAN GPS user

GPS Forest : Navigation Field Science Education GPS user PDA

GPS Forest : Contents Field Science Education GPS Hot Spot

GPS Forest : Contents Field Science Education

New service of Rakuten travel （ ） ・ User can see hotel information by iPhone, Air Tag ・ User can book a room directly from the Air Tag What is brought by miniaturization of computer ?

Application of AR with GPS and RFID Outside Use of GPS information Inside Use of RFID and pedometer Nara Institute of Science and Technology

Life Log : record of experience  User who wears wearable computer with camera, microphone and various sensors can record use- own experience unconsciously.  If 8 hours a day, the resolution is not so high, required capacity is 10Tbytes in 70 years.  What do you want to use it for ?  A sense of experience can be analyzed quantitatively The subjective experience is analyzed quantitatively. Multiple person can have the experience in common.

Body temperature, beat rate, air temperature, humidity are measured and recorded and the correlation among these experience. Life Log : record of experience

Information-oriented real space experiment space for barrier free in Univ. of Tokyo  1300 active RFID Tags are embedded in floor of 1700 m 2, in pitch of 1.2m  Each tag has own ID and sends information every 0.2 second  User with wearable computer and antenna for RFID tag can be detected in real time. The resolution is less than 1m. Hot spot is set every 5m Some hot spots have network camera and record and analyze spatiotemporal information in real time

Information-oriented real space experiment space for barrier free in Univ. of Tokyo

 Navigation for deaf- blindness person Active studded paving block to aid the blind Not only user information but environment information is also obtained in real time. Leading path is decided every 100ms. The decided path is transmitted to user by the special device. Wearable computer for user Finger-braille interface Information-oriented real space experiment space for barrier free in Univ. of Tokyo

Information-oriented real space a plan of area-exhibition in the 2005 World Exposition  A plan of exhibition system which doesn’t use “building”  The real space (natural space) is used for exhibition space for ecology  User can access information by using wearable computer and HMD.  It couldn’t be realized due to the cost of devices, quality of information and the sense of incompatibility about “wearing anything”

Information-oriented real space a plan of area-exhibition in the 2005 World Exposition