2. Human InformationProcessing Li Liu

3. Human Computer Interaction How much information can she receive? ”Human Information Processing”

4. Case 1

5. Personal Area Network

7. Principle

9. Speech – Control Technology Name Dialing Hand Free

10. Speech Recognizer Speech Recognizer ”repeat”

11. Speech Signal Waveform

12. Effect of Background Noises

13. Performance Speech-to-Noise Ratio (dB) Words Correct Rate (%) -30 0 100 0

14. Lip Tracker

15. Performance of Speech Recognition Speech-to-Noise Ratio (dB) Words Correct Rate (%) -30 0 100 0 Auditory cues only Auditory and visual cues

16. How to Design A Headset? Tip ?

17. Mobile Phones

18. Braille Code for English

19. Tactile Display

20. Problem: Usable? Efficiency? Reliability?

21. Braille Code for English

22. How Many Letters Can be Represented?

23. Combination

24. Tactile Pins

25. Braille Code for English W=2.4093 The average number of active tactile pins. W opt =1.2118 Letters in written English

26. New Code W=1.2316

30. Information

31. If all eight horses are equally good, then the chance for a horse to win the race is 1/8! Information Theory What is the probability? The probability for a horse to win is P i =1/8

32. Information Theory If a horse wins the game, how much information is it given? How to measure information?

33. Measure of information A source A={a 1,a 2 …a N } the probability of each event P={P 1,P 2 …P N } More information if P i is low, less information is P i is high I(a i )=log(1/P i ) is called self information 1/81/41/21/161/8

34. Entropy Taking the mean value over all symbols with the alphabet 1/81/41/21/161/8

35. Communication Theory I If R < H error-free representation impossible! H source R

36. Coding 1/8 000 001 010 111 1/81/41/21/16 0 10 110 1110 111100 111101 111110 111111

37. How much information does a picture contain? 255 254 0

38. How much information does a picture contain? Suppose the size of a picture is 256 x256, And each pixel is represented by 8 bits, then Total bits to represent such a picture is 8x256x256= 524288 bits/picture How many pictures can be represented by a half Mbits? 0100110101000011101110101010.............. Total number of pictures 2 524288 = 10 158000

39. How many pictures have human beings been perceived Up to now, the number of all pictures which have been perceived by human beings is only 10 19. Assume that 30 frames of pictures per second are perceived by human eyes. If the average life-span is 70 years and 8 hours per day are spent on sleep, then about 10 8 frames are received by one person in all his/her life. Furthermore, if the total number of human beings who lived in the earth is 10 11, then, the total number of all pictures which have been perceived by human beings is only 10 19. 10 19 <<< 10 158000

40. Entropy of an image H=6.9 45 001 123 00010 208 00011 intensity probability

41. Entropy of human face images A face image = 50 bytes (400 bits) !

42. Communication

43. Brain Wave C channel source H

44. Communication Channel Abstract Channel Model Ex. Noiseless Binary Channel 0 1 1 0 Channel Capacity C= 1 bit

45. Communication Channel Abstract Channel Model Ex. Noisy Binary Channel Channel Capacity C= 1 + p log 2 p + (1-p) log 2 (1-p) bits 1 1 0 0 p p 1-p

46. Communication & Design transmitter receiver

47. Different Decoders ”When a group of people look at an object, none of them sees exactly the same thing as anyone else. Even if they receive approximately the same image on their retina and interpret the image in basically the same way, this image is always revised by the observer’s personality and situation.” Rune Monö

48. Real-World Channel Model Ex. Band-limited Gaussian Channel Z(t) Gaussian noise X(t) Y(t) C = Wlog 2 (1+P/N) bits/s W: channel bandwidth P/N: signal to noise ratio

49. Telephone signals are band-limited to 3300Hz and have a SNR of 20 dB (P/N=100), C=3,300 log (1+100)= 22,000 bits/s Practical modems achieve transmission rates up to 19,200 bits/s Real-World Channel Model

50. Communication Theory II If H <= C lossless transmission possible If H > C lossless transmission impossible! C Channel R H Source

52. Brain Wave

53. Information Rate sensationperceptioncognition datainformationknowledge Cognitive Bandwidth Perceptual Bandwidth Sensory Bandwidth

54. Information Rates SenseInformation Stream Bits/s Vision10.000.000 Hearing100.000 Touch10.000 Smell1.000 Taste1.000 SenseBandwidth of consciousness bits/s vision40 hearing30 touch5 Taste and smell1

55. Channel=”Bandpass Filter”

56. Effect of degrading the speech signal by spectral filtering The original speech signal contains significant energy up to 7 kHz a) signal bandpass filtered (0.25 - 0.75 kHz) b) signal bandpass filtered (1.0 – 3.0 kHz) c) original signal Effect of Bandpass

57. Bandpass System Most long-haul transmission systems have a bandpass Frequency response The transfer function can be written as where the resonant frequency f o and quality factor Q are The 3dB bandwidth between the lower and upper cutoff frequencies is = R LC flfl fofo fufu f 1.0 0.707 B

58. Bandpass System Since practical tuned circuits usually have 10 < Q <100, the fractional bandwidth B/f c should be kept within the range As a rough rue of thumb, the carrier frequencies and corresponding nominal bandwidth can be

59. Bandpass System Frequency bandCarrier frequency Bandwidth Longwave radio 100 kHz 2 kHz Shortwave radio 5 MHz100 kHz VHF 100 MHz 2 MHz Microwave 5 GHz100 MHz Millimeterwave1 00 GHz 2 GHz Optical5x10 14 Hz 10 13 Hz Selected carrier frequencies and nominal bandwidth