1. Computational Perception Li Liu

2. Course 10 lectures 2 exercises 2 labs 1 project 1 written examination

3. Scope Biomedia Download information Computational Perception Upload information

4. What Do We Study? to learn how perceptual organs work to understand information processing under nervous systems to experience technical challenges

5. Perceptual Process

6. Sensation Perception Cognition Proximal stimulus Distal Stimulus processingTransductionRecognitionActionPerception

7. Perceptual Cycle A: The behavior approach stimulation to perception B: The physiological approach stimulus to processing C: The psychological approach processing to perception D D: Our approach Transduction to perception

8. Course Focus TransductionprocessingPerception Lec 6 Perceptive field Lec 7 Sensory integration Lec 9 Visual attention Lec 10 Tactile video Lec 3 Neuron, neural network, and brain Lec 5 Learning and neural networks Lec 4 Natural Sensors

9. Transduction Transduction is the transform of one form of energy into another form of energy. In the nervous system, transduction occurs when environmental energy is transformed into electrical energy.

10. Perceptual Organs Transduction is the transform of one form of energy into another form of energy. In the nervous system, transduction occurs when environmental energy is transformed into electrical energy.

11. Neural Processing Neural processing is the operations that transform the electrical signals in the networks of neurons. An important processing is to extract the primary sketches from sensory raw data.

12. Right Eye Left Eye Retinal Image Superior Colliculus (left lobe) Lateral Geniculate Nucleus (LGN) - left Optic Radiations Visual Association Cortex Optic Nerves Optic Chiasm Optic Tracts Perception Perception is the process of putting inputs together into a usable mental representation of the world.

13. Information Rate sensationperceptioncognition datainformationknowledge Cognitive Bandwidth Perceptual Bandwidth Sensory Bandwidth

14. How Do We Study Perception? This course is to understand information processing in the nervous system. computer simulations of neural circuits, models of learning, representation of sensory information in neural networks, computational analysis of problems in biological sensing and perception

15. Three Topics Learning in neural network Interaction bwteen our neural system and physical environment Sensory integration

16. How To Do A Project? Li Liu

17. Research & Project ” The good researcher is not ’one who knows the right answers’ but ’one who is struggling to find out what the right questions might be’ ” Phillips and Pugh, 1994

18. 1.Setting your project 2.Conducting your project 3.Presenting your project Project

19. 1. Setting your project Writing a proposal Project planning

20. Writing a project proposal Thinking about Title, aim, objectives, extected outcomes, related research, questions, hypotheses, methods,.....

21. Project Planning Work breakdown Time estimates Milestone identification Activity sequencing Scheduling Replanning

22. 2. Conducting your project Literature searching and literature reviews Doing your project

23. Literature review To avoid ”re-invent wheel”

24. Doing your project Project Control Dealing with problems Managing your time Using your supervisor Team work

25. 3. Presenting your project Writing report Oral presentation

26. Ref: The Essence of Computing Projects a student’s guide by Christian W. Dawson

27. Good luck!

32. What is a ”project”? Project = ”Solving a problem”

33. A Problem? What is the problem? How to solve the problem? How to know that the problem has been solved? How good is the solution? A quality measure.

34. Case 1

35. Personal Area Network

37. Principle

39. Speech – Control Technology Name Dialing Hand Free

40. Speech Recognizer Speech Recognizer ”repeat”

41. Speech Signal Waveform

42. Effect of Background Noises

43. Performance Speech-to-Noise Ratio (dB) Words Correct Rate (%) -30 0 100 0

44. Lip Tracker

45. Performance of Speech Recognition Speech-to-Noise Ratio (dB) Words Correct Rate (%) -30 0 100 0 Auditory cues only Auditory and visual cues

46. How to Design A Headset? Tip ?

47. Mobile Phones

48. Scenario Shadi has a banking system based on a password He heard about an old Palestinian-Chinease identification system that could increase his system security He made a search on the Internet and found that he may find it at Umeå University, Biomedia2007. You are the consultants to help him

49. How to enjoy football with your mobile phone

50. One way is to use animation..

51. Live Experience!

52. Vibration

53. What is the ball?

55. Information Transform!

56. Control Patterns

57. Task To develop and evaluate a touch-based football broadcasting system for mobile users

58. iPhone

59. Virtual Buttons

60. Real Buttons vs Virtual Buttons ”Entry speed and error rate”

61. Task To add the tactile cues of real buttons to virtual buttons displayed on mobile devices with touch screens.

62. Why Do We Study Perception? To upload information to our brain!

63. Direct Interface Speech Recognizer

64. Implantable Chips

65. Neural-Silicon Interface

66. Implantable Computing

67. Sensory Integration

68. Resolution of RF

69. On-Off Perceptive Field

70. Mathematical Models of Perceptive Fields

71. Function of Perceptive Fields Image Analysis

72. Neural Information Transmission

73. Switch Circuits