Matjaž Gams Institut “Jožef Stefan” The visual Turing test 1JSI, visuat TT

Outline Outline Relation to cognitive sciences Computer vision Turing and the vision Turing test 2JSI, visuat TT

Computer vision Computer vision (Broek 2011) intersection human-computer: study of pictures and videos in order to achieve results similar to those as by men. David Marr (1979) vision is the process of discovering from images what is present in the world. Vision is solving the "ill-posed problems" of reverse by adding assumptions about the world into the process of vision. Marr strongly believed in Turing. 3JSI, visuat TT

Computer vision Karl Pribram Computer vision Karl Pribram Holonomic brain model of cognitive function Processing in the brain: -large fiber tracts in the brain, and -processing in webs of fine fiber branches, e.g. dendrites, performing multiple computing from multiple sources in the web. Gabor quanta of information, wavelets in quantum holography. Holograms correspond to 3D images and can correlate and store a huge amount of information. 4JSI, visuat TT

Computer vision Computer vision (ECAI 2012) computer vision outperforms humans in several tasks, e.g. counting objects (sheep, furniture), medical imaging. Computer more accurate than human doctor at breast cancer diagnosis 5JSI, visuat TT Computer scientists and pathologists at Stanford University now have a computer system, called C- Path (Computational Pathologist), that can look a tissue sample and diagnose breast cancer more accurately than a human doctor.

Computer vision Computer vision (ECAI 2012) computer vision or with other sensors enables movement in the real environment: autonomous cars, choppers, robots.., l 6JSI, visuat TT Wolfram Burgard, University of Freiburg, Germany: Probabilistic Techniques for Mobile Robot Navigation. Robot Obeliks 3 km in 1.5h, Freiburg, German TV.

Seeing is a cognitive process Seeing is a cognitive process Fast progressing, but like in chess The meaning or the understanding of what is seen is the correct version of zillion of possibilities captured in a picture (a line or an edge?, seeing after 40 years). Deciphering uses time, sequences, shades …, and knowledge, and models and meaning / cognition. Seeing is a cognitive process. 7JSI, visuat TT

Seeing is a cognitive process Seeing is a cognitive process Michael G. "Mike" May (born 1954) blinded at the age of 3 but regained vision in 2000, at 46. He sees the picture OK. He still has no intuitive grasp of depth perception. As people walk away from him, he perceives them as literally shrinking in size, has problems distinguishing male from female faces, and recognizing emotions. Michael lost his eyesight at age 3, when his vision was still not fully developed to distinguish shapes, drawings or images clearly. The impairment of his visual cortex, due to the loss of his vision at a very early age, resulted in visual cortex cells that are not used to the stimuli in his surroundings. Michael has developed very precise senses of hearing and touch. Similar to language (wolf children) early development (hardware) of the brain is essential – the visual neurons have to bind together with meaning neurons. 8JSI, visuat TT

1950 – birth of AI, Turing test 9 Turing, Alan (October 1950), "Computing Machinery and Intelligence", Mind. Turing test – TT Total TT - TTT Total total TT – TTTT Loebner test CAPTCHA, Jeopardy 2011 Searl’s Chinese room JSI, visuat TT

TT too simple or too hard? TT too simple or too hard? Web: lots of links how a particular system fooled humans, e.g. the review process French: The Turing Test is already too hard and too anthropocentric for any machine that was not a physical, social, and behavioral carbon copy of ourselves to actually pass it. MG: „Fair“ TT: do not compare to an actual adult; compare it to a human model; if the tested subject demonstrates intelligent and cognitive skills at a level of a child or any intelligent form Visual Turing test: instead of symbolic tasks, vision tasks 10JSI, visuat TT

Visual Turing test - CAPTCHA Visual Turing test - CAPTCHA Differentiate computers from humans Easiest and fastest version of the Turing test Looking at an android or Madame Tussauds wax hard 11JSI, visuat TT