1. Learning in the Brain Recognition and Representation in Cortex

2. Recognition Networks - Distributed

4. Recognition Networks - Parallel

6. The McGurk effect and parallel processing What about students with learning disabilities? Integration of heard and seen speech: a factor in learning disabilities in children Erin A. Hayesa,*, Kaisa Tiippanab, Trent G. Nicola, Mikko Samsb, Nina Krausa,c,d

7. Recognition Networks - Heterarchical

8. What’s wrong with this diagram? See Top to Bottom highlights

9. Illusions as top-down constraints on understanding images. Shadow Presidential Illusion Illusions Reveal the Brain's Assumptions Ball and Shadow On Illusions From Top to Bottom

10. Recognition Cortex Recognition cortex (sensory –perceptual cortex in the posterior neocortex) is composed of neural networks adapted to recognize regularities in the environment. Recognition cortex does not “respond” to these regularities, it generates them.

11. Structure in Recognition Cortex Structure is sculpted by learning – specifically by learning the regularities of the environment There is no optimal structure, the optimal structure is dependent on the kind of memory/perception/learning is needed. Overall structure is a network of networks – there is specialization and localization determined by learning There are many specialized networks – not 5 senses, but many. 30 visual networks alone.

12. Learning in Recognition Cortex Recognition cortex learns by changing its structure – by changing the connections between neurons that make up the network. Learning is a change in the way the network acts. Learning is a dynamic process not a static one. Piaget was right – assimilation is accompanied by accommodation.

13. What does recognition require? An integrated network, where meaning is constructed “heterarchically” – from the massive interplay of perceptual constancies symbolic information and cognitive experience.

14. Recognition Networks What kind of barriers arise?

15. Recognition Networks What kind of barriers arise? Perceptual Barriers Linguistic and Symbolic barriers Cognitive Barriers

16. Recognition Networks Overcoming the barriers: Multiple Representations Perceptual Options Linguistic Options Cognitive Options

17. Multiple Representations 1) Cognitive Options Priming background knowledge Providing multiple examples and non-examples Highlighting critical features and relationships Scaffolding strategies for comprehension Supporting memory and transfer 2) Linguistic Options Providing semantic (vocabulary) alternatives Providing syntactic alternatives Providing background language alternatives 3) Perceptual Options Providing verbal descriptions for Images Providing spoken equivalents for Text Providing captions for Speech

18. Practice: Teaching someone to recognize a “Federal Style” house.

19. The Federal Style house is usually a simple box, two or more rooms deep, with doors and windows arranged in strict symmetry. The box may be modified by projecting wings or attached dependencies. The stylistic focus is on the main entry -- a paneled door often framed by half or three-quarter length sidelights and thin pilasters or columns. The door is often crowned by a fanlight, or entabulature. The Federal Style House Recognizing a Federal Style House: One representation

20. The Federal Style house is usually a simple box, two or more rooms deep, with doors and windows arranged in strict symmetry. The box may be modified by projecting wings or attached dependencies. The stylistic focus is on the main entry -- a paneled door often framed by half or three-quarter length sidelights and thin pilasters or columns. The door is often crowned by a fanlight, or entabulature. The Federal Style House What kinds of barriers does this representation raise, for whom? Perceptual Linguistic Cognitive

21. The Federal Style house is usually a simple box, two or more rooms deep, with doors and windows arranged in strict symmetry. The Federal Style House What kinds of barriers does this representation raise, for whom? Perceptual Linguistic Cognitive

22. The Concept of the Federal Style House: An alternate representation A Federal Style House

23. longdesc 1)Perceptual Options Examples: Images with verbal equivalents Spoken Equivalents for Text Captions for Speech

24. The Federal Style house is most commonly a simple box, two or more rooms deep, with doors and windows arranged in strict symmetry. The box may be modified by projecting wings or attached dependencies. The stylistic focus is on the main entry -- a paneled door often framed by half or three-quarter length sidelights and thin pilasters or columns. The door is often crowned by a fanlight or an entablature. 1)Perceptual Options Examples: Verbal Descriptions for Images Spoken Equivalents for Text Captions for Speech

25. 1)Perceptual Options Examples: Verbal Descriptions for Images Spoken Equivalents for Text Captions for Speech video

26. Multiple Representations The Federal Style house is most commonly a simple box, two or more rooms deep, with doors and windows arranged in strict symmetry. The box may be modified by projecting wings or attached dependencies. The stylistic focus is on the main entry -- a paneled door often framed by half or three-quarter length sidelights and thin pilasters or columns. The door is often crowned by a fanlight, or entabulature.

27. Picture Descriptions (How to) First, understand the purpose of the image Second, start with a broad overview, the big picture Third, focus on a few relevant details (see Purpose) Fourth, describe relationships and comparisons Fifth, leave interpretations to the observer. Making a Picture Description

28. Multiple Representations Linked RepresentationsRepresentations Iris demo

29. Principle One: Multiple Representations 1) Perceptual Options Options in the display of information Options for auditory info Options for visual information transformations within vision transformations to other senses 2) Linguistic Options 3) Cognitive Options

30. Multiple Representations 1) Cognitive Options Priming background knowledge Providing multiple examples and non-examples Highlighting critical features and relationships Scaffolding strategies for comprehension Supporting memory and transfer 2) Linguistic Options Providing semantic (vocabulary) alternatives Providing syntactic alternatives Providing background language alternatives 3) Perceptual Options Providing verbal descriptions for Images Providing spoken equivalents for Text Providing captions for Speech

31. Multiple Representations 1) Perceptual Options 2) Linguistic Options Definitions for vocabulary Clarifications for syntax and structure Decoding of text and symbols Alternatives for cross-linguistic info Illustrations for info in text or language 3) Cognitive Options

32. The Federal Style house is most commonly a simple box, two or more rooms deep, with doors and windows arranged in strict symmetry. The box may be modified by projecting wings or attached dependencies. The stylistic focus is on the main entry -- a paneled door often framed by half or three- quarter length sidelights and thin pilasters or columns. The door is often crowned by a fanlight or an entablature.fanlightentablature 2) Linguistic Options Example: Definitions for vocabulary Translations for English Alternative syntactic complexity

33. The Federal Style house is most commonly a simple box, two or more rooms deep, with doors and windows arranged in strict symmetry. The box may be modified by projecting wings or attached dependencies. The stylistic focus is on the main entry -- a paneled door often framed by half or three- quarter length sidelights and thin pilasters or columns. The door is often crowned by a fanlight or an entabulature. En Espanol In English 2) Linguistic Options Example: Definitions for vocabulary Translations for English Alternative syntactic complexity

34. Multiple Representations 1) Cognitive Options Priming background knowledge Providing multiple examples and non-examples Highlighting critical features and relationships Scaffolding strategies for comprehension Supporting memory and transfer 2) Linguistic Options Providing semantic (vocabulary) alternatives Providing syntactic alternatives Providing background language alternatives 3) Perceptual Options Providing verbal descriptions for Images Providing spoken equivalents for Text Providing captions for Speech

35. 3) Cognitive Options Providing Background Information It's easy to confuse Federalist architecture with the earlier Georgian Colonial style. The difference is in the details: While Georgian homes are square and angular, a Federal style building is more likely to have curved lines and decorative flourishes. Federalist architecture was the favored style in the United States from about 1780 until the 1830s. However, Federalist details are often incorporated into modern American homes. Look past the vinyl siding, and you may see a fanlight or the elegant arch of a Palladian window.

36. 3) Cognitive Options: Example: Activating background knowledge

37. 3) Cognitive Options: Example: Activating background knowledge

38. 3) Cognitive Options: Example: Activating background knowledge

39. 3) Cognitive Options: Example: Activating background knowledge Providing alternative examples

40. Federal Style Buildings: Examples

41. Non-examples: Gothic Revival Buildings

42. Non-examples: Greek Revival Buildings

43. Non-examples: Georgian

44. 3) Cognitive Options: Example: Highlighting Critical Features Prominent End Chimneys Low Hipped Roof Fanlight Over Door Symmetrical, Multi-pane windows

45. | 1800 |1810 |1820 |1830 |1840 |1850 |1860 |1870 |1880 |1890 |1900 | 1800 Georgian | 1810 Federal | 1825 Greek Revival | 1840 Victorian | 1855 Second Empire | 1880 Harvard Mills | 3) Cognitive Options: Example: Highlighting Critical Features, Relationships

46. Classical Entrance? Fanlight over the door? Small side panels or lites? 3) Cognitive Options: Example: Guiding exploration and examination Progressive exposure First, look at the main entrance, does it have:

47. Palladian window in center? Windows arranged symmetrically? Entabulature over front entrance?, Second, look at the front façade, does it have:

48. Low-pitched roof? Balustrade? Prominent End Chimneys? Third, look at the roof, does it have::

49. Federal Features F anlight over front door E nd Chimneys D entil Moldings E ven or symmetrical windows R oof over front door A Palladian Window L ow Hipped roof 1) Cognitive Options: Example: Facilitating memory and transfer

50. 3) Cognitive Options: Example: Facilitating memory and transfer

51. 3) Cognitive Options: Example: Facilitating memory and transfer

52. 3) Cognitive Options: Example: Facilitating memory and transfer

53. 3) Cognitive Options: Example: Facilitating memory and transfer

54. Alt tags and Long Descriptions Picture of a Federal Style house. The image shows a single home setting on a large landscaped lawn and garden. The house is two stories tall and made of brick with a low pitched roof and four prominent chimneys placed at the ends of the roof. Overall there is a distinctively symmetrical arrangement of the building’s features. There is a central entrance with a fanlight over the door and small windows alongside. Two rows of evenly spaced multiple-pane windows with black shutters are arranged symmetrically around the entrance. Return

55. Vocabulary Fanlight: A fanlight is a semicircular or semi-elliptical window over a doorway or another window. Federal homes often have fanlights.Federal Return

56. Vocabulary Entablature: Entablature is the elaborate, multi-level beam that sits on top of the columns in classical architecture. Return

57. 3) Provide cognitive options in the way information is presented. Prime or activate background knowledge (advanced organizers, pre-teaching, analogies, multiple examples)

58. Provide cognitive options in the way information is presented. Prime or activate background knowledge (advanced organizers, pre-teaching, analogies) Highlight critical features, big ideas, relationships (concept maps, diagrams, highlighted text)

59. Provide cognitive options in the way information is presented. Prime or activate background knowledge (advanced organizers, pre-teaching, analogies) Highlight critical features, big ideas, relationships (concept maps, diagrams, highlighted text) Embed scaffolds for using strategies (prompts, models, graduated scaffolds)

60. Provide cognitive options in the way information is presented. Prime or activate background knowledge (advanced organizers, pre-teaching, analogies) Highlight critical features, big ideas, relationships (concept maps, diagrams, highlighted text) Embed scaffolds for using strategies (prompts, models, graduated scaffolds) Provide supports for memory and transfer (checklists, mnemonic devices, spaced review)