Learning in the Brain Recognition and Representation in Cortex

Recognition Networks - Distributed

Recognition Networks - Parallel

The McGurk effect and parallel processing What about students with learning disabilities? Integration of heard and seen speech: a factor in learning disabilities in children Erin A. Hayesa,*, Kaisa Tiippanab, Trent G. Nicola, Mikko Samsb, Nina Krausa,c,d

Recognition Networks - Heterarchical

What’s wrong with this diagram? See Top to Bottom highlights

Illusions as top-down constraints on understanding images. Shadow Presidential Illusion Illusions Reveal the Brain's Assumptions Ball and Shadow On Illusions From Top to Bottom

Recognition Cortex Recognition cortex (sensory –perceptual cortex in the posterior neocortex) is composed of neural networks adapted to recognize regularities in the environment. Recognition cortex does not “respond” to these regularities, it generates them.

Structure in Recognition Cortex Structure is sculpted by learning – specifically by learning the regularities of the environment There is no optimal structure, the optimal structure is dependent on the kind of memory/perception/learning is needed. Overall structure is a network of networks – there is specialization and localization determined by learning There are many specialized networks – not 5 senses, but many. 30 visual networks alone.

Learning in Recognition Cortex Recognition cortex learns by changing its structure – by changing the connections between neurons that make up the network. Learning is a change in the way the network acts. Learning is a dynamic process not a static one. Piaget was right – assimilation is accompanied by accommodation.

What does recognition require? An integrated network, where meaning is constructed “heterarchically” – from the massive interplay of perceptual constancies symbolic information and cognitive experience.

Recognition Networks What kind of barriers arise?

Recognition Networks What kind of barriers arise? Perceptual Barriers Linguistic and Symbolic barriers Cognitive Barriers

Recognition Networks Overcoming the barriers: Multiple Representations Perceptual Options Linguistic Options Cognitive Options

Multiple Representations 1) Cognitive Options Priming background knowledge Providing multiple examples and non-examples Highlighting critical features and relationships Scaffolding strategies for comprehension Supporting memory and transfer 2) Linguistic Options Providing semantic (vocabulary) alternatives Providing syntactic alternatives Providing background language alternatives 3) Perceptual Options Providing verbal descriptions for Images Providing spoken equivalents for Text Providing captions for Speech

Practice: Teaching someone to recognize a “Federal Style” house.

The Federal Style house is usually a simple box, two or more rooms deep, with doors and windows arranged in strict symmetry. The box may be modified by projecting wings or attached dependencies. The stylistic focus is on the main entry -- a paneled door often framed by half or three-quarter length sidelights and thin pilasters or columns. The door is often crowned by a fanlight, or entabulature. The Federal Style House Recognizing a Federal Style House: One representation

The Federal Style house is usually a simple box, two or more rooms deep, with doors and windows arranged in strict symmetry. The box may be modified by projecting wings or attached dependencies. The stylistic focus is on the main entry -- a paneled door often framed by half or three-quarter length sidelights and thin pilasters or columns. The door is often crowned by a fanlight, or entabulature. The Federal Style House What kinds of barriers does this representation raise, for whom? Perceptual Linguistic Cognitive

The Federal Style house is usually a simple box, two or more rooms deep, with doors and windows arranged in strict symmetry. The Federal Style House What kinds of barriers does this representation raise, for whom? Perceptual Linguistic Cognitive

The Concept of the Federal Style House: An alternate representation A Federal Style House

longdesc 1)Perceptual Options Examples: Images with verbal equivalents Spoken Equivalents for Text Captions for Speech

The Federal Style house is most commonly a simple box, two or more rooms deep, with doors and windows arranged in strict symmetry. The box may be modified by projecting wings or attached dependencies. The stylistic focus is on the main entry -- a paneled door often framed by half or three-quarter length sidelights and thin pilasters or columns. The door is often crowned by a fanlight or an entablature. 1)Perceptual Options Examples: Verbal Descriptions for Images Spoken Equivalents for Text Captions for Speech

1)Perceptual Options Examples: Verbal Descriptions for Images Spoken Equivalents for Text Captions for Speech video

Multiple Representations The Federal Style house is most commonly a simple box, two or more rooms deep, with doors and windows arranged in strict symmetry. The box may be modified by projecting wings or attached dependencies. The stylistic focus is on the main entry -- a paneled door often framed by half or three-quarter length sidelights and thin pilasters or columns. The door is often crowned by a fanlight, or entabulature.

Picture Descriptions (How to) First, understand the purpose of the image Second, start with a broad overview, the big picture Third, focus on a few relevant details (see Purpose) Fourth, describe relationships and comparisons Fifth, leave interpretations to the observer. Making a Picture Description

Multiple Representations Linked RepresentationsRepresentations Iris demo

Principle One: Multiple Representations 1) Perceptual Options Options in the display of information Options for auditory info Options for visual information transformations within vision transformations to other senses 2) Linguistic Options 3) Cognitive Options

Multiple Representations 1) Cognitive Options Priming background knowledge Providing multiple examples and non-examples Highlighting critical features and relationships Scaffolding strategies for comprehension Supporting memory and transfer 2) Linguistic Options Providing semantic (vocabulary) alternatives Providing syntactic alternatives Providing background language alternatives 3) Perceptual Options Providing verbal descriptions for Images Providing spoken equivalents for Text Providing captions for Speech

Multiple Representations 1) Perceptual Options 2) Linguistic Options Definitions for vocabulary Clarifications for syntax and structure Decoding of text and symbols Alternatives for cross-linguistic info Illustrations for info in text or language 3) Cognitive Options

The Federal Style house is most commonly a simple box, two or more rooms deep, with doors and windows arranged in strict symmetry. The box may be modified by projecting wings or attached dependencies. The stylistic focus is on the main entry -- a paneled door often framed by half or three- quarter length sidelights and thin pilasters or columns. The door is often crowned by a fanlight or an entablature.fanlightentablature 2) Linguistic Options Example: Definitions for vocabulary Translations for English Alternative syntactic complexity

The Federal Style house is most commonly a simple box, two or more rooms deep, with doors and windows arranged in strict symmetry. The box may be modified by projecting wings or attached dependencies. The stylistic focus is on the main entry -- a paneled door often framed by half or three- quarter length sidelights and thin pilasters or columns. The door is often crowned by a fanlight or an entabulature. En Espanol In English 2) Linguistic Options Example: Definitions for vocabulary Translations for English Alternative syntactic complexity

Multiple Representations 1) Cognitive Options Priming background knowledge Providing multiple examples and non-examples Highlighting critical features and relationships Scaffolding strategies for comprehension Supporting memory and transfer 2) Linguistic Options Providing semantic (vocabulary) alternatives Providing syntactic alternatives Providing background language alternatives 3) Perceptual Options Providing verbal descriptions for Images Providing spoken equivalents for Text Providing captions for Speech

3) Cognitive Options Providing Background Information It's easy to confuse Federalist architecture with the earlier Georgian Colonial style. The difference is in the details: While Georgian homes are square and angular, a Federal style building is more likely to have curved lines and decorative flourishes. Federalist architecture was the favored style in the United States from about 1780 until the 1830s. However, Federalist details are often incorporated into modern American homes. Look past the vinyl siding, and you may see a fanlight or the elegant arch of a Palladian window.

3) Cognitive Options: Example: Activating background knowledge

3) Cognitive Options: Example: Activating background knowledge

3) Cognitive Options: Example: Activating background knowledge

3) Cognitive Options: Example: Activating background knowledge Providing alternative examples

Federal Style Buildings: Examples

Non-examples: Gothic Revival Buildings

Non-examples: Greek Revival Buildings

Non-examples: Georgian

3) Cognitive Options: Example: Highlighting Critical Features Prominent End Chimneys Low Hipped Roof Fanlight Over Door Symmetrical, Multi-pane windows

| 1800 |1810 |1820 |1830 |1840 |1850 |1860 |1870 |1880 |1890 |1900 | 1800 Georgian | 1810 Federal | 1825 Greek Revival | 1840 Victorian | 1855 Second Empire | 1880 Harvard Mills | 3) Cognitive Options: Example: Highlighting Critical Features, Relationships

Classical Entrance? Fanlight over the door? Small side panels or lites? 3) Cognitive Options: Example: Guiding exploration and examination Progressive exposure First, look at the main entrance, does it have:

Palladian window in center? Windows arranged symmetrically? Entabulature over front entrance?, Second, look at the front façade, does it have:

Low-pitched roof? Balustrade? Prominent End Chimneys? Third, look at the roof, does it have::

Federal Features F anlight over front door E nd Chimneys D entil Moldings E ven or symmetrical windows R oof over front door A Palladian Window L ow Hipped roof 1) Cognitive Options: Example: Facilitating memory and transfer

3) Cognitive Options: Example: Facilitating memory and transfer

3) Cognitive Options: Example: Facilitating memory and transfer

3) Cognitive Options: Example: Facilitating memory and transfer

3) Cognitive Options: Example: Facilitating memory and transfer

Alt tags and Long Descriptions Picture of a Federal Style house. The image shows a single home setting on a large landscaped lawn and garden. The house is two stories tall and made of brick with a low pitched roof and four prominent chimneys placed at the ends of the roof. Overall there is a distinctively symmetrical arrangement of the building’s features. There is a central entrance with a fanlight over the door and small windows alongside. Two rows of evenly spaced multiple-pane windows with black shutters are arranged symmetrically around the entrance. Return

Vocabulary Fanlight: A fanlight is a semicircular or semi-elliptical window over a doorway or another window. Federal homes often have fanlights.Federal Return

Vocabulary Entablature: Entablature is the elaborate, multi-level beam that sits on top of the columns in classical architecture. Return

3) Provide cognitive options in the way information is presented. Prime or activate background knowledge (advanced organizers, pre-teaching, analogies, multiple examples)

Provide cognitive options in the way information is presented. Prime or activate background knowledge (advanced organizers, pre-teaching, analogies) Highlight critical features, big ideas, relationships (concept maps, diagrams, highlighted text)

Provide cognitive options in the way information is presented. Prime or activate background knowledge (advanced organizers, pre-teaching, analogies) Highlight critical features, big ideas, relationships (concept maps, diagrams, highlighted text) Embed scaffolds for using strategies (prompts, models, graduated scaffolds)

Provide cognitive options in the way information is presented. Prime or activate background knowledge (advanced organizers, pre-teaching, analogies) Highlight critical features, big ideas, relationships (concept maps, diagrams, highlighted text) Embed scaffolds for using strategies (prompts, models, graduated scaffolds) Provide supports for memory and transfer (checklists, mnemonic devices, spaced review)