What do we have so far? Basic biology of the nervous system

Slides:



Advertisements
Similar presentations
Heuristic Search techniques
Advertisements

Presentation on Artificial Intelligence
Problem Solving What is a problem? How do we go about solving problems? How can we be better problem-solvers?
Computer Simulation (1). 8 A (8) Initial State 44 Goal State B (5) C (3) A (8) B (5) C (3) Step 1 Step 2 Step 3 Step 4 Step 5 Step 6 Step 7.
Skill Learning and Expertise. Anderson’s ACT Theory General theory of learning and problem solving Anderson (e.g., 1983, 1990, 1993, 1996) –Adaptive Control.
Problem Solving Shortcuts through the Problem Space.
Problem Solving. Well-defined problems –Much studied in AI –Requires search –Domain general heuristics for solving problems What about ill-defined problems?
Cognitive - problem_solving.ppt © 2001 Laura Snodgrass, Ph.D.1 Problem Solving Well-defined versus ill-defined problems Creativity Polya’s stages of problem.
Cognitive Processes PSY 334 Chapter 8 – Problem Solving.
Chinese Ring Puzzle and its Isomorphs (Kotovsky & Simon)
1 What do we have so far? Basic biology of the nervous system Motivations Senses Learning Perception Memory Thinking and mental representations.
Problem Solving & Creativity Dr. Claudia J. Stanny EXP 4507 Memory & Cognition Spring 2009.
1 Problem Solving We view many situations in life as problems we need to solve Also, much of human behavior can be considered problem solving, even if.
Heuristic Search Heuristic - a “rule of thumb” used to help guide search often, something learned experientially and recalled when needed Heuristic Function.
Warm Up Answers 3. YYURYYUBICURYY4ME Coffin
Problem-Solving and Reasoning
Chapter 6 Supplement Knowledge Engineering and Acquisition Chapter 6 Supplement.
Thinking & Problem Solving
PSY 323 – Cognition Chapter 12: Problem Solving.
Human Cognitive Processes: psyc 345 Ch. 11: Problem Solving Takashi Yamauchi © Takashi Yamauchi (Dept. of Psychology, Texas A&M University)
Changing and reorganizing information stored in memory to create new or transformed information.
WHS AP Psychology Unit 6: Cognition Essential Task 6-2: Identify problem-solving techniques (algorithms and heuristics) as well as factors that influence.
Expertise Novices and experts Expertise and perception Expertise and memory Expertise and judgment Expertise and domain-specificity.
Lecture 13 – Problem Solving 1 Two points for this lecture: 1.Role of problem solving in history of cognition. 2. Cognitive theories of the problem, the.
Introduction to Problem Solving
Cognitive Processes PSY 334
Automated Reasoning Early AI explored how to automated several reasoning tasks – these were solved by what we might call weak problem solving methods as.
Problem solving What is problem solving? Weak and strong methods.
Problem Solving PERTEMUAN Early research on problem- solving A cat placed in a box with a trapdoor was not observed to show behaviour approximating.
Four points for this lecture Role of problem solving in history of cognition. Theories about problem Theories about solver’s knowledge Theories about process.
Cognitive Processes PSY 334
The Acceptance Problem for TMs
Recursion Topic 5.
Learning Fast and Slow John E. Laird
Cognitive Processes PSY 334
Done Done Course Overview What is AI? What are the Major Challenges?
Introduction to Artificial Intelligence
Unit 3: Learning, Memory, Thinking, and Language
Psychology lecture thinking and decision making
What Does Math Practice 7 Mean, Anyway? Nicole Hansen and Dylan Kane
Introduction Defining the Problem as a State Space Search.
PROBLEM-SOLVING Why are some problems just so damn darn hard to solve? 1. We don’t take the time to determine what is relevant and end up focusing on irrelevant.
Unit 6: Cognition WHS AP Psychology
Cognitive Processes: Thinking and Problem Solving
Knowledge Representation
Teach meet Fluency and Reasoning.
Memory and Thought Chapter 3.
Introduction Artificial Intelligent.
Unit 7: Cognition AP Psychology
Tutorial 3 Empirical evaluation in AI
Thinking & Problem Solving
Thinking and Language.
Haskell Tips You can turn any function that takes two inputs into an infix operator: mod 7 3 is the same as 7 `mod` 3 takeWhile returns all initial.
Unit 7: Cognition AP Psychology
Thinking.
Language & Thought Cognition at Work.
Lecture 3: Environs and Algorithms
Lecture 6 Architecture Algorithm Defin ition. Algorithm 1stDefinition: Sequence of steps that can be taken to solve a problem 2ndDefinition: The step.
Cognitive Processes PSY 334
Psychology of Thinking: Embedding Artifice in Nature
Unit VII: Cognition Part two- Thinking
Applying Use Cases (Chapters 25,26)
Applying Use Cases (Chapters 25,26)
Thinking.
State-Space Searches.
State-Space Searches.
Search.
Good Morning!!! Which would you rather fight?? Ten duck-sized Horses!?
Search.
State-Space Searches.
Presentation transcript:

What do we have so far? Basic biology of the nervous system Motivations Senses Learning Perception Memory Thinking and mental representations

What do we have so far? All of these topics give a basic sense of the structure and operation of our mind What kinds of tasks does our mind engage in? Language Problem Solving Decision Making Others

Problem Solving: Definition A problem exists when you want to get from “here” (a knowledge state) to “there” (another knowledge state) and the path is not immediately obvious.

What are problems? Everyday experiences Domain specific problems How to get to the airport? How to study for a quiz, complete a paper, and finish a lab before recitation? Domain specific problems Physics or math problems Puzzles/games Crossword, anagrams, chess

A Partial Problem Typology Well-defined vs. ill-defined problems: Problems where the goal or solution is recognizable--where there is a right answer (ex. a math or physics problem) vs. problems where there is no "right" answer but a range of more or less acceptable answers. Knowledge rich vs. knowledge lean problems: problems whose solution depends on specialized knowledge. Insight vs. non-insight problems--those solved "all of a sudden" vs. those solved more incrementally--in a step by step fashion.

Contents of Memory Does the contents of memory influence how easy a problem is? Knowledge rich problems Require domain knowledge to answer, physics problems Knowledge lean problems Can use a general problem solving method to solve, don’t need a lot of domain knowledge

Some Problem Examples Tower of Hanoi Weighing problem Traveling salesman (100 cities = 100! or 10200 or each electron, 109 operations per sec. would take 1011 years!!) but 100,000 cities within 1% in 2 days via heuristic breakup (reduce search!) Missionaries & Cannibals Flashlight: 1, 2, 5, 10 min. walkers to cross bridge 21 link gold necklace/21 day stay Subway Problem Vases (or 3-door)

Early findings Zeigarnik effect, 1927 Participants were given a set of problems to solve On some problems, they were interrupted before they could finish the problem Participants were given a surprise recall test They remembered many more of the interrupted problems than the uninterrupted ones Moss et al. (2007) recent RAT results: open goals

Early Findings: Prob. Solv’ Set Luchins water jug experiment, 1942 Participants were given a series of water jug problems Example: You have three jugs, A holds 21 quarts, B holds 127, C holds 3. Your job is to obtain exactly 100 quarts from a well Solution is B – A – 2C Participants solved a series of these problems all having the same solution

Early Findings: P.S. Set Luchins water jug experiment, 1942 New problem: Given 23, 49, and 3 quart jugs. Goal is to get 20 quarts. Given 28, 76, and 3 quart jugs, obtain 25 quarts Some failed to solve, others took a very long time Mental set People who solved series of problems using one method tended to over apply that method to new similar appearing problems Even when other methods were easier or where the learned method no longer could solve the problem

Prob. A B C Goal 1 21 127 3 100 2 14 163 25 99 3 18 43 10 5 4 9 42 6 21 5 20 59 4 31 6 23 49 3 20 7 15 39 3 18 8 28 76 3 25 9 8 48 4 22 10 14 36 8 6

Early Findings:Functional Fixedness Duncker’s candle problem, 1945 Problem: Find a way to fix a candle to the wall and light it without wax dripping on the floor. Given: Candle, matches, and a bow of thumbtacks Solution: Empty the box, tack it to the wall, place candle on box Have to think of the box as something other than a container People found the problem easier to solve if the box was empty with the tacks given separately

Early Findings:Funct. Fixedness Duncker’s candle problem

Maier’s two-string problem 1930

Functional Fix’dness: Conclusion Functional Fixedness Inability to realize that something familiar for a particular use may also be used for new functions But is this really a bad thing? We learn and generalize from our experience in order to be more efficient in most cases Is it really a good idea to sit around trying to figure out how many potential uses a pair of pliers has? How often do mental sets and functional fixedness save time and computation?

General Problem Characteristics What characteristics do all problems share? Start with an initial situation Want to end up in some kind of goal situation There are ways to transform the current situation into the goal situation Can we have a general theory of problem solving?

General Theory of Problem Solving Newell & Simon proposed a general theory in 1972 in their book Human Problem Solving They studied a number of problem solving tasks Proving logic theorems Chess Cryptarithmetic DONALD D=5 + GERALD ROBERT

General Theory of Problem Solving Verbal Protocols Record people as they think aloud during a problem solving task Computational simulation Write computer programs that simulate how people are doing the task Yields detailed theories of task performance that make specific predictions

General Theory of Problem Solving Problem spaces Initial state Goal state(s) Operators that transform one state into another Initial Goal …………………. o1 o2

An Example Tower of Hanoi Given a puzzle with three pegs and three discs Discs start on Peg 1 as shown below, and your goal is to move them all to peg 3 You can only move one at a time You can never place a larger disc on a smaller disc 1 2 3

Another ex.: Detour Problems Missionaries and cannibals problem Six travelers must cross a river in one boat Only two people can fit in the boat at a time Three of them are missionaries and three are cannibals The number of cannibals on either shore of the river can not exceed the number of missionaries

Problem Space

Operators How do we choose which operators to apply given the current state of the problem? Algorithm Series of steps that guarantee an answer within a certain amount of time Heuristic General rule of thumb that usually leads to a solution

Algorithm Examples Columnar algorithm for addition Add the ones column Carry if necessary Add the next column, etc. People don’t have a simple algorithm for solving most problems 4 6 2 + 2 3 4 8 5

Common Heuristics “Weak Methods” Hill climbing Just use the operator which moves you closer to the goal no matter what What about problems where you have to first move away from the goal in order to get to it (detour problems)? Fractionation and Subgoaling Break the problem into a series or hierarchy of smaller problems

Problem Space: Subgoaling

Heuristics Working Backwards from the goal Works well if there are fewer branches going from the goal to the initial state Only works if you can reverse the operators Ex. Lily Pond Problem

Heuristics Means-ends analysis Always choose an operator that reduces the difference between your current state and the goal state Tests for their applicability of the operator on the current problem state Adopts subgoals if there is no move that will take you to the goal in one step Must have a difference-operator table or its equivalent Tells you what operator(s) to use given the current difference between the state of the problem and the goal. Might have to modify operator if none can be applied in current state

First AI programs Newell & Simon (1956) Logic Theorist (LT) LT completed proofs for a number of logic theorems General Problem Solver (GPS) GPS incorporated means-ends analysis, capable of solving a number of problems Planning problems Cryptarithmetic Logic proofs

Centrality of Representation Problem space and representation Problem difficulty and representation The interaction of representation and processing limitations (problem isomorphs)

Representation: Example Number scrabble 1 2 3 4 5 6 7 8 9

Limitations of GPS What about problems where there is no explicit test for a goal state? Well-defined problems have a clearly defined goal state Ill-defined problems don’t have a clearly defined goal state

Examples of ill-defined problems Engineering Design Architecture Painting Sculpture How to run a business? A number of other creative or difficult tasks that people engage in

Limits of AI? Can AI programs be applied to ill-defined problems? Engineering Design (ex. A-Design, Campbell, Cagan, Kotovsky) AARON Program created by Harold Cohen Produces paintings using a number of heuristics and general conceptions of aesthtics

Art by AARON

What makes problems hard? Large problem spaces are usually harder to search than small ones Compare playing tic-tac-toe to chess What factors from our architecture of mind play a role in determining how hard a problem is? Memory constraints Memory contents Types of mental representations we use

Memory constraints Work on isomorphs of the Tower of Hanoi (Kotovsky, Hayes & Simon, 1985) An isomorph of a problem is one in which the structure of the problem space is the same but the appearance of the problem is different Remember the Tower of Hanoi? 1 2 3

Isomorphs Hayes & Simon, 1977, Kotovsky, Hayes, & Simon, 1985

Isomorphs Hayes & Simon, 1977, Kotovsky, Hayes, & Simon, 1985

Isomorph Difficulty (Kotovsky, Hayes & Simon, 1985)

Results of Isomorphs Adapted from Kotovsky, Hayes, & Simon, 1985

Memory constraints In the original Tower of Hanoi and in the condition with monster models there was an external memory aid Change problems are harder than move problems Takes more processing to assess whether a change is valid than it does for a move Spatial proximity of the information Working with unchanging discs (stable representation) vs. changing discs

Computational Model (From Kushmerick & Kotovsky, 1993) Tested understanding via a computer model that was: Goal driven, subgoaling, limited memory capable of perfect behavior except for limited working memory To see if we were in right “ballpark” To separate actions of various mechanisms to see which had the most control/influence To be able to experiment with the separate postulated mechanisms

Model-Human Agreement

Chinese Ring Puzzle From Kotovsky & Simon, 1990

Two-Phase Problem Solving: Exploratory & Final Path

Non-conscious problem-solving From Reber & Kotovsky, 1997

Strategy acquisition can be unconscious--

Expertise Hayes on ten year rule (Also encoded as 10,000 hours of practice)

Expertise: What’s being Learned in the Ten Years? DeGroot and Chase & Simon’s work on chunking and chess Estimates of knowledge base size Ericsson: idea of deliberate practice

Practice Makes Perfect! Power law of practice: Ta = cPb + d

Expertise Physics (Simon et al., 1980) Chess (Chase & Simon, 1973) Physics experts approach physics problems differently than do novices Chess (Chase & Simon, 1973) Given a mid-game chessboard, grandmasters can reconstruct it almost perfectly after studying it for only 5 seconds Novices can only place 3-5 pieces correctly after the same amount of study However, if the pieces are randomly placed on the board, novices and experts perform at the same level

Knowledge in Chess Why do experts and novices perform differently? Experts have more knowledge and experience But the organization of this knowledge is crucial Experts can chunk the chess board into meaningful units that are already in memory Novices have no such chunking mechanism Random placement of pieces eliminates this chunking from an expert’s performance

Other Characteristics of Experts Working forward (physics experts) (Chi et al.) Deliberate Practice (Ericcsson et al.) McComb, Cagan & Kotovsky)

Best/Worst Bridge Design: McComb, Cagan & Kotovsky, 2014

Mental Representations Insight problems Insight is a seemingly sudden understanding of a problem or strategy that aids in solving the problem Sometimes require a change in mental representation before the problem can be solved

Mutilated Checkerboard Place dominoes on the mutilated checkerboard until it is entirely covered Taken from Kaplan & Simon, 1990

Mutilated Checkerboard Subjects had difficulty solving this problem Average of 38 minutes Requires parity to be part of the representation Taken from Kaplan & Simon, 1990

Learning in Problem Solving Can knowledge learned on one problem be transferred to another problem? Sometimes, if people notice a similarity between the source and target problems How do people map knowledge from a source problem to a target problem Analogy

Analogy & Transfer Classic example (Gick & Holyoak, 1983, Based on Dunker) Army problem Cancer problem Mapping between the two leads to a solution for the cancer problem

Conclusions Problem solving is an everyday activity We can use findings from problem solving to further our understanding of the mind and its processes We can use our knowledge of the mind’s structure and operation to understand elements of problem solving Different types of problems and different contributions to problem difficulty