1. CS 682, AI:Case-Based Reasoning, Prof. Cindy Marling1 Chapter 2: Case Studies of Several Case-Based Reasoners This chapter describes some classic CBR systems that illustrate different ways in which CBR can be used One of the best known CBR systems is the planning system CHEF CHEF generates plans for cooking, that is, recipes It was built by Chris Hammond, in the AI Lab, at Yale We will use CHEF to illustrate the flow of reasoning in CBR

2. CS 682, AI:Case-Based Reasoning, Prof. Cindy Marling 2

3. 3 CHEF In a CBR system, the input describes the problem you want to solve or the situation you want to interpret Sample Input for CHEF: Request for stir-fry beef and broccoli recipe Next we need to assign indexes Indexes are features of the new problem that characterize it and that are relevant to finding similar problems in the case base Indexes for CHEF example: Stir-fry-dish Contains-beef Contains-broccoli

4. CS 682, AI:Case-Based Reasoning, Prof. Cindy Marling 4

5. 5 CHEF, continued The input and indexes are used to retrieve a similar past case The past case contains the prior solution Matching rules are used to find the most similar, or most useful, case CHEF wants a recipe for stir fry beef and broccoli. It retrieves: Recipe for Stir-Fry Beef and Green Beans

6. CS 682, AI:Case-Based Reasoning, Prof. Cindy Marling6 CHEF, continued The next step is to adapt the old solution so that it will meet all of the goals of the present problem CHEF has a rule that tells it one vegetable can be substituted for another in a recipe It also has rules to account for differences in ingredients. For example, broccoli needs to be chopped and cooks for less time than green beans Recipe for Stir-Fry Beef and Green Beans Cook time X Recipe for Stir-Fry Beef and Broccoli Cook time Y Step: Chop broccoli

7. CS 682, AI:Case-Based Reasoning, Prof. Cindy Marling 7

8. 8 CHEF, continued The next step is to test out the new plan or solution to see if it is satisfactory CHEF uses a simulator that checks a recipe against known criteria for good stir-fry cooking CHEF’s evaluation for this example: Failure: The broccoli is soggy When a failure is detected, it needs to be explained, so that the system will learn from it and not make the same mistake again CHEF’s simulator knows that the broccoli is soggy because it sat too long in the meat juices Explanation: meat juices to blame

9. CS 682, AI:Case-Based Reasoning, Prof. Cindy Marling 9

10. 10 CHEF, continued The causal analysis guides the repair of the plan Repair strategies are stored and indexed based on the types of problems known to occur CHEF’s strategy for soggy broccoli is called SPLIT-AND-REFORM It repairs the recipe by adding in steps to stir fry the broccoli separately and then mix it in Recipe for Stir-Fry Beef and Broccoli Cook time Y Step: Chop broccoli Step: Stir-fry broccoli in separate pan Step: Mix broccoli in with other ingredients

11. CS 682, AI:Case-Based Reasoning, Prof. Cindy Marling11 CHEF, continued Now CHEF has a good recipe to store in the case base To avoid the soggy vegetable problem in the future, CHEF indexes this recipe by Stir-fry-recipe Contains-beef Contains-broccoli Avoids soggy vegetable problem CHEF improves its performance by checking for this problem in the future A CBR system learns by acquiring new cases A CBR system learns by anticipating and avoiding failure

12. CS 682, AI:Case-Based Reasoning, Prof. Cindy Marling 12

13. CS 682, AI:Case-Based Reasoning, Prof. Cindy Marling13 CASEY CASEY diagnoses cardiac disease based on the diagnoses of earlier patients It was built by Phyllis Koton, at MIT The features, or indexes, for a patient are measures and states Measures are clinical data, like heart rate States can be qualitative measurements, like high left arterial pressure, or the presence of a disease, like pericarditis, or therapies given, like nitroglycerin To support a diagnosis, CASEY builds a causal explanation, in the form of a graph, showing links between measures and states to indicate causality

14. CS 682, AI:Case-Based Reasoning, Prof. Cindy Marling14 CASEY, continued CASEY compares two cases by determining what the differences are and whether or not they are significant An old case may have a feature that the new case does not have If it was not used in the diagnosis, then it is irrelevant whether or not the new case has it If the feature was used in the diagnosis, then CASEY looks to see if the new case has another feature that would cause the same states as the missing feature. If so, the match is still good. If all differences are irrelevant or can be “fixed up,” the cases are considered to be similar, and the diagnosis is made The diagnosis is adapted to to the new patient by substituting the new causal relations and the new patient’s data

15. CS 682, AI:Case-Based Reasoning, Prof. Cindy Marling15 CASEY, continued CASEY was built on top of the Heart Failure Program, a model based system that was considered to be accurate, but slow Whenver CASEY could not find a similar enough case in its case base to make a diagnosis, it invoked the Heart Failure Program CASEY obtained initial cases for its case base by running this system CASEY also took knowledge about which features were and were not significant from this system CASEY’s diagnoses were found to match those of the Heart Failure Program most of the time, but it operated one to two orders of magnitude faster Efficiency was CASEY’s original claim to fame, but it has since been recognized for integrating reasoning modes and for illustrating CBR’s usefulness in medical domains

16. CS 682, AI:Case-Based Reasoning, Prof. Cindy Marling16 JULIA JULIA is a CBR design system It designs menus for dinner parties, serving in the role of a virtual caterer It was built by Tom Hinrichs, at Georgia Tech The inputs to JULIA are the constraints that any satisfactory menu must meet Example: (host tom) (guests jlks-research-group) (cost cheap-meal) (ease-of-prep easy) (ingredients (tomato cheese))

17. CS 682, AI:Case-Based Reasoning, Prof. Cindy Marling17 JULIA, continued JULIA checks its case base for matching menus and interactively asks questions to try to narrow down to a good menu In our example, JULIA asks “Would you like lasagne, garlic bread and red wine? The user may agree, but if the user disagrees, JULIA will look for more menu choices in the case base The user may also add new constraints at any time, much as they would in interacting with a human caterer JULIA uses both cases (specific dinner party menus) and prototypes (outlines of menus) It also integrates CBR with constraint problem solving, another AI approach applicable to the menu planning process

18. CS 682, AI:Case-Based Reasoning, Prof. Cindy Marling18 HYPO HYPO is an example of interpretive CBR, rather than problem solving CBR It was built by Kevin Ashley, at U Mass Amherst HYPO’s task is argumentation for legal reasoning in the domain of trade secrets law Trade secrets law cases typically involve employees of one company giving or selling proprietary information to another company, giving that company a competitive advantage Trade secrets law cases are decided in courts of law based on precedents found in previous cases HYPO works by inputting a current case and finding “most-on-point” cases to it from a case base of around 30 real trade secrets cases Cases are most-on-point if they share the most features in common

19. CS 682, AI:Case-Based Reasoning, Prof. Cindy Marling19 HYPO, continued The features used in HYPO were those determined by legal scholars to be important in deciding trade secrets cases Example features: Had the accused employee signed a nondisclosure agreement Had the accused company bribed employees to switch employment or to give them secrets Had the plaintiff company already disclosed the secrets to others Had the accused employee given the plaintiff’s notes, diagrams, or tools to the accused company HYPO retrieves cases that have both desired and undesired outcomes It suggests hypothetical ways of strengthening a case by locating additional information that would be helpful in getting a positive ruling Lawyers then argue their cases based on the precedents HYPO provides

20. CS 682, AI:Case-Based Reasoning, Prof. Cindy Marling20 PROTOS PROTOS is a CBR classifier It was built by Ray Bareiss It uses classification to diagnose an audiological patient as having one of a number of known audiological disorders PROTOS contains approximately 200 cases and 15 different disorders It was built by having an expert audiologist classify real audiological patients To classify a new case, PROTOS uses reminding links to suggest a potential classification It compares the new case to the cases in that classification first If it finds a close match, it extends that classification to the new case If not, it uses difference links and censor links to suggest a new classification to try

21. CS 682, AI:Case-Based Reasoning, Prof. Cindy Marling21 PROTOS, continued There are other AI approaches to classification that are easier to use when they are applicable These include neural networks and decision trees Automated classification techniques did not work well in PROTOS’s domain because of the nature of the data There were 58 different features a patient could have, but on average, a given patient only had values recorded for 11 of these Neural networks and decision tree techniques do not deal well with this much missing data

22. CS 682, AI:Case-Based Reasoning, Prof. Cindy Marling22 CLAVIER CLAVIER is a design system that was fielded at Lockheed by D. Hennessy and D. Hinkle It was the first CBR system to be used on a factory shop floor (1990) CLAVIER determines how to best load an autoclave, a large, pressurized, convection oven Lockheed manufactures parts for aerospace applications One critical step is to cure these parts in an autoclave Lockheed engineers do not fully understand the properties of the autoclave and believe them to be too complex to define using equations or rules Before CLAVIER, shop floor operators worked from sample oven configurations They tried to fit the parts that were ordered into configurations known to produce good results

23. CS 682, AI:Case-Based Reasoning, Prof. Cindy Marling23 CLAVIER’s Oven Configurations

24. CS 682, AI:Case-Based Reasoning, Prof. Cindy Marling24 CLAVIER, continued CLAVIER began by using 20 of these manual configurations as cases It input a prioritized list of ordered parts and looked for the best matching configuration If multiple configurations could be used, the best match was the configuration that used the highest number of high priority parts If no configuration could be completely filled out, the best match was the one with the fewest missing parts Initially, Hennessy and Hinkle tried to adapt incomplete configurations by including parts similar to the missing ones This worked OK from a research perspective, but every mistake was very expensive Lockheed engineers decided to just cure the missing (unordered) parts and save them against future orders

25. CS 682, AI:Case-Based Reasoning, Prof. Cindy Marling25 CLAVIER, continued CLAVIER became more successful as it acquired cases over time Each new successful configuration was added to the case base until there were 150 cases At this point, they could find an exact match 90% of the time It grew close to becoming a table lookup system Advantages of CLAVIER were: It used CBR outside the research lab It captured load configuration expertise, which could be used by non-expert employees It provided working solutions even though engineers didn’t understand the problem well enough to derive solutions from first principles

26. CS 682, AI:Case-Based Reasoning, Prof. Cindy Marling26 Other CBR Systems Not all CBR systems implement all phases of the CBR flow chart or work in exactly the same way One important twist is that CBR is useful for advisory and/or educational systems These systems are typically less automated than the ones we’ve discussed so far Often, just retrieving past examples for a user can help a person to identify and/or solve a problem on their own A typical application is the CBR help desk, which works by storing cases of reported problems that the help desk operators have already solved. Since different users report the same problems over and over, good solutions often already exist that can be recalled.