1 Introduction to Artificial Intelligence MSc WS 2009 Organisation + Introduction: Chapter 1

2 Introduction to Artificial Intelligence Overview Course home page: be replaced with course homepage (schedule, lecture notes, exercises, etc). Textbook: S. Russell and P. Norvig Artificial Intelligence: A Modern Approach Prentice Hall, 2003, Second Edition Lecturer: Dieter Fensel Tutors: Tutors here Each week: lecture – tutorials organization come here Attendance of the tutorials is obligatory ! Miss at most 2 times with written excuse ("was such nice weather" doesn't count!)‏ Grades: Lecture: final exam determines your grade Tutorials: Proper presentation of the reports and active interaction your grade. Reports should be submitted before the tutorial (more Details in the tutorials)‏ …Questions?

3 Introduction to Artificial Intelligence Overview 1Introduction 2Propositional Logic 3Predicate Logic 4Model checking and theorem proving (vampire) 5Search methods 6CommonKADS 7Problem-Solving Methods 8Planning 9Agents 10Rule learning 11Inductive Logic Programming 12Formal Concept Analysis 13Neural networks 14Semantic Web and Exam Preparation

4 Introduction to Artificial Intelligence What is AI ? Views of AI fall into four categories: Thinking humanlyThinking rationally Acting humanlyActing rationally The textbook advocates "acting rationally"

5 Introduction to Artificial Intelligence Acting humanly: Turing Test Turing (1950) "Computing machinery and intelligence": "Can machines think?"  "Can machines behave intelligently?" Operational test for intelligent behavior: the Imitation Game Predicted that by 2000, a machine might have a 30% chance of fooling a lay person for 5 minutes Anticipated all major arguments against AI in following 50 years Suggested major components of AI: knowledge, reasoning, language understanding, learning

6 Introduction to Artificial Intelligence Thinking humanly: cognitive modeling 1960s "cognitive revolution": information-processing psychology Requires scientific theories of internal activities of the brain How to validate? Requires 1.Predicting and testing behavior of human subjects (top-down) or 2.Direct identification from neurological data (bottom-up)‏ Both approaches (roughly, Cognitive Science and Cognitive Neuroscience) are now distinct from AI

7 Introduction to Artificial Intelligence Thinking rationally: "laws of thought" Aristotle( BC)‏ What are correct arguments/thought processes? Several Greek schools developed various forms of logic: notation and rules of derivation for thoughts; may or may not have proceeded to the idea of mechanization Direct line through mathematics and philosophy to modern AI Problems: 1.Not all intelligent behavior is mediated by purely logical deliberation 2.What is the purpose of thinking? What thoughts should I have?

8 Introduction to Artificial Intelligence Acting rationally: rational agent Rational behavior: doing the "right" thing The right thing: that which is expected to maximize goal achievement, given the available information. Doesn't necessarily involve thinking – e.g., blinking reflex – but thinking should be in the service of rational action "hard-code" solution algorithm"Reflex" Declarative Problem Solving"Thinking"

9 Introduction to Artificial Intelligence Rational agents An agent is an entity that perceives and acts This course is in some sense about designing rational agents Abstractly, an agent is a function from percept histories to actions: [f: P*  A ] For any given class of environments and tasks, we seek the agent (or class of agents) with the best performance BUT: computational limitations make perfect rationality unachievable  design best program for given machine resources.

10 Introduction to Artificial Intelligence What is AI for John McCarthy? Q. What is artificial intelligence? A. It is the science and engineering of making intelligent machines, especially intelligent computer programs. It is related to the similar task of using computers to understand human intelligence, but AI does not have to confine itself to methods that are biologically observable. Q. Yes, but what is intelligence? A. Intelligence is the computational part of the ability to achieve goals in the world. Varying kinds and degrees of intelligence occur in people, many animals and some machines.....[

11 Introduction to Artificial Intelligence What is AI for Marvin Minsky? “ Artificial Intelligence is the science of making machines do things that require intelligent if done by men." Minsky and John McCarthy co-founded the MIT Artificial Intelligence Laboratory in 1961

12 Introduction to Artificial Intelligence What is AI?

13 Introduction to Artificial Intelligence Types of AI Symbolic AI : Symbolic AI is based in logic. It uses sequences of rules to tell the computer what to do next. Expert systems consist of many so-called IF-THEN rules: IF this is the case, THEN do that. Since both sides of the rule can be defined in complex ways, rule-based programs can be very powerful. Connectionist AI : Connectionism is inspired by the brain. It is closely related to computational neuroscience, which models actual brain cells and neural circuits. Connectionist AI uses artificial neural networks made of many units working in parallel. Each unit is connected to its neighbours by links that can raise or lower the likelihood that the neighbour unit will fire (excitatory and inhibitory connections respectively). Neural networks that are able to learn do so by changing the strengths of these links, depending on past experience. These simple units are much less complex than real neurons. Each can do only one thing: for instance, report a tiny vertical line at a particular place in an image. What matters is not what any individual unit is doing, but the overall activity- pattern of the whole network.brain neural networks Evolutionary AI : Evolutionary AI draws on biology. Its programs make random changes in their own rules, and select the best daughter programs to breed the next generation. This method develops problem-solving programs, and can evolve the “brains” and “eyes” of robots. It is often used in modelling artificial life (A-Life). A-Life studies self-organization: how order arises from something that is ordered to a lesser degree. Biological examples include the flocking patterns of birds and the development of embryos.

14 Introduction to Artificial Intelligence Branches of AI (John McCarthy) Logical AI: What a program knows about the world in general the facts of the specific situation in which it must act, and its goals are all represented by sentences of some mathematical logical language. The program decides what to do by inferring that certain actions are appropriate for achieving its goals. Search: AI programs often examine large numbers of possibilities, e.g. moves in a chess game or inferences by a theorem proving program. Discoveries are continually made about how to do this more efficiently in various domains. Pattern recognition When a program makes observations of some kind, it is often programmed to compare what it sees with a pattern. For example, a vision program may try to match a pattern of eyes and a nose in a scene in order to find a face. More complex patterns, e.g. in a natural language text, in a chess position, or in the history of some event are also studied. These more complex patterns require quite different methods than do the simple patterns that have been studied the most.

15 Introduction to Artificial Intelligence Branches of AI (John McCarthy) Representation: Facts about the world have to be represented in some way. Usually languages of mathematical logic are used. Inference: From some facts, others can be inferred. Mathematical logical deduction is adequate for some purposes, but new methods of non- monotonic inference have been added to logic since the 1970s. The simplest kind of non-monotonic reasoning is default reasoning in which a conclusion is to be inferred by default, but the conclusion can be withdrawn if there is evidence to the contrary. Ordinary logical reasoning is monotonic in that the set of conclusions that can the drawn from a set of premises is a monotonic increasing function of the premises. Common sense knowledge and reasoning: This is the area in which AI is farthest from human-level, in spite of the fact that it has been an active research area since the 1950s. While there has been considerable progress, e.g. in developing systems of non-monotonic reasoning and theories of action, yet more new ideas are needed. The Cyc system contains a large but spotty collection of common sense facts.

16 Introduction to Artificial Intelligence Branches of AI (John McCarthy) Learning from experience: Programs do that. The approaches to AI based on connectionism and neural nets specialize in that. There is also learning of laws expressed in logic. Programs can only learn what facts or behaviors their formalisms can represent, and unfortunately learning systems are almost all based on very limited abilities to represent information. Planning: Planning programs start with general facts about the world (especially facts about the effects of actions), facts about the particular situation and a statement of a goal. From these, they generate a strategy for achieving the goal. In the most common cases, the strategy is just a sequence of actions. Epistemology: This is a study of the kinds of knowledge that are required for solving problems in the world.

17 Introduction to Artificial Intelligence Branches of AI (John McCarthy) Ontology: Ontology is the study of the kinds of things that exist. In AI, the programs and sentences deal with various kinds of objects, and we study what these kinds are and what their basic properties are. Emphasis on ontology begins in the 1990s. Heuristics: A heuristic is a way of trying to discover something or an idea imbedded in a program. The term is used variously in AI. Heuristic functions are used in some approaches to search to measure how far a node in a search tree seems to be from a goal. Heuristic predicates that compare two nodes in a search tree to see if one is better than the other, i.e. constitutes an advance toward the goal, may be more useful. Genetic programming: Genetic programming is a technique for getting programs to solve a task by mating random Lisp programs and selecting fittest in millions of generations.

18 Introduction to Artificial Intelligence AI prehistory PhilosophyLogic, methods of reasoning, mind as physical system foundations of learning, language, rationality MathematicsFormal representation and proof algorithms, computation, (un)decidability, (in)tractability, probability Economicsutility, decision theory Neurosciencephysical substrate for mental activity Psychology phenomena of perception and motor control, experimental techniques Computer building fast computers engineering Control theorydesign systems that maximize an objective function over time Linguisticsknowledge representation, grammar

19 Introduction to Artificial Intelligence Abridged history of AI 1943 McCulloch & Pitts: Boolean circuit model of brain 1950 Turing's "Computing Machinery and Intelligence" 1956Dartmouth meeting: "Artificial Intelligence" adopted 1952—69Look, Ma, no hands! 1950sEarly AI programs, including Samuel's checkers program, Newell & Simon's Logic Theorist, Gelernter's Geometry Engine 1965Robinson's complete algorithm for logical reasoning 1966—73AI discovers computational complexity Neural network research almost disappears 1969—79Early development of knowledge-based systems AI becomes an industry Neural networks return to popularity AI becomes a science The emergence of intelligent agents

20 Introduction to Artificial Intelligence State of the art Deep Blue defeated the reigning world chess champion Garry Kasparov in 1997 ( Automated Reasoning methods proved a mathematical conjecture (Robbins conjecture) unsolved for decades No hands across America (driving autonomously 98% of the time from Pittsburgh to San Diego) Military still the strongest factor for AI research: During the 1991 Gulf War, US forces deployed an AI logistics planning and scheduling program that involved up to 50,000 vehicles, cargo, and people NASA's on-board autonomous planning program controlled the scheduling of operations for a spacecraft Proverb solves crossword puzzles better than most humans

21 Introduction to Artificial Intelligence AI around us ABS uses fuzzy logic ( Group of elevators work together under planning techniques to minimize the time that the users have to wait. ( Video Games like Age of Empire or Commandos use sophisticated AI techniques (neural networks, planning techniques, genetic algorithms, etc.) to increase the difficulty and realism of the game (

22 Introduction to Artificial Intelligence Some AI relevant People Isaac Asimov * ( Arthur C. Clark * ( John McCarthy ( Marvin Minsky ( Donald Michie ( Allen Newell* ( Herbert A. Simon* ( Alan Turing* (