Dr. Matthew Iklé Department of Mathematics and Computer Science Adams State College Probabilistic Quantifier Logic for General Intelligence: An Indefinite.

Slides:



Advertisements
Similar presentations
Artificial Intelligence
Advertisements

Slide 1 of 18 Uncertainty Representation and Reasoning with MEBN/PR-OWL Kathryn Blackmond Laskey Paulo C. G. da Costa The Volgenau School of Information.
CPSC 422, Lecture 11Slide 1 Intelligent Systems (AI-2) Computer Science cpsc422, Lecture 11 Jan, 29, 2014.
ARCHITECTURES FOR ARTIFICIAL INTELLIGENCE SYSTEMS
Semantics Static semantics Dynamic semantics attribute grammars
Naïve Bayes. Bayesian Reasoning Bayesian reasoning provides a probabilistic approach to inference. It is based on the assumption that the quantities of.
Lahore University of Management Sciences, Lahore, Pakistan Dr. M.M. Awais- Computer Science Department 1 Lecture 12 Dealing With Uncertainty Probabilistic.
The Logic of Intelligence Pei Wang Department of Computer and Information Sciences Temple University.
Rulebase Expert System and Uncertainty. Rule-based ES Rules as a knowledge representation technique Type of rules :- relation, recommendation, directive,
Psychology 290 Special Topics Study Course: Advanced Meta-analysis April 7, 2014.
A Brief Introduction to Bayesian Inference Robert Van Dine 1.
Chapter 8: Estimating with Confidence
Chapter 10: Estimating with Confidence
IMPORTANCE SAMPLING ALGORITHM FOR BAYESIAN NETWORKS
Approximate Reasoning 1 Expert Systems Dr. Samy Abu Nasser.
© C. Kemke Approximate Reasoning 1 COMP 4200: Expert Systems Dr. Christel Kemke Department of Computer Science University of Manitoba.
Ai in game programming it university of copenhagen Statistical Learning Methods Marco Loog.
Plan Recognition with Multi- Entity Bayesian Networks Kathryn Blackmond Laskey Department of Systems Engineering and Operations Research George Mason University.
UNIVERSITY OF SOUTH CAROLINA Department of Computer Science and Engineering CSCE 580 Artificial Intelligence Ch.6 [P]: Reasoning Under Uncertainty Section.
PR-OWL: A Framework for Probabilistic Ontologies by Paulo C. G. COSTA, Kathryn B. LASKEY George Mason University presented by Thomas Packer 1PR-OWL.
Introduction  Bayesian methods are becoming very important in the cognitive sciences  Bayesian statistics is a framework for doing inference, in a principled.
Evaluating Hypotheses Chapter 9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics.
© C. Kemke1Reasoning - Introduction COMP 4200: Expert Systems Dr. Christel Kemke Department of Computer Science University of Manitoba.
Chapter 7 Probability. Definition of Probability What is probability? There seems to be no agreement on the answer. There are two broad schools of thought:
Representing Uncertainty CSE 473. © Daniel S. Weld 2 Many Techniques Developed Fuzzy Logic Certainty Factors Non-monotonic logic Probability Only one.
Semantics For the Semantic Web: The Implicit, the Formal and The Powerful Amit Sheth, Cartic Ramakrishnan, Christopher Thomas CS751 Spring 2005 Presenter:
Part III: Inference Topic 6 Sampling and Sampling Distributions
WELCOME TO THE WORLD OF FUZZY SYSTEMS. DEFINITION Fuzzy logic is a superset of conventional (Boolean) logic that has been extended to handle the concept.
Chapter 10: Estimating with Confidence
Chapter One: The Science of Psychology
Jeff Howbert Introduction to Machine Learning Winter Classification Bayesian Classifiers.
FUZZY LOGIC Babu Appat. OVERVIEW What is Fuzzy Logic? Where did it begin? Fuzzy Logic vs. Neural Networks Fuzzy Logic in Control Systems Fuzzy Logic in.
Artificial Intelligence: Definition “... the branch of computer science that is concerned with the automation of intelligent behavior.” (Luger, 2009) “The.
Chapter One: The Science of Psychology. Ways to Acquire Knowledge Tenacity Tenacity Refers to the continued presentation of a particular bit of information.
RDPStatistical Methods in Scientific Research - Lecture 11 Lecture 1 Interpretation of data 1.1 A study in anorexia nervosa 1.2 Testing the difference.
Finding Scientific topics August , Topic Modeling 1.A document as a probabilistic mixture of topics. 2.A topic as a probability distribution.
Geo597 Geostatistics Ch9 Random Function Models.
Formal Models in AGI Research Pei Wang Temple University Philadelphia, USA.
ECE 8443 – Pattern Recognition LECTURE 07: MAXIMUM LIKELIHOOD AND BAYESIAN ESTIMATION Objectives: Class-Conditional Density The Multivariate Case General.
Distributions of the Sample Mean
A Probabilistic Quantifier Fuzzification Mechanism: The Model and Its Evaluation for Information Retrieval Felix Díaz-Hemida, David E. Losada, Alberto.
Probability and Measure September 2, Nonparametric Bayesian Fundamental Problem: Estimating Distribution from a collection of Data E. ( X a distribution-valued.
+ “Statisticians use a confidence interval to describe the amount of uncertainty associated with a sample estimate of a population parameter.”confidence.
Lógica difusa  Bayesian updating and certainty theory are techniques for handling the uncertainty that arises, or is assumed to arise, from statistical.
ARTIFICIAL INTELLIGENCE [INTELLIGENT AGENTS PARADIGM] Professor Janis Grundspenkis Riga Technical University Faculty of Computer Science and Information.
Uncertainty Management in Rule-based Expert Systems
Uncertainty. Assumptions Inherent in Deductive Logic-based Systems All the assertions we wish to make and use are universally true. Observations of the.
Theory and Applications
Sampling distributions rule of thumb…. Some important points about sample distributions… If we obtain a sample that meets the rules of thumb, then…
The famous “sprinkler” example (J. Pearl, Probabilistic Reasoning in Intelligent Systems, 1988)
Artificial Intelligence “Introduction to Formal Logic” Jennifer J. Burg Department of Mathematics and Computer Science.
Business Statistics for Managerial Decision Farideh Dehkordi-Vakil.
International Conference on Fuzzy Systems and Knowledge Discovery, p.p ,July 2011.
SAMPLING DISTRIBUTION OF MEANS & PROPORTIONS. PPSS The situation in a statistical problem is that there is a population of interest, and a quantity or.
MPS/MSc in StatisticsAdaptive & Bayesian - Lect 71 Lecture 7 Bayesian methods: a refresher 7.1 Principles of the Bayesian approach 7.2 The beta distribution.
Ch 8 Estimating with Confidence 8.1: Confidence Intervals.
Kansas State University Department of Computing and Information Sciences CIS 730: Introduction to Artificial Intelligence Lecture 24 of 41 Monday, 18 October.
The Psychologist as Detective, 4e by Smith/Davis © 2007 Pearson Education Chapter One: The Science of Psychology.
Expert System Seyed Hashem Davarpanah University of Science and Culture.
+ The Practice of Statistics, 4 th edition – For AP* STARNES, YATES, MOORE Chapter 8: Estimating with Confidence Section 8.1 Confidence Intervals: The.
Statistical Concepts Basic Principles An Overview of Today’s Class What: Inductive inference on characterizing a population Why : How will doing this allow.
Dealing with Uncertainty: A Survey of Theories and Practice Yiping Li, Jianwen Chen and Ling Feng IEEE Transactions on Knowledge and Data Engineering,
CHAPTER 5 Handling Uncertainty BIC 3337 EXPERT SYSTEM.
Representing Uncertainty
CS 594: Empirical Methods in HCC Introduction to Bayesian Analysis
28th September 2005 Dr Bogdan L. Vrusias
Experiments, Outcomes, Events and Random Variables: A Revisit
Representations & Reasoning Systems (RRS) (2.2)
Generalized Diagnostics with the Non-Axiomatic Reasoning System (NARS)
Habib Ullah qamar Mscs(se)
Presentation transcript:

Dr. Matthew Iklé Department of Mathematics and Computer Science Adams State College Probabilistic Quantifier Logic for General Intelligence: An Indefinite Probabilities Approach

Probabilistic Logic Networks A Probabilistic Logic Inference System: unifies probability and logic key component of the Novamente Cognition Engine, an integrative AGI system BUT independent of Novamente -- designed with ability to be incorporated into other systems

Probabilistic Logic Networks supports the full scope of inferences required within an intelligent system, including e.g. first and higher order logic, intensional and extensional reasoning, and so forth lends itself naturally to methods of inference control that are computationally tractable, and able to make use of the inputs provided by non-logical cognitive mechanisms

Weight of Evidence What is it? Why is it important? E.g. belief revision One approach: weight of ev. = interval width [.2,.8] means less evidence than [.4,.6] Pei Wang’s NARS system Walley’s Imprecise Probabilities Heuristic approaches

primary measure of uncertainty utilized within PLN hybrid of Walley’s Imprecise Probabilities and Bayesian credible intervals provides a natural mechanism for determining weight of evidence PLN’s logical inference rules are associated with indefinite truth value formulas or procedures Prior papers have given indefinite truth value formulas for a number of PLN inference rules, but have not dealt with quantifiers Indefinite Probabilities

Indefinite Probabilities Review truth-value takes the form of a quadruple ([L, U], b, k) There is a probability b that, after k more observations, the truth value assigned to the statement S will lie in the interval [L, U] Given intervals, [Li,Ui], of mean premise probabilities, we first find a distribution from the “second-order distribution family” supported on [L1i,U1i ]so that these means have [L i,Ui] as (100*bi)% credible intervals For each premise, we use Monte-Carlo methods to generate samples for each of the “first-order” distributions with means given by samples of the “second- order” distributions. We then apply the inference rules to the set of premises for each sample point, and calculate the mean of each of these distributions.

Goals: logical and conceptual consistency agreement with standard quantifier logic for the crisp case (for all expressions to which standard quantifier logic assigns truth values) gives intuitively reasonable answers in practical cases compatibility with probability theory in general and PLN in particular handles fuzzy quantifiers as well as standard universal and existential quantifiers comprehensive, conceptually coherent, probabilistically grounded and computationally tractable approach Quantifiers Via Indefinite Probabilities

Quantifiers in Indefinite Probabilities utilize third-order probabilities non-standard semantic approach we assign truth values to expressions with unbound variables, yet without in doing so binding the variables unusual but not contradictory expression with unbound variables, as a mathematical entity, may be mapped into a truth value without introducing any mathematical or conceptual inconsistency approach reduces to the standard crisp approach in terms of truth value assignation for all expressions for which the standard crisp approach assigns a truth value. our approach also assigns truth values to some expressions (formulas standard crisp approach assigns no truth value

Suppose we have an indefinite probability for an expression F(t) with unbound variable t, summarizing an envelope E of probability distributions corresponding to F(t) How do derive from this an indefinite probability for the expression “ForAll x, F(x)”? we consider the envelope E to be part of a higher-level envelope E1, which is an envelope of envelopes given that we have observed E, what is the chance (according to E1) that the true envelope describing the world actually is almost entirely supported within [1-e, 1], where the latter interval is interpreted to constitute “essentially 1” Quantifiers in Indefinite Probabilities: ForAll

For “ThereExists x, F(x),” what is the chance (according to E1) that the true envelope describing the world actually is not entirely supported within [0, e], where the latter interval is interpreted to constitute “essentially zero” Quantifiers in Indefinite Probabilities: ThereExists

By almost entirely (in ForAll case) we mean that the fraction contained is at least proxy_confidence_level (PCL) the interval [PCL, 1] represents the fraction of bottom- level distributions completely contained in the interval [1-e, 1] Quantifiers in Indefinite Probabilities: The proxy_confidence_level parameter

indefinite probabilities provide a natural method for “fuzzy” quantifiers such as AlmostAll and Afew In analogy with the interval [PCL, 1] we introduce the parameters lower_proxy_confidence (LPC) and upper_proxy_confidence (UPC) Letting [LPC, UPC] = [0.9, 0.99], the interval could now naturally represent AlmostAll the same interval could represent AFew by setting LPC to a value such as 0.05 and UPC to, say, 0.1. Quantifiers in Indefinite Probabilities: Fuzzy Quantifiers

incorporating a third level of distributions, as perturbations, into the indefinite probabilities framework allows for extension of indefinite probabilities to handle a sliding scale of fuzzy and crisp quantifiers computationally tractable Summary