Linguistic summaries on relational databases Miroslav Hudec University of Economics in Bratislava, Department of Applied Informatics FSTA, 2014
Relational knowledge from a data set Most of municipalities with high altitude have small pollution? Validity of rule If then rules: if population density is high then waste production is high?
Linguistic summary - introduction Q is a linguistic quantifier, X ={x} is a universe of disclosure and P(x) is a predicate depicting summariser S Qx(Px) Q entities in database are (have) S Truth value of summaries called validity and gets values from the [0, 1] interval
Linguistic summary - elementary Q entities in database are (have) S where n is the cardinality of database (number of entities), is the proportion of objects in a database that satisfy P(x), µ q is quantifier
Linguistic summary - extended Q R objects in database are (have) S the proportion of R objects in a database that satisfy S, t is a t- norm, µ q is quantifier.
Linguistic summary - graph Q R objects in database are (have) S
Issues
Summarizer Let D min and D max be the lowest and the highest domain values of attribute A i.e. Dom(A) = [D min, D max ] and L and H be the lowest and the highest values in the current content of a database respectively. In practice, [L, H] [D min, D max ]. This fact should be considered in linguistic summaries.
Family of summarizer The uniform domain covering method (Tudorie, 2008)
Quantifier For a regular non-decreasing quantifier (e.g. most) its membership function should meet the following property: Quantifier most might be given as (Kacprzyk and Zadrożny 2009)
Example Linguistic summary (rule)Validity Most municipalities having high population density have high production of waste 0,662 Most municipalities having medium population density have medium production of wa 0 Most municipalities having small population density have small production of waste 1 if population density is small then production of waste is small with cf = 1; if population density is high then production of waste is high with cf = Rules
Family of quantifiers Uniform domain covering method on the [0, 1] interval,,,,,
Comparison of quantifiers
Optimization of summaries 1.Decision maker creates particular linguistic summary or sentence of interest and evaluate its validity 2.Automatic generation of relevant linguistic summaries (Liu, 2011). is a set of relevant quantifiers, is a set of relevant linguistic expressions, is a set defining subpopulation of interest and β is the threshold value from the {0, 1] interval. Each solution produces a linguistic summary Q* R * are S*.
Optimization of summaries {(small, small), (small, medium), (medium, medium), (high, high)}
Fuzzy functional dependencies and linguistic summaries
Queries by summaries Data on lower hierarchical level are basis for summaries but only data on higher level are revealed ranked downward from the best to the worst. Select regions where most of municipalities has small attitude above sea level where n is number of entities in whole database, N i is number of entities in cluster i (municipalities in region i), R is number of clusters in database (regions), µ p (x ji ) is matching degree of j-th entity in i-th cluster. Advantages: 1.Sensitive or data that are not free of charge remain hidden 2.Policy maker… is interested in general overview not in data
Example Select regions where most of municipalities has small attitude above sea level Region Validity of the summary Bratislava 1 Trnava 1 Nitra 1 Trenčín Košice Banská Bystrica Žilina 0 Prešov 0
Conclusion The work demonstrates how we can start with a simple linguistic summary and build more complex summaries by merging knowledge from several fields: mining parameters for functions of summarizers from data and extending to defining parameters of quantifiers, optimization of summaries, fuzzy queries. Although fuzzy set theory has been already established as an adequate framework to deal with linguistic summaries, there is still space for improvements.
Some topics for further research Linguistic summaries on fuzzy databases, Operations research task for optimisation the process of rules generation Full applications for practitioners Fuzzy functional dependencies and linguistic summaries in data mining
Thank you for your attention