3. Rough set extensions  In the rough set literature, several extensions have been developed that attempt to handle better the uncertainty present in.

Slides:



Advertisements
Similar presentations
Protein Secondary Structure Prediction Using BLAST and Relaxed Threshold Rule Induction from Coverings Leong Lee Missouri University of Science and Technology,
Advertisements

School of something FACULTY OF OTHER School of Computing FACULTY OF ENGINEERING Formalising a basic hydro-ontology David Mallenby Knowledge Representation.
Sequential Three-way Decision with Probabilistic Rough Sets Supervisor: Dr. Yiyu Yao Speaker: Xiaofei Deng 18th Aug, 2011.
Mustafa Cayci INFS 795 An Evaluation on Feature Selection for Text Clustering.
Ch2 Data Preprocessing part3 Dr. Bernard Chen Ph.D. University of Central Arkansas Fall 2009.
Fuzzy sets II Prof. Dr. Jaroslav Ramík Fuzzy sets II.
_ Rough Sets. Basic Concepts of Rough Sets _ Information/Decision Systems (Tables) _ Indiscernibility _ Set Approximation _ Reducts and Core _ Rough Membership.
Feature Grouping-Based Fuzzy-Rough Feature Selection Richard Jensen Neil Mac Parthaláin Chris Cornelis.
Affinity Set and Its Applications Moussa Larbani and Yuh-Wen Chen.
Rulebase Expert System and Uncertainty. Rule-based ES Rules as a knowledge representation technique Type of rules :- relation, recommendation, directive,
Multiple Criteria Decision Analysis with Game-theoretic Rough Sets Nouman Azam and JingTao Yao Department of Computer Science University of Regina CANADA.
Fuzzy Sets and Applications Introduction Introduction Fuzzy Sets and Operations Fuzzy Sets and Operations.
Automatic Histogram Threshold Using Fuzzy Measures 呂惠琪.
Bayesian Decision Theory
AI TECHNIQUES Fuzzy Logic (Fuzzy System). Fuzzy Logic : An Idea.
Fuzzy Sets and Fuzzy Logic Theory and Applications
Huge Raw Data Cleaning Data Condensation Dimensionality Reduction Data Wrapping/ Description Machine Learning Classification Clustering Rule Generation.
Rough Set Strategies to Data with Missing Attribute Values Jerzy W. Grzymala-Busse Department of Electrical Engineering and Computer Science University.
ผศ. ดร. สุพจน์ นิตย์ สุวัฒน์ ตอนที่ interval, 2. the fundamental concept of fuzzy number, 3. operation of fuzzy numbers. 4. special kind of fuzzy.
Rough Sets Theory Speaker:Kun Hsiang.
Support Vector Machine
ECIV 201 Computational Methods for Civil Engineers Richard P. Ray, Ph.D., P.E. Error Analysis.
_ Rough Sets. Basic Concepts of Rough Sets _ Information/Decision Systems (Tables) _ Indiscernibility _ Set Approximation _ Reducts and Core.
Data classification based on tolerant rough set reporter: yanan yean.
Mining Hierarchical Decision Rules from Hybrid Data with Categorical and Continuous Valued Attributes Miao Duoqian, Qian Jin, Li Wen, Zhang Zehua.
August 2005RSFDGrC 2005, Regina, Canada 1 Feature Selection Based on Relative Attribute Dependency: An Experimental Study Jianchao Han 1, Ricardo Sanchez.
1 Chapter 2 Imprecise Categories, Approximations and Rough Sets #6 ChenKuang(Andy) Yang.
Uncertainty Measure and Reduction in Intuitionistic Fuzzy Covering Approximation Space Feng Tao Mi Ju-Sheng.
1 Chapter 18 Fuzzy Reasoning. 2 Chapter 18 Contents (1) l Bivalent and Multivalent Logics l Linguistic Variables l Fuzzy Sets l Membership Functions l.
COMP 578 Fuzzy Sets in Data Mining Keith C.C. Chan Department of Computing The Hong Kong Polytechnic University.
1 Seventh Lecture Error Analysis Instrumentation and Product Testing.
Unsupervised Rough Set Classification Using GAs Reporter: Yanan Yean.
ROUGH SET THEORY AND FUZZY LOGIC BASED WAREHOUSING OF HETEROGENEOUS CLINICAL DATABASES Yiwen Fan.
Rule-Based Fuzzy Model. In rule-based fuzzy systems, the relationships between variables are represented by means of fuzzy if–then rules of the following.
Fuzzy Logic Jan Jantzen Logic is based on set theory, and when we switch to fuzzy sets it will have an effect on.
Fuzzy Sets Introduction/Overview Material for these slides obtained from: Modern Information Retrieval by Ricardo Baeza-Yates and Berthier Ribeiro-Neto.
A Simple Method to Extract Fuzzy Rules by Measure of Fuzziness Jieh-Ren Chang Nai-Jian Wang.
On Applications of Rough Sets theory to Knowledge Discovery Frida Coaquira UNIVERSITY OF PUERTO RICO MAYAGÜEZ CAMPUS
Fuzzy-rough data mining Richard Jensen Advanced Reasoning Group University of Aberystwyth
Statistical Decision Theory
Slides are based on Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems.
CSE & CSE6002E - Soft Computing Winter Semester, 2011 More Rough Sets.
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
Classifying Attributes with Game- theoretic Rough Sets Nouman Azam and JingTao Yao Department of Computer Science University of Regina CANADA S4S 0A2
Fuzzy Logic. WHAT IS FUZZY LOGIC? Definition of fuzzy Fuzzy – “not clear, distinct, or precise; blurred” Definition of fuzzy logic A form of knowledge.
Data Reduction. 1.Overview 2.The Curse of Dimensionality 3.Data Sampling 4.Binning and Reduction of Cardinality.
Richard Jensen, Andrew Tuson and Qiang Shen Qiang Shen Aberystwyth University, UK Richard Jensen Aberystwyth University, UK Andrew Tuson City University,
Practical Considerations When t , the supp, then there will be a value of t when supp folds, it becomes multi-w-to-one-x mapping.
Logical Systems and Knowledge Representation Fuzzy Logical Systems 1.
Lógica difusa  Bayesian updating and certainty theory are techniques for handling the uncertainty that arises, or is assumed to arise, from statistical.
A Logic of Partially Satisfied Constraints Nic Wilson Cork Constraint Computation Centre Computer Science, UCC.
FUZZY LOGIC INFORMATION RETRIEVAL MODEL Ferddie Quiroz Canlas, ME-CoE.
Discriminative Frequent Pattern Analysis for Effective Classification By Hong Cheng, Xifeng Yan, Jiawei Han, Chih- Wei Hsu Presented by Mary Biddle.
Data Mining By Farzana Forhad CS 157B. Agenda Decision Tree and ID3 Rough Set Theory Clustering.
1 Pattern Recognition: Statistical and Neural Lonnie C. Ludeman Lecture 28 Nov 9, 2005 Nanjing University of Science & Technology.
Copyright © Cengage Learning. All rights reserved. 15 Distribution-Free Procedures.
Fuzzy Logic Artificial Intelligence Chapter 9. Outline Crisp Logic Fuzzy Logic Fuzzy Logic Applications Conclusion “traditional logic”: {true,false}
Richard Jensen and Chris Cornelis Chris Cornelis Chris Cornelis Ghent University, Belgium Richard Jensen Richard Jensen Aberystwyth University, UK Fuzzy-Rough.
Fuzzy Relations( 關係 ), Fuzzy Graphs( 圖 形 ), and Fuzzy Arithmetic( 運算 ) Chapter 4.
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
 Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems n Introduction.
Rough Sets, Their Extensions and Applications 1.Introduction  Rough set theory offers one of the most distinct and recent approaches for dealing with.
More Rough Sets.
Course : T0423-Current Popular IT III
Fuzzy Expert Systems (part 1) By: H.Nematzadeh
Fuzzy Expert Systems (part 1) By: H.Nematzadeh
Fuzzy Logic and Fuzzy Sets
Rough Sets.
Dependencies in Structures of Decision Tables
Rough Sets (Theoretical Aspects of Reasoning about Data)
Presentation transcript:

3. Rough set extensions  In the rough set literature, several extensions have been developed that attempt to handle better the uncertainty present in real world data.  Variable precision rough set is generalized model of rough sets, allowing a controlled degree of misclassification by relaxing the subset operator.  Fuzzy rough sets and tolerance rough sets handle real-valued data by replacing the traditional equivalence classes of crisp rough set theory with alternatives that are better suited to dealing with this type of data. 3.1 Variable precision rough sets  Variable precision rough sets (VPRS) attempts to improve upon rough set theory by relaxing the subset operator. It was proposed to analyze and identify data patterns which represent statistical trends rather than functional. 1ISA Lab., CU, Korea

 The main idea of VPRS is to allow objects to be classified with an error smaller than a certain predefined level.  This approach is arguably easiest to be understood within the framework of classification. Let X, Y  U, the relative classification error is defined by  Observe that c(X, Y)=0 if and only if X  Y. A degree of inclusion can be achieved by allowing a certain level of error, , in classification:  Using   instead of , the  -upper and  -lower approximations of a set X can be defined as  Note that for  =0. 2

ISA Lab., CU, Korea3  The positive, negative and boundary regions in the original rough set theory can now be extended to  In the example dataset in Table 1, (15) can be used to calculate the  -positive region for R={b, c}, X={e} and  =0.4. U/R={{2}, {0, 4}, {3}, {1,6,7}, {5}} U/X={{0}, {1, 3, 6}, {2, 4, 5, 7}}  For each set A  U/R and B  U/X, the value of c(A,B) must be less than  if the equivalence class A is to be included in the  -positive region. Considering A={2} gives c({2}, {0})=1>  c({2}, {1, 3, 6})=1>  c({2}, {2, 4, 5, 7})=0< 

ISA Lab., CU, Korea4  So object 2 is added to the  -positive region as it is a  -subset of {2, 4, 5, 7}  Taking A={1, 6, 7}, a more interesting case is encountered: c({1, 6, 7}, {0})=1>  c({1, 6, 7}, {1, 3, 6})=0.3333<  c({1, 6, 7}, {2, 4, 5, 7})=0.6667>  Here the objects 1, 6 and 7 included in the  -positive region as the set {1, 6, 7} is a  -subset of {1, 3, 6}.  Calculating the subsets in this way leads to the following  -positive region:  Compare this with the positive region generated previously: {2, 3, 5}. Objects 1, 6 and 7 are now included due to the relaxation of the subset operator.  Consider a decision table (U, C  D), where C is the set of conditional attributes and D is the set of decision attributes. The  -positive region of an equivalence relation Q on U may be determined by

ISA Lab., CU, Korea5 where R is also an equivalence relation on U. This can then be used to calculate dependencies and thus determine  -reducts. This dependency function become 3.2 Tolerance rough sets  Another way of attempting to handle imprecision is to introduce a measure of similarity of attribute values and define the lower and upper approximations based on these similarity measures Similarity measures In this approach, suitable similarity relations must be defined for each attribute, although the same definition can be used for all attributes if applicable. A standard measure for this purpose is where a is the attribute under consideration, and a max and a min denote the maximum and minimum values respectively for this attribute.

ISA Lab., CU, Korea6 When considering more than one attribute, the defined similarities must be combined to provide a measure of the overall similarity of objects. For a subset of attributes, P, this can be achieved in many ways; two commonly adopted approaches are where  is a global similarity threshold. From this, the so-called tolerance classes that are generated by a given similarity relation for an object x are defined as

ISA Lab., CU, Korea Approximations and dependency Lower and upper approximations are then defined in a similar way to traditional rough set theory: The tuple is called a tolerance rough set. Positive region and dependency functions then become

ISA Lab., CU, Korea8 3.3 Fuzzy-rough sets Main approaches In the same way that crisp equivalence classes are central to rough sets, fuzzy equivalence classes are central to the fuzzy-rough set approach. The concept of crisp equivalence classes can be extended by the inclusion of a fuzzy similarity relation S on the universe, which determines the extent to which two elements are similar in S. The usual properties of reflexivity (  S (X, Y)=1), symmetry (  S (x, y)=  S (y, x)) and transitivity (  S (x, z)  S (x, y)  S (y, z), where  is a t-norm) hold. Using such a fuzzy similarity relation S, the fuzzy equivalence class [x] S for the objects close to x can be defined: [Def. 3.1] Suppose FS=(U, A, V, f) is a knowledge representation system, and I is defined as an equivalence relation on U, while FX is a fuzzy set on U, P  A, FX  U, then a pair of the lower approximation and the upper approximation of the knowledge representation system FS about FX is described, respectively, as

ISA Lab., CU, Korea9 Where  FX (x) is the membership degree that x belongs to FX, and the upper approximation and the lower approximation of the fuzzy set are still fuzzy sets. Could be understood as the membership degree that the object definitely belongs to the fuzzy set FX, while could be understood as the membership degree that the object possibly belongs to the fuzzy set. [Ex. 5.1] Suppose U={n 1, n 2, n 3, n 4, n 5, n 6, n 7, n 8 } is a group consisted of eight students studied. They are divided into three equivalent classes, denoted by U/I={N, M}, U/I={{n 1, n 6 }, {n 2, n 7, n 8 }, {n 3, n 4, n 5 }}. Suppose the fuzzy set FX expresses the fuzzy concept “height,” and its membership function is  FX (X)={n 1 /0.6, n 2 /0.4, n 3 /0.4, n 4 /0.7, n 5 /0.6, n 6 /0.8, n 7 /1, n 8 /0.9}, calculates the upper approximation, the lower approximation, and the classification accuracy of the rough fuzzy set FX. [Solution]

ISA Lab., CU, Korea10 [Def. 5.2] FS=(U, R) is a fuzzy approximation space, Where U is a nonempty universe, and R is an approximate relation on U, x  U, y  U, P  A, FX  U, the input class F 1, F 2, …, F n is a fuzzy cluster originated from a fuzzy equivalence relation, and n is the number of the cluster. Every F i is a fuzzy equivalent class. Thus, a pair of the upper approximation and the lower approximation of the fuzzy rough set FX on U is Obviously, when the equivalence relation is clear, a fuzzy rough set will degrade into a rough fuzzy set. When all fuzzy equivalence relations are clear, it will further degrade into a classical rough set.