A Simple Method to Extract Fuzzy Rules by Measure of Fuzziness Jieh-Ren Chang Nai-Jian Wang.

Slides:



Advertisements
Similar presentations
Patient information extraction in digitized X-ray imagery Hsien-Huang P. Wu Department of Electrical Engineering, National Yunlin University of Science.
Advertisements

Applications of one-class classification
Associative Learning Memories -SOLAR_A
ECG Signal processing (2)
DECISION TREES. Decision trees  One possible representation for hypotheses.
Huffman code and ID3 Prof. Sin-Min Lee Department of Computer Science.
Fuzzy Sets and Applications Introduction Introduction Fuzzy Sets and Operations Fuzzy Sets and Operations.
Farnoush Banaei-Kashani and Cyrus Shahabi Criticality-based Analysis and Design of Unstructured P2P Networks as “ Complex Systems ” Mohammad Al-Rifai.
WRSTA, 13 August, 2006 Rough Sets in Hybrid Intelligent Systems For Breast Cancer Detection By Aboul Ella Hassanien Cairo University, Faculty of Computer.
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley.
Prénom Nom Document Analysis: Linear Discrimination Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
Data classification based on tolerant rough set reporter: yanan yean.
Prénom Nom Document Analysis: Data Analysis and Clustering Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
Classification for High Dimensional Problems Using Bayesian Neural Networks and Dirichlet Diffusion Trees Radford M. Neal and Jianguo Zhang the winners.
Chapter 6: Multilayer Neural Networks
Pattern Recognition. Introduction. Definitions.. Recognition process. Recognition process relates input signal to the stored concepts about the object.
© Prentice Hall1 DATA MINING Introductory and Advanced Topics Part II Margaret H. Dunham Department of Computer Science and Engineering Southern Methodist.
Results Comparison with existing approaches on benchmark datasets Evaluation on a uveal melanoma datasetEvaluation on the two-spiral dataset Evaluation.
On the Application of Artificial Intelligence Techniques to the Quality Improvement of Industrial Processes P. Georgilakis N. Hatziargyriou Schneider ElectricNational.
Foundation of High-Dimensional Data Visualization
Attention Deficit Hyperactivity Disorder (ADHD) Student Classification Using Genetic Algorithm and Artificial Neural Network S. Yenaeng 1, S. Saelee 2.
Digital Camera and Computer Vision Laboratory Department of Computer Science and Information Engineering National Taiwan University, Taipei, Taiwan, R.O.C.
Load Balancing in Distributed Computing Systems Using Fuzzy Expert Systems Author Dept. Comput. Eng., Alexandria Inst. of Technol. Content Type Conferences.
Presented by Tienwei Tsai July, 2005
Slides are based on Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems.
An Introduction to Artificial Intelligence and Knowledge Engineering N. Kasabov, Foundations of Neural Networks, Fuzzy Systems, and Knowledge Engineering,
© Negnevitsky, Pearson Education, Will neural network work for my problem? Will neural network work for my problem? Character recognition neural.
Introduction to Data Mining Group Members: Karim C. El-Khazen Pascal Suria Lin Gui Philsou Lee Xiaoting Niu.
Ranking Queries on Uncertain Data: A Probabilistic Threshold Approach Wenjie Zhang, Xuemin Lin The University of New South Wales & NICTA Ming Hua,
Data Mining Chapter 1 Introduction -- Basic Data Mining Tasks -- Related Concepts -- Data Mining Techniques.
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley.
Avoiding Segmentation in Multi-digit Numeral String Recognition by Combining Single and Two-digit Classifiers Trained without Negative Examples Dan Ciresan.
Generalized Fuzzy Clustering Model with Fuzzy C-Means Hong Jiang Computer Science and Engineering, University of South Carolina, Columbia, SC 29208, US.
3. Rough set extensions  In the rough set literature, several extensions have been developed that attempt to handle better the uncertainty present in.
Expert Systems with Applications 34 (2008) 459–468 Multi-level fuzzy mining with multiple minimum supports Yeong-Chyi Lee, Tzung-Pei Hong, Tien-Chin Wang.
Pattern Discovery of Fuzzy Time Series for Financial Prediction -IEEE Transaction of Knowledge and Data Engineering Presented by Hong Yancheng For COMP630P,
Map of the Great Divide Basin, Wyoming, created using a neural network and used to find likely fossil beds See:
Fuzzy Systems Michael J. Watts
PATTERN RECOGNITION : CLUSTERING AND CLASSIFICATION Richard Brereton
MACHINE LEARNING 10 Decision Trees. Motivation  Parametric Estimation  Assume model for class probability or regression  Estimate parameters from all.
Protein motif extraction with neuro-fuzzy optimization Bill C. H. Chang and Author : Bill C. H. Chang and Saman K. Halgamuge Saman K. Halgamuge Adviser.
Feature selection with Neural Networks Dmitrij Lagutin, T Variable Selection for Regression
1Ellen L. Walker Category Recognition Associating information extracted from images with categories (classes) of objects Requires prior knowledge about.
AUTOMATIC TARGET RECOGNITION AND DATA FUSION March 9 th, 2004 Bala Lakshminarayanan.
DATA MINING WITH CLUSTERING AND CLASSIFICATION Spring 2007, SJSU Benjamin Lam.
Fuzzy Inference Systems
MULTI-INTERVAL DISCRETIZATION OF CONTINUOUS VALUED ATTRIBUTES FOR CLASSIFICATION LEARNING KIRANKUMAR K. TAMBALKAR.
2008/9/15fuzzy set theory chap01.ppt1 Introduction to Fuzzy Set Theory.
OPERATING SYSTEMS CS 3530 Summer 2014 Systems and Models Chapter 03.
An Introduction Student Name: Riaz Ahmad Program: MSIT( ) Subject: Data warehouse & Data Mining.
Using decision trees to build an a framework for multivariate time- series classification 1 Present By Xiayi Kuang.
1 Lecture 4 The Fuzzy Controller design. 2 By a fuzzy logic controller (FLC) we mean a control law that is described by a knowledge-based system consisting.
1 Statistics & R, TiP, 2011/12 Multivariate Methods  Multivariate data  Data display  Principal component analysis Unsupervised learning technique 
Introduction to Classifiers Fujinaga. Bayes (optimal) Classifier (1) A priori probabilities: and Decision rule: given and decide if and probability of.
Pattern Recognition. What is Pattern Recognition? Pattern recognition is a sub-topic of machine learning. PR is the science that concerns the description.
SUPERVISED AND UNSUPERVISED LEARNING Presentation by Ege Saygıner CENG 784.
Network Management Lecture 13. MACHINE LEARNING TECHNIQUES 2 Dr. Atiq Ahmed Université de Balouchistan.
A Presentation on Adaptive Neuro-Fuzzy Inference System using Particle Swarm Optimization and it’s Application By Sumanta Kundu (En.R.No.
 Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems n Introduction.
Machine Learning Reading: Chapter Classification Learning Input: a set of attributes and values Output: discrete valued function Learning a continuous.
Fuzzy Systems Michael J. Watts
Erich Smith Coleman Platt
Artificial Intelligence and Adaptive Systems
Classifiers Fujinaga.
Principal Component Analysis and Linear Discriminant Analysis
An Introduction to Supervised Learning
Classifiers Fujinaga.
A task of induction to find patterns
NON-NEGATIVE COMPONENT PARTS OF SOUND FOR CLASSIFICATION Yong-Choon Cho, Seungjin Choi, Sung-Yang Bang Wen-Yi Chu Department of Computer Science &
Presentation transcript:

A Simple Method to Extract Fuzzy Rules by Measure of Fuzziness Jieh-Ren Chang Nai-Jian Wang

Abstract Use a variable fuzzy-neural network structure to implement the fuzzy rules system. First, we extract fuzzy rules from different class region which was named as activation hyper-box. Second, when the activation hyper-boxes are overlapped, a recursive process are applied to additive activation hyper-box in these uncertainty- overlap regions. Third, the stop criterion for the recursive process -- by measure of fuzziness.

Relation between activation hyper-boxes and overlap regions by 2-dimensional example

Contents : Motivation. Introduction. Measure of fuzziness for a fuzzy set. Measure of fuzziness of a fuzzy rule in a fuzzy system. Fuzzy-neural network. Learning algorithm. Compare our method with other methods. Conclusions.

Motivation To extract more efficiently fuzzy rules from numerical information data in classification problem. To save computation cost To get available rules and cancel redundant rules

Introduction Human can always collect the knowledge to discriminate the uncertainty or ambiguous data by their experience. But computer still can’t be dealt perfectly in classification problem. So, many methods are still proposed to improve the performance of classification problem.

The methods of classification problem are divided into four groups: 1) Statistical method: It is not practical in solving classification problem in a real world. 2) Neural network: It is a system that is constructed to make use of some organizational principles like human brain. It is good for many application.

3)Fuzzy inference engine: By querying experts’ experience or other techniques directly from training data to build fuzzy rule database. 4)Hybrid neural-fuzzy technique: It combines the fuzzy inference and neural network theory to computer-based pattern recognition.

Hong and Lee, proposed a method based on the fuzzy clustering technique to setup the decision tables. But they need to determine the scaling it usually takes more computation time.

Hong and Chen, they propose the other method to decrease the computation time, but it still generates many rules and take very much computation process, when the training data increase.

Wu and Chen have a fuzzy learning algorithm base on theα-cut, can induce the fuzzy rule and reaches a higher average classification ratio. But we don ’ t know how to select the α- cut. P.K. Simpson setup the fuzzy rules by an expansion-contraction, it usually generated too many hyper-box that mean too many rules to be concerned.

S. Abe and M-S. Lan extract the fuzzy rules by resolving overlaps, it can decrease the learning process. But there some drawback in following points: 1)It needs more computation time to resolve overlaps when the data include many classes. 2)It can’t be resolved in some critical condition. 3)It generate many meaningless fuzzy rules as the data are chaos.

Our propose is to decrease the computation time and to extract more efficient fuzzy rule, the method is described in the following steps: 1)Find the activation hyper-box. 2)Find uncertainty overlap. 3)Extracts fuzzy rules. 4)Construct an easy and efficient neural network by measure of fuzziness.

Measure of Fuzziness of a Fuzzy Set To measure uncertainty of vagueness.

Measure of fuzziness is a function ƒ, the function ƒ satisfies the following axioms: Axiom 1 : ƒ (A)=0 if only if A is a crisp set. Axiom 2 : If A B, then ƒ (A) ƒ (B). Where A B denotes that A is shaper than B. Axiom 3 : ƒ (A) assumes the maximum value if and only if A is maximally fuzzy

Degree of fuzziness of fuzzy set

Normalized measure of fuzziness

Measure of Fuzziness of a Fuzzy Rule in a Fuzzy System In this section, we define a classification system by a sequence of multi-input-single-output fuzzy rules as follows n is the number of attribute of the classification system c is the number of class of the system A i,k is the linguistic label, i=1,2,…n,

R k can be rewrote by the T-norm operator with min operation in the following: The membership value of this rule R k represented as:

We can define the measure of fuzziness of the rule R k in the fuzzy rule system as:

According to the formula (3) We can decide the rule R k is worth to exist in this rule-based system or not necessary. If the rule have high measure of fuzziness of a rule, it means too much uncertain for this rule.

A Fuzzy-Neural Network Structure

A variable structure We will leave the rule which is very efficient and useful, so the number of nodes in the second layer are variable. We will reduce the cost, because the redundant second layer nodes are eliminated.

Second layer includes two Sub layer the first sub layer is configured by the hyper- box nodes which are created from our proposed algorithm the second sub-layer is a maximum-operation node, which takes the maximum values of inputs from the first sub-layer.

Learning Process Step1: set level = 1. Step2: Set up the hyper-boxes and membership function for each class. Step3: Find the overlap among the activation hyper-boxes of level l,then l=l+1.

Step4:Extract activation hyper-boxes and set up feature as in step 1. Step5:Calculate the measure of fuzziness for each extracted fuzzy rule. If it is bigger than threshold, we discard this rule. Step6:If none of hyper-box exist in Step 4, then stop the process, else go to Step 2. Step7:Build up the fuzzy-neural network structure by these extracted fuzzy rules

Performance Evaluation We use Fisher’s iris data, there are three kinds of flowers, four kinds of attributes. Three flowers: Setosa Versicolor Verginica Four attributes: Sepal length Sepal width Petal length Petal width

Original Iris Data

Pseudo-Iris data Sepal length Sepal width Petal length Petal width Setosa4.4~5.82.9~4.41.0~1.90.1~0.6 Versicolor5.0~7.02.0~3.43.0~5.11.0~1.8 Verginica4.9~7.72.5~3.84.8~6.91.4~2.5 單位: cm Randomly generated area

Conclusions By this proposed method, we can find more efficient fuzzy rules. It generates fewer fuzzy rules than other methods [9][10][11][14]. It avoids a huge matrix computation [9] so its computation time decreases. It provides a simple recursive process and stopping criteria to extract the fuzzy rules in the uncertainty- overlap region. Thus, the network structure is simple and easy to implement. The classifier can be generated even for a large scale of data pattern.