Data classification based on tolerant rough set reporter: yanan yean.

Slides:



Advertisements
Similar presentations
© Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems Introduction.
Advertisements

Relevant characteristics extraction from semantically unstructured data PhD title : Data mining in unstructured data Daniel I. MORARIU, MSc PhD Supervisor:
ACAT05 May , 2005 DESY, Zeuthen, Germany Search for the Higgs boson at LHC by using Genetic Algorithms Mostafa MJAHED Ecole Royale de l’Air, Mathematics.
Adaptive Resonance Theory (ART) networks perform completely unsupervised learning. Their competitive learning algorithm is similar to the first (unsupervised)
Huge Raw Data Cleaning Data Condensation Dimensionality Reduction Data Wrapping/ Description Machine Learning Classification Clustering Rule Generation.
August 2005RSFDGrC 2005, Regina, Canada 1 Feature Selection Based on Relative Attribute Dependency: An Experimental Study Jianchao Han 1, Ricardo Sanchez.
Basic Data Mining Techniques
Artificial Intelligence Genetic Algorithms and Applications of Genetic Algorithms in Compilers Prasad A. Kulkarni.
Basic concepts of Data Mining, Clustering and Genetic Algorithms Tsai-Yang Jea Department of Computer Science and Engineering SUNY at Buffalo.
1 MACHINE LEARNING TECHNIQUES IN IMAGE PROCESSING By Kaan Tariman M.S. in Computer Science CSCI 8810 Course Project.
Genetic Art. Network Record Using Network Information Chicago Evanston ParisMoscow.
Unsupervised Rough Set Classification Using GAs Reporter: Yanan Yean.
On the Application of Artificial Intelligence Techniques to the Quality Improvement of Industrial Processes P. Georgilakis N. Hatziargyriou Schneider ElectricNational.
1 PSO-based Motion Fuzzy Controller Design for Mobile Robots Master : Juing-Shian Chiou Student : Yu-Chia Hu( 胡育嘉 ) PPT : 100% 製作 International Journal.
Attention Deficit Hyperactivity Disorder (ADHD) Student Classification Using Genetic Algorithm and Artificial Neural Network S. Yenaeng 1, S. Saelee 2.
CHAPTER 12 ADVANCED INTELLIGENT SYSTEMS © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang.
Approximating the Algebraic Solution of Systems of Interval Linear Equations with Use of Neural Networks Nguyen Hoang Viet Michal Kleiber Institute of.
Genetic Algorithm.
A Genetic Algorithms Approach to Feature Subset Selection Problem by Hasan Doğu TAŞKIRAN CS 550 – Machine Learning Workshop Department of Computer Engineering.
Genetic Algorithms and Ant Colony Optimisation
A Simple Method to Extract Fuzzy Rules by Measure of Fuzziness Jieh-Ren Chang Nai-Jian Wang.
GENETIC ALGORITHMS AND GENETIC PROGRAMMING Ehsan Khoddam Mohammadi.
Slides are based on Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems.
Cristian Urs and Ben Riveira. Introduction The article we chose focuses on improving the performance of Genetic Algorithms by: Use of predictive models.
SOFT COMPUTING (Optimization Techniques using GA) Dr. N.Uma Maheswari Professor/CSE PSNA CET.
An Introduction to Artificial Intelligence and Knowledge Engineering N. Kasabov, Foundations of Neural Networks, Fuzzy Systems, and Knowledge Engineering,
Hierarchical Distributed Genetic Algorithm for Image Segmentation Hanchuan Peng, Fuhui Long*, Zheru Chi, and Wanshi Siu {fhlong, phc,
Chapter 8 The k-Means Algorithm and Genetic Algorithm.
Boltzmann Machine (BM) (§6.4) Hopfield model + hidden nodes + simulated annealing BM Architecture –a set of visible nodes: nodes can be accessed from outside.
3. Rough set extensions  In the rough set literature, several extensions have been developed that attempt to handle better the uncertainty present in.
Data Mining Knowledge on rough set theory SUSHIL KUMAR SAHU.
ART – Artificial Reasoning Toolkit Evolving a complex system Marco Lamieri
1 Computing in High Energy and Nuclear Physics, February 2006, Mumbai, India.
Neural and Evolutionary Computing - Lecture 9 1 Evolutionary Neural Networks Design  Motivation  Evolutionary training  Evolutionary design of the architecture.
A Hybrid Genetic Algorithm for the Periodic Vehicle Routing Problem with Time Windows Michel Toulouse 1,2 Teodor Gabriel Crainic 2 Phuong Nguyen 2 1 Oklahoma.
Smooth Side-Match Classified Vector Quantizer with Variable Block Size IEEE Transaction on image processing, VOL. 10, NO. 5, MAY 2001 Department of Applied.
© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 12-1 Chapter 12 Advanced Intelligent Systems.
1 Genetic Algorithms and Ant Colony Optimisation.
Genetic Algorithms Przemyslaw Pawluk CSE 6111 Advanced Algorithm Design and Analysis
Kanpur Genetic Algorithms Laboratory IIT Kanpur 25, July 2006 (11:00 AM) Multi-Objective Dynamic Optimization using Evolutionary Algorithms by Udaya Bhaskara.
Chapter 9 Genetic Algorithms.  Based upon biological evolution  Generate successor hypothesis based upon repeated mutations  Acts as a randomized parallel.
Protein motif extraction with neuro-fuzzy optimization Bill C. H. Chang and Author : Bill C. H. Chang and Saman K. Halgamuge Saman K. Halgamuge Adviser.
 Based on observed functioning of human brain.  (Artificial Neural Networks (ANN)  Our view of neural networks is very simplistic.  We view a neural.
Genetic Algorithms Genetic algorithms provide an approach to learning that is based loosely on simulated evolution. Hypotheses are often described by bit.
1 An Anti-Spam filter based on Adaptive Neural Networks Alexandru Catalin Cosoi Researcher / BitDefender AntiSpam Laboratory
Chapter 12 FUSION OF FUZZY SYSTEM AND GENETIC ALGORITHMS Chi-Yuan Yeh.
1 Danny Hillis and Co-evolution Between Hosts and Parasites I 590 4/11/2005 Pu-Wen(Bruce) Chang.
GENETIC PROGRAMMING. THE CHALLENGE "How can computers learn to solve problems without being explicitly programmed? In other words, how can computers be.
Learning Classifier Systems (Introduction) Muhammad Iqbal Evolutionary Computation Research Group School of Engineering and Computer Science Victoria University.
Improving Support Vector Machine through Parameter Optimized Rujiang Bai, Junhua Liao Shandong University of Technology Library Zibo , China { brj,
A Genetic Algorithm-Based Approach to Content-Based Image Retrieval Bo-Yen Wang( 王博彥 )
Neural Networks And Its Applications By Dr. Surya Chitra.
Application of the GA-PSO with the Fuzzy controller to the robot soccer Department of Electrical Engineering, Southern Taiwan University, Tainan, R.O.C.

1 Using Graph Theory to Analyze Gene Network Coherence José A. Lagares Jesús S. Aguilar Norberto Díaz-Díaz Francisco A. Gómez-Vela
A field of study that encompasses computational techniques for performing tasks that require intelligence when performed by humans. Simulation of human.
Melody Characterization by a Fuzzy Rule System Pedro J. Ponce de León, David Rizo, José M. Iñesta (DLSI, Univ. Alicante) Rafael Ramírez (MTG, Univ. Pompeu.
A Presentation on Adaptive Neuro-Fuzzy Inference System using Particle Swarm Optimization and it’s Application By Sumanta Kundu (En.R.No.
Evolutionary Design of the Closed Loop Control on the Basis of NN-ANARX Model Using Genetic Algoritm.
March 1, 2016Introduction to Artificial Intelligence Lecture 11: Machine Evolution 1 Let’s look at… Machine Evolution.
 Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems n Introduction.
Evolutionary Computation Evolving Neural Network Topologies.
Introduction to Soft Computing
Chapter 12 Advanced Intelligent Systems
An Improved Neural Network Algorithm for Classifying the Transmission Line Faults Slavko Vasilic Dr Mladen Kezunovic Texas A&M University.
Introduction to Artificial Intelligence Lecture 11: Machine Evolution
MACHINE LEARNING TECHNIQUES IN IMAGE PROCESSING
MACHINE LEARNING TECHNIQUES IN IMAGE PROCESSING
Lecture 4. Niching and Speciation (1)
Genetic Algorithm Soft Computing: use of inexact t solution to compute hard task problems. Soft computing tolerant of imprecision, uncertainty, partial.
Presentation transcript:

Data classification based on tolerant rough set reporter: yanan yean

Abstract Similarity measure between two data is described by a distance function of all constituent attributes. Optimal similarity threshold value –GA Two-stage classification method –Lower approximation –Rough membership functions obtained from the upper approximation BPNN,OFUNN,FCM

Outline Introduction Tolerant rough set Determination of similarity thresholds Data classification based on the tolerant rough set Simulation results and discussion conclusion

Carpenter and Grossberg –Fuzzy adaptive resonance theory (ART) Lin and Lee –A general neural-network model for fuzzy logic control and decision systems Simpson –A fuzzy min-max classification neural network Banzan et al. –Multi-modal logics for automatic feature extraction –Rough-set-based induct reasoning for discovering optimal feature set. Nguyen et al. –The tolerance relation among the objects for pattern classification. 1.Introduction

2.Tolerant rough set Some objects have an indiscernibility relation I from each other with the given attributes. A tolerance relation that satisfies only the reflexive and symmetric property.

A tolerance set Define a similarity measure that quantifies the closeness between attribute values of objects. –t(a) is a similarity threshold value We can relate the tolerance relation with the similarity measure as

One of the most important tasks in the data classification using the similarity measure defined above is the optimal determination of the similarity threshold Apply the GA to solve this optimization problem

3.Determination of similarity thresholds 3-1. Chromosome representation –The Inputs: the information table –The similarity measure –The output: a set of optimal similarity threshold values –An object is represented by n attributes –The chromosome for the GA consists of n+1 consecutive real numbers of the similarity thresholds –t(A) : the similarity threshold that defines the tolerance relation when all attributes A are considered together.

3-2. Initial population generation The initial gene values in the chromosome are obtained by generating n+1 real-valued random numbers in the interval of [0.5,1.0]

3-3.Fitness function If,then we can say that there is a connection between two objects x and y. When two objects are tolerant and contained in the same class, they have good connection.

Some objects that are tolerant of each other are included in the same class as many as possible. A quality of approximation of classification that express the ratio of all classified objects to all objects. A set of objects contained in the same class The tolerance set of an object x whose all elements in TS(x) is contained in the same class d i

A quality of approximation of classification that express the ratio of all classified objects to all objects. ; the size of tolerant sets ;similarity thresholds The ratio of good connection –Express a ration of good connections to all possible connections as

;the size of tolerant sets ;the similarity thresholds The fitness function F in order to balance two coefficients The first term makes some tolerant objects to be contained in the same class The second term makes the objects in the same class to be tolerant.

3-4. Genetic operations Reproduction –First selection method : F –Second selection method: a modified k- tournament method. F, k chromosomes selected from the upper class of fitness values randomly is chosen => reproduction –Choromosomes : C 1.C 2 =>C c+m

Crossover –(C 1,t 1 (a i ),F 1 ) (C 2,t 2 (a i ),F 2 ) –The new chromosome C c created by the chromosome operation is computed by an average weighted by fitness value as Mutation

4.Data classification based on the tolerant rough set We define a rough membership function u di (x) –Express the degree of inclusion of the sample x in the decision class d i as 1st stage: Classification using the lower approximation set –A tolerant set of a test sample x, 2nd stage: Classification using the upper approximation set

5.Simulation results and discussion