Attention Deficit Hyperactivity Disorder (ADHD) Student Classification Using Genetic Algorithm and Artificial Neural Network S. Yenaeng 1, S. Saelee 2.

Slides:



Advertisements
Similar presentations
Ch. Eick: More on Machine Learning & Neural Networks Different Forms of Learning: –Learning agent receives feedback with respect to its actions (e.g. using.
Advertisements

Principal Component Analysis Based on L1-Norm Maximization Nojun Kwak IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008.
Data Mining Feature Selection. Data reduction: Obtain a reduced representation of the data set that is much smaller in volume but yet produces the same.
1 Statistical Modeling  To develop predictive Models by using sophisticated statistical techniques on large databases.
June 19, Proposal: An overall Plan Design to obtain answer to the research questions or problems Outline the various tasks you plan to undertake.
TEMPLATE DESIGN © Genetic Algorithm and Poker Rule Induction Wendy Wenjie Xu Supervised by Professor David Aldous, UC.
Decision Support Systems
Final Project: Project 9 Part 1: Neural Networks Part 2: Overview of Classifiers Aparna S. Varde April 28, 2005 CS539: Machine Learning Course Instructor:
Supervised classification performance (prediction) assessment Dr. Huiru Zheng Dr. Franscisco Azuaje School of Computing and Mathematics Faculty of Engineering.
Modeling Gene Interactions in Disease CS 686 Bioinformatics.
Experimental Evaluation
General Mining Issues a.j.m.m. (ton) weijters Overfitting Noise and Overfitting Quality of mined models (some figures are based on the ML-introduction.
Chapter 5 Data mining : A Closer Look.
Data Mining Techniques
Kansas State University Department of Computing and Information Sciences CIS 830: Advanced Topics in Artificial Intelligence From Data Mining To Knowledge.
Data Mining Chun-Hung Chou
A Genetic Algorithms Approach to Feature Subset Selection Problem by Hasan Doğu TAŞKIRAN CS 550 – Machine Learning Workshop Department of Computer Engineering.
Mining Feature Importance: Applying Evolutionary Algorithms within a Web- based Educational System CITSA 2004, Orlando, July 2004 Behrouz Minaei-Bidgoli,
Slides are based on Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems.
Using Neural Networks in Database Mining Tino Jimenez CS157B MW 9-10:15 February 19, 2009.
Hurieh Khalajzadeh Mohammad Mansouri Mohammad Teshnehlab
WELCOME. Malay Mitra Lecturer in Computer Science & Application Jalpaiguri Polytechnic West Bengal.
GA-Based Feature Selection and Parameter Optimization for Support Vector Machine Cheng-Lung Huang, Chieh-Jen Wang Expert Systems with Applications, Volume.
GATree: Genetically Evolved Decision Trees 전자전기컴퓨터공학과 데이터베이스 연구실 G 김태종.
Data Mining: Classification & Predication Hosam Al-Samarraie, PhD. Centre for Instructional Technology & Multimedia Universiti Sains Malaysia.
COMPARISON OF IMAGE ANALYSIS FOR THAI HANDWRITTEN CHARACTER RECOGNITION Olarik Surinta, chatklaw Jareanpon Department of Management Information System.
Copyright  2004 McGraw-Hill Pty Ltd. PPTs t/a Marketing Research by Lukas, Hair, Bush and Ortinau 2-1 The Marketing Research Process Chapter Two.
Dr. Chen, Data Mining  A/W & Dr. Chen, Data Mining Chapter 2 Data Mining: A Closer Look Jason C. H. Chen, Ph.D. Professor of MIS School of Business Administration.
An Introduction to Support Vector Machines (M. Law)
Neural and Evolutionary Computing - Lecture 9 1 Evolutionary Neural Networks Design  Motivation  Evolutionary training  Evolutionary design of the architecture.
Handwritten Recognition with Neural Network Chatklaw Jareanpon, Olarik Surinta Mahasarakham University.
A.N.N.C.R.I.P.S The Artificial Neural Networks for Cancer Research in Prediction & Survival A CSI – VESIT PRESENTATION Presented By Karan Kamdar Amit.
Data Mining BY JEMINI ISLAM. Data Mining Outline: What is data mining? Why use data mining? How does data mining work The process of data mining Tools.
ASSESSING LEARNING ALGORITHMS Yılmaz KILIÇASLAN. Assessing the performance of the learning algorithm A learning algorithm is good if it produces hypotheses.
Journal Club Meeting Sept 13, 2010 Tejaswini Narayanan.
Feature selection with Neural Networks Dmitrij Lagutin, T Variable Selection for Regression
Patch Based Prediction Techniques University of Houston By: Paul AMALAMAN From: UH-DMML Lab Director: Dr. Eick.
Learning Classifier Systems (Introduction) Muhammad Iqbal Evolutionary Computation Research Group School of Engineering and Computer Science Victoria University.
Improving Support Vector Machine through Parameter Optimized Rujiang Bai, Junhua Liao Shandong University of Technology Library Zibo , China { brj,
Data Mining and Decision Support
NTU & MSRA Ming-Feng Tsai
WHAT IS DATA MINING?  The process of automatically extracting useful information from large amounts of data.  Uses traditional data analysis techniques.
An Effective Hybridized Classifier for Breast Cancer Diagnosis DISHANT MITTAL, DEV GAURAV & SANJIBAN SEKHAR ROY VIT University, India.
Developing outcome prediction models for acute intracerebral hemorrhage patients: evaluation of a Support Vector Machine based method A. Jakab 1, L. Lánczi.
Novel Approaches to Optimised Self-configuration in High Performance Multiple Experts M.C. Fairhurst and S. Hoque University of Kent UK A.F. R. Rahman.
WHAT IS DATA MINING?  The process of automatically extracting useful information from large amounts of data.  Uses traditional data analysis techniques.
Instance-Based Learning Evgueni Smirnov. Overview Instance-Based Learning Comparison of Eager and Instance-Based Learning Instance Distances for Instance-Based.
Computacion Inteligente Least-Square Methods for System Identification.
An Evolutionary Algorithm for Neural Network Learning using Direct Encoding Paul Batchis Department of Computer Science Rutgers University.
A Presentation on Adaptive Neuro-Fuzzy Inference System using Particle Swarm Optimization and it’s Application By Sumanta Kundu (En.R.No.
 Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems n Introduction.
Business Intelligence and Decision Support Systems (9 th Ed., Prentice Hall) Chapter 6: Artificial Neural Networks for Data Mining.
Big data classification using neural network
Applying Deep Neural Network to Enhance EMPI Searching
Regression Analysis Module 3.
School of Computer Science & Engineering
Bag-of-Visual-Words Based Feature Extraction
Table 1. Advantages and Disadvantages of Traditional DM/ML Methods
Can Computer Algorithms Guess Your Age and Gender?
Predict House Sales Price
Gerd Kortemeyer, William F. Punch
Introduction to Artificial Intelligence and Soft Computing
Predicting Student Performance: An Application of Data Mining Methods with an Educational Web-based System FIE 2003, Boulder, Nov 2003 Behrouz Minaei-Bidgoli,
Behrouz Minaei, William Punch
Discriminative Frequent Pattern Analysis for Effective Classification
Business and Management Research
Somi Jacob and Christian Bach
Using Bayesian Network in the Construction of a Bi-level Multi-classifier. A Case Study Using Intensive Care Unit Patients Data B. Sierra, N. Serrano,
Automatic Handwriting Generation
Presenter: Donovan Orn
Presentation transcript:

Attention Deficit Hyperactivity Disorder (ADHD) Student Classification Using Genetic Algorithm and Artificial Neural Network S. Yenaeng 1, S. Saelee 2 and S. Krootjohn 2 1 Department of Computer Education, Faculty of Education, Bansomdejchaopraya Rajabhat University, Bangkok, Thailand 2 Department of Computer Education, Faculty of Technical Education, King Mongkut’s University of Technology North Bangkok, Bangkok, Thailand

Contents I. PROBLEM STATEMENT II. SOLVE THE PROBLEM III. DATA SET IV. GANN APPROACH TO FEATURE SELECTION V. EXPERIMENTAL DESIGN VI. CONCLUSION

I. PROBLEM STATEMENT  What is Attention deficit hyperactivity disorder (ADHD) ?

I. PROBLEM STATEMENT  What is Attention deficit hyperactivity disorder (ADHD) ? It is a group of neurobehavioral disorders that have a neurobiological basis with strong genetic components.

I. PROBLEM STATEMENT  It impacts multiple areas of brain functions and life activities

I. PROBLEM STATEMENT  Clinical interviews and multiple informants both contribute to a reliable assessment of ADHD

I. PROBLEM STATEMENT  Owing to the complex nonlinear relationship among the main morphological features of ADHD, it is difficult to describe by the traditional linear regression methods.

II. SOLVE THE PROBLEM  Among a great variety of classification Techniques suggested so far for medical diagnosis neural network (NN) has been one of the most popular methods that consistently demonstrated its strengths and potentials in solving practical classification problems

II. SOLVE THE PROBLEM  There exist redundant or useless information in these features. In this case, it is essential to carry out the task of feature selection, a technique commonly used in machine learning for selecting a subset of relevant features for building a robust learning model. Feature selection can discover the optimum feature subset which is rich in relevant information.

III. DATA SET  The sample was drawn from 5 primary schools in the area of Bangkok.  Our teacher rating scale was composed of 30 attributes and was derived from the ADHD: KUS-SI Rating Scales.  ADHD dataset contains 4 classes and 1,000 students, of which 115 cases were ADHD and 885 cases were control.  We divided the dataset into two parts, of which one is the training set (700 samples) is used for training the parameter of NN using a BP algorithm.

III. DATA SET  The testing set (300 samples) is introduced for testing the ability of neural network.  The number of attributes is reduced to 21 attributes using Genetic Search.  The reduced data set is fed to the GANN models. K-fold cross validation method is used as the test mode.

III. DATA SET Table 1: Attributes list and description

IV. GANN APPROACH TO FEATURE SELECTION  The genetic search starts with zero attributes, and an initial population with randomly generated rules.  The process of generation continues until it evolves a population P where every rule in P satisfies the fitness threshold.  Initial population of 20 instances, generation continued till t­he eightieth generation with cross over probability of 0.6 and mutation probability of 0.033

IV. GANN APPROACH TO FEATURE SELECTION  The genetic search resulted in twenty-one attributes out of thirty attributes is show in Table 2 and 3.

IV. GANN APPROACH TO FEATURE SELECTION Figure 1: Overview of the GANN

IV. GANN APPROACH TO FEATURE SELECTION Neural Network as ADHD Classifier  Classification is a supervised learning method to extract models describing important data classes or to predict future trends.  Our work intends to use Artificial Neural Network (NN) to diagnosis the presence of ADHD in students.

IV. GANN APPROACH TO FEATURE SELECTION Neural Network as ADHD Classifier  The learning algorithm of NN is a supervised learning method by training feed forward neural network using error back propagation technique to determine the parameters of neural network.

V. EXPERIMENTAL DESIGN Data and Variables  The sample was drawn from 5 primary schools in the area of Bangkok. Our teacher rating scale was composed of 30 attributes and was derived from the ADHD: KUS-SI Rating Scales.  This ADHD dataset contains 4 classes and 1,000 students, of which 115 cases were ADHD and 885 cases were control.  We divided the dataset into two parts, of which one is the training set (700 samples) is used for training the parameter of NN using a BP algorithm. On the other hand, the testing set (300 samples) is introduced for the purpose of testing the generalization ability of neural network.

V. EXPERIMENTAL DESIGN Experimental results and Performance analysis  Experiments were conducted with Weka tool. Data set of 1,000 records with 30 attributes is used.  We have trained the classifiers to classify the ADHD data set. The general and specific confusion matrix of four classes (Y1, Y2, Y3, and Y4) is show in Table 4 and 5.

V. EXPERIMENTAL DESIGN Experimental results and Performance analysis

V. EXPERIMENTAL DESIGN Experimental results and Performance analysis  As far as the classification performance of the model is concerned, the classification rate (C) denotes the percentage of correctly classified samples, which is computed by the following formula (Huang et al, 2011).

V. EXPERIMENTAL DESIGN  As the results in Tables 6 show that we obtained 21 features selected by our GA approach.  It can be obviously seen that the recognition rate in terms of the right classification percentage has distinctly increased, which is measured by GANN model has the classification accuracy is 81%.  The modeling time using GANN technique is also greatly reduced. Experimental results and performance analysis

VI. CONCLUSION & SUGGESTION  We propose a machine learning technique where NN as classifier is combined with GA approach to classify more accurately the presence of ADHD with reduced number of attributes.  Verify the effectiveness of NN classifier and GANN are adopted in the same experimental conditions to study classification performance of the samples for the testing sets.  The experiment shows that thirty attributes are reduced to 21 attributes using GANN approach while not allowing the accuracy of the classifier to decrease  When classify ADHD student can be taught to children is different from the normal group.