***Classification Model*** Hosam Al-Samarraie, PhD. CITM-USM

Download Weka Click download And run it and follow The steps for installation. Just next, next, etc….

Pre-processing the data Data can be imported from a file in various formats: ARFF, CSV, binary Data can also be read from a URL or from SQL databases using JDBC Pre-processing tools in WEKA are called “ filters ” WEKA contains filters for: – Discretization, normalization, resampling, attribute selection, attribute combination, … 3

Building classification models “ Classifiers ” in WEKA are models for predicting nominal or numeric quantities Implemented schemes include: – Decision trees and lists, instance-based classifiers, support vector machines, multi-layer perceptrons, logistic regression, Bayes ’ nets, … “ Meta ” -classifiers include: – Bagging, boosting, stacking, error-correcting output codes, data cleansing, … 4

Start window Use to open the csv format and to convert to arff Use to open deploy Classification and prediction Use to compare different Classifiers

Explore window Insert the file 3. Similar to 2 but with more details about the performance 2. Use to select The attribute that Predict classes.

Select file Open the file Select the file File attributes Visual representation

Classify.. 1. After loading the file I select classify 2. in this window, I click on “Choose” To select the classifier for my data. 3. The common used one is J48 classifier, select and it will close automatically

Start Make sure cross Validation is ticked Click start To run the Classification 1 2

Result This is the percentage of the correct classification. >50 consider ok. This is the roc for Measuring the performance >60 consider ok.. This is the precision Of the classification For each class.. Usually similar to roc. This is the confusion Matrix just another indictor For the performance of Classification

Right click on The result file. Select visualize Tree… 5 6

Oval refers To the predictors Meaning that we have 3 predictors. 7

Attribute Selection Now we investigate which subset of attributes produces the best cross-validated classification accuracy for the algorithm we used on the dataset.

Identify the search method 1 2

Start 1 2

Interpretation of the output M, SD, SE of the selected attributes Percentage of correctly classified instance Precision Recall ROC Confusion matrix

In case… You still have the time to decide which classifier to use (algorithm). Since there are differences in the classifier’s accuracies, then it is recommended to compare between different classifiers.

Compare classifiers 1

1 2 3

4 5

V indicate significant relation

Thank you.