Appendix: The WEKA Data Mining Software

Slides:



Advertisements
Similar presentations
Florida International University COP 4770 Introduction of Weka.
Advertisements

Weka & Rapid Miner Tutorial By Chibuike Muoh. WEKA:: Introduction A collection of open source ML algorithms – pre-processing – classifiers – clustering.
Data Mining Practical Machine Learning Tools and Techniques Slides for Chapter 3 of Data Mining by I. H. Witten, E. Frank and M. A. Hall.
Department of Computer Science, University of Waikato, New Zealand Eibe Frank WEKA: A Machine Learning Toolkit The Explorer Classification and Regression.
WEKA (sumber: Machine Learning with WEKA). What is WEKA? Weka is a collection of machine learning algorithms for data mining tasks. Weka contains.
WEKA Evaluation of WEKA Waikato Environment for Knowledge Analysis Presented By: Manoj Wartikar & Sameer Sagade.
Department of Computer Science, University of Waikato, New Zealand Eibe Frank WEKA: A Machine Learning Toolkit The Explorer Classification and Regression.
March 25, 2004Columbia University1 Machine Learning with Weka Lokesh S. Shrestha.
An Extended Introduction to WEKA. Data Mining Process.
1 Statistical Learning Introduction to Weka Michel Galley Artificial Intelligence class November 2, 2006.
Evaluation of Results (classifiers, and beyond) Biplav Srivastava Sources: [Witten&Frank00] Witten, I.H. and Frank, E. Data Mining - Practical Machine.
Machine Learning with WEKA. WEKA: the bird Copyright: Martin Kramer
1 How to use Weka How to use Weka. 2 WEKA: the software Waikato Environment for Knowledge Analysis Collection of state-of-the-art machine learning algorithms.
CSCI 347 / CS 4206: Data Mining Module 05: WEKA Topic 04: Data Preparation Tools.
An Exercise in Machine Learning
CSCI 347 / CS 4206: Data Mining Module 05: WEKA Topic 01: WEKA Navigation.
 The Weka The Weka is an well known bird of New Zealand..  W(aikato) E(nvironment) for K(nowlegde) A(nalysis)  Developed by the University of Waikato.
Contributed by Yizhou Sun 2008 An Introduction to WEKA.
ROOT: A Data Mining Tool from CERN Arun Tripathi and Ravi Kumar 2008 CAS Ratemaking Seminar on Ratemaking 17 March 2008 Cambridge, Massachusetts.
Department of Computer Science, University of Waikato, New Zealand Geoff Holmes WEKA project and team Data Mining process Data format Preprocessing Classification.
Short Introduction to Machine Learning Instructor: Rada Mihalcea.
WEKA - Explorer (sumber: WEKA Explorer user Guide for Version 3-5-5)
WEKA and Machine Learning Algorithms. Algorithm Types Classification (supervised) Given -> A set of classified examples “instances” Produce -> A way of.
In part from: Yizhou Sun 2008 An Introduction to WEKA Explorer.
1 Data preparation: Selection, Preprocessing, and Transformation Literature: Literature: I.H. Witten and E. Frank, Data Mining, chapter 2 and chapter 7.
Weka: a useful tool in data mining and machine learning Team 5 Noha Elsherbiny, Huijun Xiong, and Bhanu Peddi.
Department of Computer Science, University of Waikato, New Zealand Eibe Frank WEKA: A Machine Learning Toolkit The Explorer Classification and Regression.
Constructing Data Mining Applications based on Web Services Composition Ali Shaikh Ali and Omer Rana
Machine Learning with Weka Cornelia Caragea Thanks to Eibe Frank for some of the slides.
Weka: Experimenter and Knowledge Flow interfaces Neil Mac Parthaláin
For ITCS 6265/8265 Fall 2009 TA: Fei Xu UNC Charlotte.
W E K A Waikato Environment for Knowledge Analysis Branko Kavšek MPŠ Jožef StefanNovember 2005.
Artificial Neural Network Building Using WEKA Software
1 1 Slide Using Weka. 2 2 Slide Data Mining Using Weka n What’s Data Mining? We are overwhelmed with data We are overwhelmed with data Data mining is.
Department of Computer Science, University of Waikato, New Zealand Eibe Frank WEKA: A Machine Learning Toolkit The Explorer Classification and Regression.
Chapter 11 Statistical Techniques. Data Warehouse and Data Mining Chapter 11 2 Chapter Objectives  Understand when linear regression is an appropriate.
BOĞAZİÇİ UNIVERSITY DEPARTMENT OF MANAGEMENT INFORMATION SYSTEMS MATLAB AS A DATA MINING ENVIRONMENT.
Weka – A Machine Learning Toolkit October 2, 2008 Keum-Sung Hwang.
Introduction to Weka Xingquan (Hill) Zhu Slides copied from Jeffrey Junfeng Pan (UST)
 A collection of open source ML algorithms ◦ pre-processing ◦ classifiers ◦ clustering ◦ association rule  Created by researchers at the University.
W E K A Waikato Environment for Knowledge Aquisition.
An Exercise in Machine Learning
***Classification Model*** Hosam Al-Samarraie, PhD. CITM-USM.
Weka Tutorial. WEKA:: Introduction A collection of open source ML algorithms – pre-processing – classifiers – clustering – association rule Created by.
A new clustering tool of Data Mining RAPID MINER.
Data Mining By Farzana Forhad CS 157B. Agenda Decision Tree and ID3 Rough Set Theory Clustering.
WEKA's Knowledge Flow Interface Data Mining Knowledge Discovery in Databases ELIE TCHEIMEGNI Department of Computer Science Bowie State University, MD.
In part from: Yizhou Sun 2008 An Introduction to WEKA Explorer.
Data Mining Practical Machine Learning Tools and Techniques Chapter 6.3: Association Rules Rodney Nielsen Many / most of these slides were adapted from:
@relation age sex { female, chest_pain_type { typ_angina, asympt, non_anginal,
WEKA: A Practical Machine Learning Tool WEKA : A Practical Machine Learning Tool.
Department of Computer Science, University of Waikato, New Zealand Eibe Frank WEKA: A Machine Learning Toolkit The Explorer Classification and Regression.
Department of Computer Science, University of Waikato, New Zealand Geoff Holmes WEKA project and team Data Mining process Data format Preprocessing Classification.
An Introduction to WEKA
Waikato Environment for Knowledge Analysis
WEKA.
Sampath Jayarathna Cal Poly Pomona
An Introduction to WEKA
Machine Learning with WEKA
Machine Learning with WEKA
Weka Package Weka package is open source data mining software written in Java. Weka can be applied to your dataset from the GUI, the command line or called.
Machine Learning with Weka
An Introduction to WEKA
Tutorial for WEKA Heejun Kim June 19, 2018.
Machine Learning with Weka
Machine Learning with WEKA
Lecture 10 – Introduction to Weka
Data Mining CSCI 307, Spring 2019 Lecture 7
Data Mining CSCI 307, Spring 2019 Lecture 8
Presentation transcript:

Appendix: The WEKA Data Mining Software http://www.cs.waikato.ac.nz/ml/weka/

WEKA: Introduction WEKA, developed by Waikato University, New Zealand. WEKA (Waikato Environment for Knowledge Analysis) History: 1st version (version 2.1, 1996); Version 2.3, 1998; Version 3.0, 1999; Version 3.4, 2003; Version 3.6, 2008. WEKA provides a collection of data mining, machine learning algorithms and preprocessing tools. It includes algorithms for regression, classification, clustering, association rule mining and attribute selection. It also has data visualization facilities. WEKA is an environment for comparing learning algorithms With WEKA, researchers can implement new data mining algorithms to add in WEKA WEKA is the best-known open-source data mining software.

WEKA: Introduction WEKA was written in Java. WEKA 3.4 consists of 271477 lines of code. WEKA 3.6 consists of 509903 lines of code. It can work on Windows, Linux and Macintosh. Users can access its components through Java programming or through a command-line interface. It consists of three main graphical user interfaces: Explorer, Experimenter and Knowledge Flow. The easiest way to use WEKA is through Explorer, the main graphical user interface. Data can be loaded from various sources, including files, URLs and databases. Database access is provided through Java Database Connectivity.

WEKA data format WEKA stores data in flat files (ARFF format). It’s easy to transform EXCEL file to ARFF format. An ARFF file consists of a list of instances We can create an ARFF file by using Notepad or Word. The name of the dataset is with @relation Attribute information is with @attribute The data is with @data. Beside ARFF format, WEKA allows CSV, LibSVM, and C4.5’s format.

WEKA ARFF format @relation weather @attribute outlook {sunny, overcast, rainy} @attribute temperature real @attribute humidity real @attribute windy {TRUE, FALSE} @attribute play {yes, no} @data sunny, 85, 85, FALSE, no sunny, 80, 90, TRUE, no overcast, 83, 86, FALSE, yes rainy, 70, 96, FALSE, yes rainy, 68, 80, FALSE, yes ……………………………

Explorer GUI Consists of 6 panels, each for one data mining tasks: Preprocess Classify Cluster Associate Select Attributes Visualize. Preprocess: to use WEKA’s data preprocessing tools (called “filters”) to transform the dataset in several ways. WEKA contains filters for: Discretization, normalization, resampling, attribute selection, transforming and combining attributes, …

Explorer (cont.) Classify: Regression techniques (predictors of “continuous classes”) Linear regression Logistic regression Neural network Support vector machine Classification algorithms Decision trees – ID3, C4.5 (called J48) Naïve Bayes, Bayes network k-nearest-neighbors Rule learners: Ripper, Prism Lazy rule learners Meta learners (bagging, boosting)

Clustering Clustering algorithms: K-Means, X-Means, FarthestFirst Likelihood-based clustering: EM (Expectation-Maximization) Cobweb (incremental clustering algorithm) Clusters can be visualized and compared to “true” clusters (if given) Attribute Selection: This provides access to various methods for measuring the utility of attributes and identifying the most important attributes in a dataset. Filter method: the attribute set is filtered to produce the most promising subset before learning begins. A wide range of filtering criteria, including correlation-based feature selection, the chi-square statistic, gain ratio, information, support-machine-based criterion. A variety of search methods: forward and backward selection, best-first search, genetic search and random search. PCA (principal component analysis) to reduce the dimensionality of a problem. Discretizing numeric attributes.

Explorer (cont.) Assocation rule mining Visualization Apriori algorithm Work only with discrete data Visualization Scatter plots, ROC curves,Trees, graphs WEKA can visualize single attributes (1-d) and pairs of attributes (2-d). Color-coded class values. “Zoom-in” function

Explorer GUI (Classify)

WEKA Experimenter This interface is designed to facilitate experimental comparisons of the performance of algorithms based on many different evaluation criteria. Experiments can involves many algorithms that are run on multiple datasets. Can also iterate over different parameter settings Experiments can also be distributed across different computer nodes in a network. Once an experiment has been set up, it can be saved in either XML or binary form, so that it can be re-visited.

Knowledge Flow Interface The Explorer is designed for batch-based data processing: training data is loaded into memory and then processed. However WEKA has implemented some incremental algorithms. Knowledge-flow interface can handle incremental updates. It can load and preprocess individual instances before feeding them into incremental learning algorithms. Knowledge-flow also provides nodes for visualization and evaluation.

Conclusions Comparison to R, WEKA is weaker in classical statistics but stronger in machine learning (data mining) algorithms. WEKA has developed a set of extensions covering diverse areas, such as text mining, visualization and bioinformatics. WEKA 3.6 includes support for importing PMML models (Predictive Modeling Markup Language). PMML is a XML-based standard fro expressing statistical and data mining models. WEKA 3.6 can read and write data in the format used by the well known LibSVM and SVM-Light support vector machine implementations. WEKA has 2 limitations: Most of the algorithms require all the data stored in main memory. So it restricts application to small or medium-sized datasets. Java implementation is somewhat slower than an equivalent in C/C++

References I.H. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations, Morgan Kaufmann, San Francisco, 2000. M. Hall and E. Frank, The WEKA Data Mining Software: An Update, J. SIGKDD Explorations, Vol. 11, No. 1, 2008. R. R. Bouckaert et al., WEKA Manual for Version 3.6.0, 2008. E. Frank et al., WEKA – A Machine Learning Workbench for Data Mining, 2003.