Using Interactive Evolution for Exploratory Data Analysis Tomáš Řehořek Czech Technical University in Prague.

Slides:



Advertisements
Similar presentations
Yuri R. Tsoy, Vladimir G. Spitsyn, Department of Computer Engineering
Advertisements

Teaching an Agent by Playing a Multimodal Memory Game: Challenges for Machine Learners and Human Teachers AAAI 2009 Spring Symposium: Agents that Learn.
Input Space versus Feature Space in Kernel- Based Methods Scholkopf, Mika, Burges, Knirsch, Muller, Ratsch, Smola presented by: Joe Drish Department of.
Computational Intelligence: Methods and Applications Lecture 1 Organization and overview Włodzisław Duch Dept. of Informatics, UMK Google: W Duch.
An Overview of Machine Learning
Application Of Evolutionary Neural Network Architecture Bharadwaj Krishnamurthy.
Face Recognition and Biometric Systems
Non-linear Dimensionality Reduction CMPUT 466/551 Nilanjan Ray Prepared on materials from the book Non-linear dimensionality reduction By Lee and Verleysen,
Biologically Inspired AI (mostly GAs). Some Examples of Biologically Inspired Computation Neural networks Evolutionary computation (e.g., genetic algorithms)
A Comprehensive Study on Third Order Statistical Features for Image Splicing Detection Xudong Zhao, Shilin Wang, Shenghong Li and Jianhua Li Shanghai Jiao.
Neuro-Evolution of Augmenting Topologies Ben Trewhella.
Face Recognition Under Varying Illumination Erald VUÇINI Vienna University of Technology Muhittin GÖKMEN Istanbul Technical University Eduard GRÖLLER Vienna.
Principal Component Analysis
Evolutionary Algorithms Simon M. Lucas. The basic idea Initialise a random population of individuals repeat { evaluate select vary (e.g. mutate or crossover)
Genetic Algorithms Learning Machines for knowledge discovery.
FACE RECOGNITION, EXPERIMENTS WITH RANDOM PROJECTION
Bayesian belief networks 2. PCA and ICA
Intelligent Systems Group Emmanuel Fernandez Larry Mazlack Ali Minai (coordinator) Carla Purdy William Wee.
INTRODUCTION TO Machine Learning ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.
Information Retrieval in High Dimensional Data 1 Wintersemester Prof. Dr. M. Kleinsteuber and Dipl. Math. M. Seibert, Geometric Optimization and.
Chrominance edge preserving grayscale transformation with approximate first principal component for color edge detection Professor: 連震杰 教授 Reporter: 第17組.
LÊ QU Ố C HUY ID: QLU OUTLINE  What is data mining ?  Major issues in data mining 2.
September 10, 2012Introduction to Artificial Intelligence Lecture 2: Perception & Action 1 Boundary-following Robot Rules 1  2  3  4  5.
Attention Deficit Hyperactivity Disorder (ADHD) Student Classification Using Genetic Algorithm and Artificial Neural Network S. Yenaeng 1, S. Saelee 2.
Data Mining Chun-Hung Chou
1 Introduction to Artificial Neural Networks Andrew L. Nelson Visiting Research Faculty University of South Florida.
A Genetic Algorithms Approach to Feature Subset Selection Problem by Hasan Doğu TAŞKIRAN CS 550 – Machine Learning Workshop Department of Computer Engineering.
Department of Information Technology Indian Institute of Information Technology and Management Gwalior AASF hIQ 1 st Nov ‘09 Department of Information.
Anomaly detection with Bayesian networks Website: John Sandiford.
1.stránka 1. 2 Czech Technical University in Prague International Computer Science Program Faculty of Electrical Engineering OPEN INFORMATICS bachelor.
Retraining of the SAMANN Network Viktor Medvedev Viktor Medvedev, Gintautas Dzemyda {Viktor.m, Institute of Mathematics and Informatics.
Computational Intelligence: Methods and Applications Lecture 37 Summary & review Włodzisław Duch Dept. of Informatics, UMK Google: W Duch.
Image Pattern Recognition The identification of animal species through the classification of hair patterns using image pattern recognition: A case study.
An informal description of artificial neural networks John MacCormick.
Enhancing Interactive Visual Data Analysis by Statistical Functionality Jürgen Platzer VRVis Research Center Vienna, Austria.
Ruizhu Yang 04/25/2014. Otari G V, Kulkarni R V. A Review of Application of Data Mining in Earthquake Prediction[J] Dzwinel W, Yuen D A, Boryczko.
A Two-level Pose Estimation Framework Using Majority Voting of Gabor Wavelets and Bunch Graph Analysis J. Wu, J. M. Pedersen, D. Putthividhya, D. Norgaard,
Artificial Neural Network Building Using WEKA Software
Eyes detection in compressed domain using classification Eng. Alexandru POPA Technical University of Cluj-Napoca Faculty.
Data Mining BY JEMINI ISLAM. Data Mining Outline: What is data mining? Why use data mining? How does data mining work The process of data mining Tools.
Non-Linear Dimensionality Reduction
Interactive Evolution in Automated Knowledge Discovery Tomáš Řehořek March 2011.
1/18 New Feature Presentation of Transition Probability Matrix for Image Tampering Detection Luyi Chen 1 Shilin Wang 2 Shenghong Li 1 Jianhua Li 1 1 Department.
Evolutionary Computation (P. Koumoutsakos) 1 What is Life  Key point : Ability to reproduce.  Are computer programs alive ? Are viruses a form of life.
Speech Lab, ECE, State University of New York at Binghamton  Classification accuracies of neural network (left) and MXL (right) classifiers with various.
Dr.Abeer Mahmoud ARTIFICIAL INTELLIGENCE (CS 461D) Dr. Abeer Mahmoud Computer science Department Princess Nora University Faculty of Computer & Information.
Interactively Discovery of Attributes Vocabulary Devi Parikh and Kristen Grauman.
WHAT IS DATA MINING?  The process of automatically extracting useful information from large amounts of data.  Uses traditional data analysis techniques.

WHAT IS DATA MINING?  The process of automatically extracting useful information from large amounts of data.  Uses traditional data analysis techniques.
Out of sample extension of PCA, Kernel PCA, and MDS WILSON A. FLORERO-SALINAS DAN LI MATH 285, FALL
George Yauneridge.  Machine learning basics  Types of learning algorithms  Genetic algorithm basics  Applications and the future of genetic algorithms.
VISUALIZATION TECHNIQUES UTILIZING THE SENSITIVITY ANALYSIS OF MODELS Ivo Kondapaneni, Pavel Kordík, Pavel Slavík Department of Computer Science and Engineering,
Principal Component Analysis (PCA)
Deeply learned face representations are sparse, selective, and robust
Theme Introduction : Learning from Data
Department of Cybernetics
HyperNetworks Engın denız usta
DeepCount Mark Lenson.
Artificial Intelligence (CS 370D)
Implementing Boosting and Convolutional Neural Networks For Particle Identification (PID) Khalid Teli .
Machine Learning Training Bootcamp
Regularization of Evolving Polynomial Models
A Hybrid PCA-LDA Model for Dimension Reduction Nan Zhao1, Washington Mio2 and Xiuwen Liu1 1Department of Computer Science, 2Department of Mathematics Florida.
Design of Hierarchical Classifiers for Efficient and Accurate Pattern Classification M N S S K Pavan Kumar Advisor : Dr. C. V. Jawahar.
Introduction PCA (Principal Component Analysis) Characteristics:
Cheng-Yi, Chuang (莊成毅), b99
Computational Intelligence: Methods and Applications
Evolving Logical-Linear Edge Detector with Evolutionary Algorithms
What is Artificial Intelligence?
Presentation transcript:

Using Interactive Evolution for Exploratory Data Analysis Tomáš Řehořek Czech Technical University in Prague

CIG Research Group Czech Technical University in Prague  Faculty of Electrical Engineering (FEL)  Faculty of Information Technology (FIT)

CIG Research Group Data Mining  Algorithms, Visualization, Automation Biologically inspired algorithms  Evolutionary computation  Artificial neural networks Artificial Intelligence  Machine learning, Optimization

Optimization in Data Mining Main objective of the CIG research group Data Mining Evolutionary computation Artificial Intelligence Optimization Machine learning Artificial Neural Networks

Dimensionality Reduction and Visualization in Data Mining Linear projections  Principal Component Analysis (PCA)  Linear Discriminant Analysis (LDA) Non-linear projections  Multidimensional Scaling (MDS)  Sammon Projection  Kernel PCA

Interactive Evolutionary Computation (IEC) Evolutionary Computation using human evaluation as the fitness function Currently used almost exclusively for artistic purposes  Images, Sounds, Animations… Inspiration:

PicBreeder Jimmy Secretan Kenneth Stanley Interactive Evolution by

Next generation … and so on …

And after 75 generations you eventually get something interesting

The technology hidden behind x z grayscale x z Neural net draws the image

Neuroevolution grayscale By clicking, you increase fitness of nets Next generations inherit fit building patterns x z

Gallery of discovered images

Using Interactive Evolution in Exploratory Data Analysis Experiment with evolving projections Examples in n-dimensional space 2D

Interactive Evolution of Projections Machine Human Candidate projections      Feedback

Interactive Evolution of Projections Machine Human Candidate projections      Feedback

Data Projection Experiments Linear transformation  Evolve coefficient matrix  Do the transformation using formula: … resulting a point in 2D-space

Data Projection Experiments Sigmoidal transformation  Evolve coefficient matrix  Do the transformation using formula: a b c

Experiments with Wine Dataset PCASOM

Separation of Different Classes using Linear Projection

Separation of Different Classes using Sigmoidal Projection

There are many possible goals! „Blue points down“ – 5 generations, sigmoid projection Outlier Detection – 8 generations, linear projection

Conclusion Interactive Evolution can be used in Exploratory Data Analysis Our experiments show that complex projections can be easily evolved In future, we plan to investigate such evolution in fields of Data Mining other than EDA

Thank you for your attention! Tomáš Řehořek Computational Intelligence Group (CIG) Faculty of Information Technology (FIT) Czech Technical University (CTU) in Prague