A weight-incorporated similarity-based clustering ensemble method based on swarm intelligence Yue Ming NJIT#: 31351707.

Slides:



Advertisements
Similar presentations
Robust spectral 3D-bodypart segmentation along time Fabio Cuzzolin, Diana Mateus, Edmond Boyer, Radu Horaud Perception project meeting 24/4/2007 Submitted.
Advertisements

Lindsey Bleimes Charlie Garrod Adam Meyerson
Conceptual Clustering
Learning Trajectory Patterns by Clustering: Comparative Evaluation Group D.
PARTITIONAL CLUSTERING
Unsupervised Learning
Foreground Focus: Finding Meaningful Features in Unlabeled Images Yong Jae Lee and Kristen Grauman University of Texas at Austin.
Clustering: Introduction Adriano Joaquim de O Cruz ©2002 NCE/UFRJ
Random Projection for High Dimensional Data Clustering: A Cluster Ensemble Approach Xiaoli Zhang Fern, Carla E. Brodley ICML’2003 Presented by Dehong Liu.
G. Folino, A. Forestiero, G. Spezzano Swarming Agents for Discovering Clusters in Spatial Data Second International.
Self Organization of a Massive Document Collection
Locally Constraint Support Vector Clustering
HMM-BASED PATTERN DETECTION. Outline  Markov Process  Hidden Markov Models Elements Basic Problems Evaluation Optimization Training Implementation 2-D.
Slide 1 EE3J2 Data Mining EE3J2 Data Mining Lecture 15: Introduction to Artificial Neural Networks Martin Russell.
Sparse Solutions for Large Scale Kernel Machines Taher Dameh CMPT820-Multimedia Systems Dec 2 nd, 2010.
Modified Particle Swarm Algorithm for Decentralized Swarm Agent 2004 IEEE International Conference on Robotic and Biomimetics Dong H. Kim Seiichi Shin.
Using Relevance Feedback in Multimedia Databases
Cliff Rhyne and Jerry Fu June 5, 2007 Parallel Image Segmenter CSE 262 Spring 2007 Project Final Presentation.
Parallel K-Means Clustering Based on MapReduce The Key Laboratory of Intelligent Information Processing, Chinese Academy of Sciences Weizhong Zhao, Huifang.
Tutorial 8 Clustering 1. General Methods –Unsupervised Clustering Hierarchical clustering K-means clustering Expression data –GEO –UCSC –ArrayExpress.
Hazırlayan NEURAL NETWORKS Radial Basis Function Networks II PROF. DR. YUSUF OYSAL.
COVERTNESS CENTRALITY IN NETWORKS Michael Ovelgönne UMIACS University of Maryland 1 Chanhyun Kang, Anshul Sawant Computer Science Dept.
Mean-shift and its application for object tracking
1/27 Ensemble Visualization for Cyber Situation Awareness of Network Security Data Lihua Hao 1, Christopher G. Healey 1, Steve E. Hutchinson 2 1 North.
COMMON EVALUATION FINAL PROJECT Vira Oleksyuk ECE 8110: Introduction to machine Learning and Pattern Recognition.
International Conference on Intelligent and Advanced Systems 2007 Chee-Ming Ting Sh-Hussain Salleh Tian-Swee Tan A. K. Ariff. Jain-De,Lee.
1 Lecture 10 Clustering. 2 Preview Introduction Partitioning methods Hierarchical methods Model-based methods Density-based methods.
An Efficient Approach to Clustering in Large Multimedia Databases with Noise Alexander Hinneburg and Daniel A. Keim.
Particle Filters for Shape Correspondence Presenter: Jingting Zeng.
A hybrid SOFM-SVR with a filter-based feature selection for stock market forecasting Huang, C. L. & Tsai, C. Y. Expert Systems with Applications 2008.
Classification Heejune Ahn SeoulTech Last updated May. 03.
Autonomic scheduling of tasks from data parallel patterns to CPU/GPU core mixes Published in: High Performance Computing and Simulation (HPCS), 2013 International.
Applying Statistical Machine Learning to Retinal Electrophysiology Matt Boardman January, 2006 Faculty of Computer Science.
CURE: An Efficient Clustering Algorithm for Large Databases Sudipto Guha, Rajeev Rastogi, Kyuseok Shim Stanford University Bell Laboratories Bell Laboratories.
Presenter : Lin, Shu-Han Authors : Jeen-Shing Wang, Jen-Chieh Chiang
The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL Clustering COMP Research Seminar BCB 713 Module Spring 2011 Wei Wang.
Chapter 11 Statistical Techniques. Data Warehouse and Data Mining Chapter 11 2 Chapter Objectives  Understand when linear regression is an appropriate.
Spoken Language Group Chinese Information Processing Lab. Institute of Information Science Academia Sinica, Taipei, Taiwan
Haojun Sun,ShengruiWang*,Qingshan Jiang Received 16 December 2002; received in revised form 29 March 2004; accepted 29 March 2004 Presenter Chia-Cheng.
Cluster Analysis Potyó László. Cluster: a collection of data objects Similar to one another within the same cluster Similar to one another within the.
AESWARM Mert Doğar Hazar İlhan Dünya Değirmenci.
Radial Basis Function ANN, an alternative to back propagation, uses clustering of examples in the training set.
Feature Selection in k-Median Clustering Olvi Mangasarian and Edward Wild University of Wisconsin - Madison.
ViSOM - A Novel Method for Multivariate Data Projection and Structure Visualization Advisor : Dr. Hsu Graduate : Sheng-Hsuan Wang Author : Hujun Yin.
Parameter Reduction for Density-based Clustering on Large Data Sets Elizabeth Wang.
Clustering Wei Wang. Outline What is clustering Partitioning methods Hierarchical methods Density-based methods Grid-based methods Model-based clustering.
A Hybrid Model of HMM and RBFN Model of Speech Recognition 길이만, 김수연, 김성호, 원윤정, 윤아림 한국과학기술원 응용수학전공.
Motion Segmentation CAGD&CG Seminar Wanqiang Shen
哈工大信息检索研究室 HITIR ’ s Update Summary at TAC2008 Extractive Content Selection Using Evolutionary Manifold-ranking and Spectral Clustering Reporter: Ph.d.
Machine Learning Lecture 4: Unsupervised Learning (clustering) 1.
Clustering (2) Center-based algorithms Fuzzy k-means Density-based algorithms ( DBSCAN as an example ) Evaluation of clustering results Figures and equations.
Clustering Anna Reithmeir Data Mining Proseminar 2017
Enhanced MWO Training Algorithm to Improve Classification Accuracy
What Is Cluster Analysis?
Cluster Analysis II 10/03/2012.
Load Balancing: List Scheduling
Mikhail Bilenko, Sugato Basu, Raymond J. Mooney
A Consensus-Based Clustering Method
A weight-incorporated similarity-based clustering ensemble method based on swarm intelligence Yue Ming NJIT#:
CSE572, CBS598: Data Mining by H. Liu
CSE572, CBS572: Data Mining by H. Liu
Shih-Wei Lin, Kuo-Ching Ying, Shih-Chieh Chen, Zne-Jung Lee
Clustering Wei Wang.
Content Based Image Retrieval
Load Balancing: List Scheduling
Introduction to Machine learning
Discriminative Training
Neal Kurande, WinaGodwin Anyanwu Jr., Adam Chau
What is Artificial Intelligence?
Presentation transcript:

A weight-incorporated similarity-based clustering ensemble method based on swarm intelligence Yue Ming NJIT#: 31351707

About my project

Clustering algorithms, one important and normal used part of unsupervised machine learning methods, aim to discover the natural groupings of patterns, points, or objects. They divide a given dataset into multiple classes according to data similarity. In this work, I choose three clustering algorithms, k-MWO, AP clustering and DBSCAN. k-MWO clustering algorithm combines mussels wandering optimization (MWO), a heuristic method based on swarm intelligence, with classic k-means clustering algorithm. Affinity propagation (AP) takes as input measures of similarity between pairs of data points. DBSCAN is a density based algorithm for dealing with arbitrary shapes. 

Simulation & Result

Dataset 1 2-dimension. 2 classes. Each class has 1000 elements. Conform to Gaussian distribution.

Initial data

After using K-MWO

Dataset 2 2-dimension. 2 classes. Arbitrary cluster ship. 1000 elements total.

Initial data

After using K-MWO

Analyze Dataset 1 Dataset 2 Algorithm time 12.536s 7.025s Cluster accuracy rate 90.6% 45.2%

Performance Comparison Dataset 1 (Arbitrary cluster ship with 1000 points) Dataset 2 (Gaussian Distribution with 2000 points) DBSCAN K-MWO AP Running Time 2.906s 7.025s 37.638s Cluster Number 2 24 Accuracy Rate 99.6% 45.2% 9.76% DBSCAN K-MWO AP Running Time 5.864s 12.536s 67.274s Cluster Number 1 2 Accuracy Rate 42.7% 90.6% 89.3%

Conclusion This paper presents a new clustering algorithm based on a new swarm intelligence model, called mussels wandering optimization (MWO). It makes full use of the global optimization ability of MWO and the local search ability of K-means. We test K-MWO, DBSCAN, AP algorithm in 2 same dataset.