Kernel Properties 2012 Computer Science PhD Showcase 17 February 2012 Roberto Valerio Dr. Ricardo Vilalta Pattern Analysis Lab.

Slides:

Advertisements

Similar presentations

SPM – introduction & orientation introduction to the SPM software and resources introduction to the SPM software and resources.

Advertisements

Introduction to Support Vector Machines (SVM)

CSI :Florida A BAYESIAN APPROACH TO LOCALIZED MULTI-KERNEL LEARNING USING THE RELEVANCE VECTOR MACHINE R. Close, J. Wilson, P. Gader.

ECG Signal processing (2)

Image classification Given the bag-of-features representations of images from different classes, how do we learn a model for distinguishing them?

Irina Vaviļčenkova, Svetlana Asmuss ELEVENTH INTERNATIONAL CONFERENCE ON FUZZY SET THEORY AND APPLICATIONS Liptovský Ján, Slovak Republic, January 30 -

ONLINE ARABIC HANDWRITING RECOGNITION By George Kour Supervised by Dr. Raid Saabne.

An Introduction of Support Vector Machine

Olivier Duchenne ， Armand Joulin ， Jean Ponce Willow Lab ， ICCV2011.

Pattern Recognition and Machine Learning

CHAPTER 10: Linear Discrimination

Input Space versus Feature Space in Kernel- Based Methods Scholkopf, Mika, Burges, Knirsch, Muller, Ratsch, Smola presented by: Joe Drish Department of.

An Introduction of Support Vector Machine

Support Vector Machines and Kernels Adapted from slides by Tim Oates Cognition, Robotics, and Learning (CORAL) Lab University of Maryland Baltimore County.

Support Vector Machines

Support vector machine

Search Engines Information Retrieval in Practice All slides ©Addison Wesley, 2008.

Computer vision: models, learning and inference Chapter 8 Regression.

LPP-HOG: A New Local Image Descriptor for Fast Human Detection Andy Qing Jun Wang and Ru Bo Zhang IEEE International Symposium.

Support Vector Machine

Pattern Recognition and Machine Learning

Support Vector Machines (SVMs) Chapter 5 (Duda et al.)

Pattern Recognition Topic 1: Principle Component Analysis Shapiro chap

Classification Problem 2-Category Linearly Separable Case A- A+ Malignant Benign.

Sketched Derivation of error bound using VC-dimension (1) Bound our usual PAC expression by the probability that an algorithm has 0 error on the training.

The Implicit Mapping into Feature Space. In order to learn non-linear relations with a linear machine, we need to select a set of non- linear features.

Support Vector Machines

Lecture 10: Support Vector Machines

Review Rong Jin. Comparison of Different Classification Models  The goal of all classifiers Predicating class label y for an input x Estimate p(y|x)

An Introduction to Support Vector Machines Martin Law.

Ch. Eick: Support Vector Machines: The Main Ideas Reading Material Support Vector Machines: 1.Textbook 2. First 3 columns of Smola/Schönkopf article on.

Digital Camera and Computer Vision Laboratory Department of Computer Science and Information Engineering National Taiwan University, Taipei, Taiwan, R.O.C.

July 11, 2001Daniel Whiteson Support Vector Machines: Get more Higgs out of your data Daniel Whiteson UC Berkeley.

Digital Camera and Computer Vision Laboratory Department of Computer Science and Information Engineering National Taiwan University, Taipei, Taiwan, R.O.C.

1 SUPPORT VECTOR MACHINES İsmail GÜNEŞ. 2 What is SVM? A new generation learning system. A new generation learning system. Based on recent advances in.

IEEE TRANSSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE

Kernel Methods A B M Shawkat Ali 1 2 Data Mining ¤ DM or KDD (Knowledge Discovery in Databases) Extracting previously unknown, valid, and actionable.

Jun-Won Suh Intelligent Electronic Systems Human and Systems Engineering Department of Electrical and Computer Engineering Speaker Verification System.

An Introduction to Support Vector Machines (M. Law)

Optimal Bayes Classification

Kernels in Pattern Recognition. A Langur - Baboon Binary Problem m/2006/ /himplu s4.jpg … HA HA HA …

Support Vector Machines and Kernel Methods Machine Learning March 25, 2010.

Support Vector Machines Project מגישים : גיל טל ואורן אגם מנחה : מיקי אלעד נובמבר 1999 הטכניון מכון טכנולוגי לישראל הפקולטה להנדסת חשמל המעבדה לעיבוד וניתוח.

Final Exam Review CS479/679 Pattern Recognition Dr. George Bebis 1.

Support Vector Machines (SVM): A Tool for Machine Learning Yixin Chen Ph.D Candidate, CSE 1/10/2002.

CS Statistical Machine learning Lecture 12 Yuan (Alan) Qi Purdue CS Oct

Support-Vector Networks C Cortes and V Vapnik (Tue) Computational Models of Intelligence Joon Shik Kim.

A Kernel Approach for Learning From Almost Orthogonal Pattern * CIS 525 Class Presentation Professor: Slobodan Vucetic Presenter: Yilian Qin * B. Scholkopf.

Chapter 10 The Support Vector Method For Estimating Indicator Functions Intelligent Information Processing Laboratory, Fudan University.

1 Kernel Machines A relatively new learning methodology (1992) derived from statistical learning theory. Became famous when it gave accuracy comparable.

A Brief Introduction to Support Vector Machine (SVM) Most slides were from Prof. A. W. Moore, School of Computer Science, Carnegie Mellon University.

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 1: INTRODUCTION.

Support Vector Machines (SVMs) Chapter 5 (Duda et al.) CS479/679 Pattern Recognition Dr. George Bebis.

SUPPORT VECTOR MACHINES

CS 9633 Machine Learning Support Vector Machines

Support Vector Machines and Kernels

Support Vector Machines

An Introduction to Support Vector Machines

Support Vector Machines Introduction to Data Mining, 2nd Edition by

Pattern Recognition CS479/679 Pattern Recognition Dr. George Bebis

CS 2750: Machine Learning Support Vector Machines

The following slides are taken from:

Recitation 6: Kernel SVM

Pattern Recognition and Machine Learning

Support Vector Machine _ 2 (SVM)

Support Vector Machines and Kernels

CSCE833 Machine Learning Lecture 9 Linear Discriminant Analysis

Linear Discrimination

Machine Learning – a Probabilistic Perspective

SVMs for Document Ranking

Presentation transcript:

Kernel Properties 2012 Computer Science PhD Showcase 17 February 2012 Roberto Valerio Dr. Ricardo Vilalta Pattern Analysis Lab

Kernel Properties – Roberto Valerio 2012 Computer Science PhD Showcase  17 February 2012 Kernel Properties Agenda Introduction Objective Current work Experiments Conclusions Publications

Kernel Properties – Roberto Valerio 2012 Computer Science PhD Showcase  17 February 2012 Introduction Machine Learning –What is it? Kernel methods –What are kernel methods?

Kernel Properties – Roberto Valerio 2012 Computer Science PhD Showcase  17 February 2012 Support Vector Machine

Kernel Properties – Roberto Valerio 2012 Computer Science PhD Showcase  17 February 2012 Support Vector Machine ? Feature 1 Feature 2.. Feature n Infinite Dimensional Space

Kernel Properties – Roberto Valerio 2012 Computer Science PhD Showcase  17 February 2012 Kernel Trick

Kernel Properties – Roberto Valerio 2012 Computer Science PhD Showcase  17 February 2012 Which kernel? Linear Polynomial Gaussian Hyperbolic ?

Kernel Properties – Roberto Valerio 2012 Computer Science PhD Showcase  17 February 2012 Objective Analyze the behaviors of different kernels to generate properties that allow us to determine the optimal kernel.

Kernel Properties – Roberto Valerio 2012 Computer Science PhD Showcase  17 February 2012 Current Work Kernel Matrices evaluations Behavioral evaluation of the Kernel transformation in varied data density situations Identifying key points in the hyper plane construction and kernel mappings

Kernel Properties – Roberto Valerio 2012 Computer Science PhD Showcase  17 February 2012 Experiments Toy Data sets Bayes ErrorNon LinearNon linear and Bayes error

Kernel Properties – Roberto Valerio 2012 Computer Science PhD Showcase  17 February 2012 Experiments Linear Kernel Matrix Bayes ErrorNon LinearNon linear and Bayes error

Kernel Properties – Roberto Valerio 2012 Computer Science PhD Showcase  17 February 2012 Experiments Polynomial Kernel Degree 4 Kernel Bayes ErrorNon LinearNon linear and Bayes error

Kernel Properties – Roberto Valerio 2012 Computer Science PhD Showcase  17 February 2012 Experiments Linear Kernel Density Evaluation Bayes ErrorNon LinearNon linear and Bayes error

Kernel Properties – Roberto Valerio 2012 Computer Science PhD Showcase  17 February 2012 Experiments Polynomial Kernel Degree 4 Density evaluation Bayes ErrorNon LinearNon linear and Bayes error

Kernel Properties – Roberto Valerio 2012 Computer Science PhD Showcase  17 February 2012 Experiments

Kernel Properties – Roberto Valerio 2012 Computer Science PhD Showcase  17 February 2012 Conclusions Each kernel has its own pattern We can take advantage of these patterns to generate more accurate classifications.

Kernel Properties – Roberto Valerio 2012 Computer Science PhD Showcase  17 February 2012 Future work Identify the relationship between the kernel pattern and the misclassification error Use this relationship to select the optimal kernel or as a guideline to construct new kernels.

Kernel Properties – Roberto Valerio 2012 Computer Science PhD Showcase  17 February 2012 Publications Classification of Sources of Ionizing Radiation in Space Missions: A Machine Learning Approach. Vilalta, R., Kuchibhotla, S., Hoang, S., Valerio, R., Ocegueda, F., and Pinsky, L., (2012) Acta Futura, 5, pp , Development of Pattern Recognition Software for Tracks of Ionizing Radiation in Medipix2-Based (TimePix) Pixel Detector Devices. Vilalta R., Valerio R., Kuchibhotla S., Pinsky L. (2010) 18th International Conference on Computing in High Energy and Nuclear Physics (CHEP-10), Taipei, Taiwan. Journal of Physics: Conference Series. The Effect of the Fragmentation Problem in Decision Tree Learning Applied to the Search for Single Top Quark Production. Vilalta R., Valerio R., Ocegueda-Hernandez F., Watts G. (2009) 17th International Conference on Computing in High Energy and Nuclear Physics (CHEP-09), Prague, Czech Republic. Journal of Physics: Conference Series.