Online Manifold Regularization: A New Learning Setting and Empirical Study Andrew B. Goldberg, Ming Li, and Xiaojin Zhu.(ECML PKDD, 2008). Hu EnLiang Friday,

Slides:



Advertisements
Similar presentations
Applications of one-class classification
Advertisements

Query Classification Using Asymmetrical Learning Zheng Zhu Birkbeck College, University of London.
Using Large-Scale Web Data to Facilitate Textual Query Based Retrieval of Consumer Photos.
Image Retrieval With Relevant Feedback Hayati Cam & Ozge Cavus IMAGE RETRIEVAL WITH RELEVANCE FEEDBACK Hayati CAM Ozge CAVUS.
Pseudo-Relevance Feedback For Multimedia Retrieval By Rong Yan, Alexander G. and Rong Jin Mwangi S. Kariuki
Image Retrieval: Current Techniques, Promising Directions, and Open Issues Yong Rui, Thomas Huang and Shih-Fu Chang Published in the Journal of Visual.
M. Belkin and P. Niyogi, Neural Computation, pp. 1373–1396, 2003.
Discriminative Relevance Feedback With Virtual Textual Representation For Efficient Image Retrieval Suman Karthik and C.V.Jawahar.
A Geometric Perspective on Machine Learning 何晓飞 浙江大学计算机学院 1.
Search Engines Information Retrieval in Practice All slides ©Addison Wesley, 2008.
Catching the Drift: Learning Broad Matches from Clickthrough Data Sonal Gupta, Mikhail Bilenko, Matthew Richardson University of Texas at Austin, Microsoft.
1 Overview of Image Retrieval Hui-Ying Wang. 2/42 Reference Smeulders, A. W., Worring, M., Santini, S., Gupta, A.,, and Jain, R “Content-based.
Fast and Extensible Building Modeling from Airborne LiDAR Data Qian-Yi Zhou Ulrich Neumann University of Southern California.
Relational Learning with Gaussian Processes By Wei Chu, Vikas Sindhwani, Zoubin Ghahramani, S.Sathiya Keerthi (Columbia, Chicago, Cambridge, Yahoo!) Presented.
Relevance Feedback Content-Based Image Retrieval Using Query Distribution Estimation Based on Maximum Entropy Principle Irwin King and Zhong Jin Nov
“Random Projections on Smooth Manifolds” -A short summary
Complex Networks for Representation and Characterization of Object For CS790g Project Bingdong Li 11/9/2009.
Machine Learning Case study. What is ML ?  The goal of machine learning is to build computer systems that can adapt and learn from their experience.”
Image Search Presented by: Samantha Mahindrakar Diti Gandhi.
1 Statistical correlation analysis in image retrieval Reporter : Erica Li 2004/9/30.
ACM Multimedia th Annual Conference, October , 2004
1 Visual Information Extraction in Content-based Image Retrieval System Presented by: Mian Huang Weichuan Dong Apr 29, 2004.
Spatial Semi- supervised Image Classification Stuart Ness G07 - Csci 8701 Final Project 1.
1 Integrating User Feedback Log into Relevance Feedback by Coupled SVM for Content-Based Image Retrieval 9-April, 2005 Steven C. H. Hoi *, Michael R. Lyu.
A novel log-based relevance feedback technique in content- based image retrieval Reporter: Francis 2005/6/2.
1 How to be a Bayesian without believing Yoav Freund Joint work with Rob Schapire and Yishay Mansour.
Object Class Recognition Using Discriminative Local Features Gyuri Dorko and Cordelia Schmid.
Presentation in IJCNN 2004 Biased Support Vector Machine for Relevance Feedback in Image Retrieval Hoi, Chu-Hong Steven Department of Computer Science.
1 An Empirical Study on Large-Scale Content-Based Image Retrieval Group Meeting Presented by Wyman
Dept. of Computer Science & Engineering, CUHK Pseudo Relevance Feedback with Biased Support Vector Machine in Multimedia Retrieval Steven C.H. Hoi 14-Oct,
Presented by Zeehasham Rasheed
Relevance Feedback Content-Based Image Retrieval Using Query Distribution Estimation Based on Maximum Entropy Principle Irwin King and Zhong Jin The Chinese.
12 -1 Lecture 12 User Modeling Topics –Basics –Example User Model –Construction of User Models –Updating of User Models –Applications.
SIEVE—Search Images Effectively through Visual Elimination Ying Liu, Dengsheng Zhang and Guojun Lu Gippsland School of Info Tech,
Jinhui Tang †, Shuicheng Yan †, Richang Hong †, Guo-Jun Qi ‡, Tat-Seng Chua † † National University of Singapore ‡ University of Illinois at Urbana-Champaign.
Unsupervised Learning of Categories from Sets of Partially Matching Image Features Kristen Grauman and Trevor Darrel CVPR 2006 Presented By Sovan Biswas.
Active Learning for Class Imbalance Problem
Graph Embedding: A General Framework for Dimensionality Reduction Dong XU School of Computer Engineering Nanyang Technological University
Kernel Classifiers from a Machine Learning Perspective (sec ) Jin-San Yang Biointelligence Laboratory School of Computer Science and Engineering.
Using Large-Scale Web Data to Facilitate Textual Query Based Retrieval of Consumer Photos Yiming Liu, Dong Xu, Ivor W. Tsang, Jiebo Luo Nanyang Technological.
Content-Based Image Retrieval
Total Variation and Euler's Elastica for Supervised Learning
Ranking and Classifying Attractiveness of Photos in Folksonomies Jose San Pedro and Stefan Siersdorfer University of Sheffield, L3S Research Center WWW.
1 Multiple Classifier Based on Fuzzy C-Means for a Flower Image Retrieval Keita Fukuda, Tetsuya Takiguchi, Yasuo Ariki Graduate School of Engineering,
Pattern Recognition April 19, 2007 Suggested Reading: Horn Chapter 14.
PSEUDO-RELEVANCE FEEDBACK FOR MULTIMEDIA RETRIEVAL Seo Seok Jun.
1 A Compact Feature Representation and Image Indexing in Content- Based Image Retrieval A presentation by Gita Das PhD Candidate 29 Nov 2005 Supervisor:
Project by: Cirill Aizenberg, Dima Altshuler Supervisor: Erez Berkovich.
HAITHAM BOU AMMAR MAASTRICHT UNIVERSITY Transfer for Supervised Learning Tasks.
Semi-Automatic Image Annotation Liu Wenyin, Susan Dumais, Yanfeng Sun, HongJiang Zhang, Mary Czerwinski and Brent Field Microsoft Research.
Image Classification for Automatic Annotation
One-class Classification of Text Streams with Concept Drift
A Distributed Multimedia Data Management over the Grid Kasturi Chatterjee Advisors for this Project: Dr. Shu-Ching Chen & Dr. Masoud Sadjadi Distributed.
26/01/20161Gianluca Demartini Ranking Categories for Faceted Search Gianluca Demartini L3S Research Seminars Hannover, 09 June 2006.
A Statistical Approach to Texture Classification Nicholas Chan Heather Dunlop Project Dec. 14, 2005.
Learning with Green’s Function with Application to Semi-Supervised Learning and Recommender System ----Chris Ding, R. Jin, T. Li and H.D. Simon. A Learning.
CS Machine Learning Instance Based Learning (Adapted from various sources)
Relevance Feedback in Image Retrieval System: A Survey Tao Huang Lin Luo Chengcui Zhang.
An Application of Divergence Estimation to Projection Retrieval for Semi-supervised Classification and Clustering MADALINA FITERAU ARTUR DUBRAWSKI ICML.
哈工大信息检索研究室 HITIR ’ s Update Summary at TAC2008 Extractive Content Selection Using Evolutionary Manifold-ranking and Spectral Clustering Reporter: Ph.d.
MULTIMEDIA SYSTEMS CBIR & CBVR. Schedule Image Annotation (CBIR) Image Annotation (CBIR) Video Annotation (CBVR) Video Annotation (CBVR) Few Project Ideas.
Information Organization: Overview
Instance Based Learning (Adapted from various sources)
Image Retrieval Longin Jan Latecki.
Image Search Engine on Internet
Ying Dai Faculty of software and information science,
Content Based Image Retrieval
Semi-Supervised Time Series Classification
Information Organization: Overview
Motivation It can effectively mine multi-modal knowledge with structured textural and visual relationships from web automatically. We propose BC-DNN method.
Presentation transcript:

Online Manifold Regularization: A New Learning Setting and Empirical Study Andrew B. Goldberg, Ming Li, and Xiaojin Zhu.(ECML PKDD, 2008). Hu EnLiang Friday, April 17, 2009

Standard online learning VS. Online Manifold Regularization Both of them are long-life learning and learn non-iid sequentially; Standard online learning: traditionally assumes that every input point is fully labeled, it cannot take advantage of unlabeled data; Online MR: it learns even when the input point is unlabeled.

Online MR VS. batch MR (advantages) Online MR scales better than batch MR in time and space; Online MR achieves comparable performance to batch MR; Online MR can handle concept drift; Online MR is an “anytime classifier”, which continuously is being improved and its training is cheap.

The principle of online MR

The relationship of batch risk, instantaneous regularized risk and average instantaneous risk

How to accelerate online MR

Continue !!!

A Brief Introduction to CBIR (Content-based Image Retrieval) Hu en liang Tuesday, April 08, 2008

Background: Content-based Image Retrieval Properties: Querying image according to user’s semantic- concepts. Querying images according to image’s contents, such as: color, texture, shape, etc. Hypothesis——similar contents means semantic affinity ; ‘Semantic gap’——semantic affinity doesn't means similar contents.

A prototype of feedback-based CBIR

Background: The Difficulty of ‘ Semantic Gap ’ Key problems: 1. How to extract user’s semantic-concept (intention)? 2. How to bridge between content and semantic ? Main methods: 1. Machine learning based RF (Relevance-Feedback); 2. The prior knowledge such as the historical logs.

How to Connect CBIR to ML?  (Semi-)supervised Metric Learning;  Manifold Learning, Dimension Reduction…  (Semi-)supervised Classification;  Active Learning; Co-training;  Assembling Classifier;  Ranking; …

Some Individual Characteristics for feedback-based CBIR In contrast to typical ML, there are some special characteristics for RF-CBIR :  The problem of the small size sample;  The problem of asymmetrical training sample;  The online algorithm with real-time requirement;

Manifold Regularization (MR) Manifold regularization: a geometric framework for learning from labeled and unlabeled examples. Mikhail Belkin, Partha Niyogi, Vikas Sindhwani. Journal of machine Learning Research 7, pp , 2006

To Modify MR for CBIR There are some intrinsic characteristics for CBIR :  The problem of the small size sample;  The problem of asymmetrical training sample;  The online algorithm with real-time requirement; The (1+x)-manifolds hypothesis There only single submanifold for positive class, but multi-submanifolds for negative class!

Negative manifold positive manifold The Problem of MR for the Multi- Submanifolds Case

The Bias-MR Focusing on Single-Submanifold

A review of LapSVM

O(l 3 )  O(n 3 ) O(n 3 )

A higher efficiency in BLapSVM O(q 3 )

The BLapSVM Algorithm for CBIR

The ‘ BEP ’ Performance Chart

The ‘ Efficiency ’ Performance Chart

Thanks for Your Attention !