HAITHAM BOU AMMAR MAASTRICHT UNIVERSITY Transfer for Supervised Learning Tasks.

Slides:

Advertisements

Similar presentations

Actively Transfer Domain Knowledge Xiaoxiao Shi Wei Fan Jiangtao Ren Sun Yat-sen University IBM T. J. Watson Research Center Transfer when you can, otherwise.

Advertisements

Knowledge Transfer via Multiple Model Local Structure Mapping Jing Gao, Wei Fan, Jing Jiang, Jiawei Han l Motivate Solution Framework Data Sets Synthetic.

Statistical Machine Learning- The Basic Approach and Current Research Challenges Shai Ben-David CS497 February, 2007.

A Survey on Transfer Learning Sinno Jialin Pan Department of Computer Science and Engineering The Hong Kong University of Science and Technology Joint.

Co Training Presented by: Shankar B S DMML Lab

On-line learning and Boosting

Machine learning continued Image source:

Universal Learning over Related Distributions and Adaptive Graph Transduction Erheng Zhong †, Wei Fan ‡, Jing Peng*, Olivier Verscheure ‡, and Jiangtao.

Cos 429: Face Detection (Part 2) Viola-Jones and AdaBoost Guest Instructor: Andras Ferencz (Your Regular Instructor: Fei-Fei Li) Thanks to Fei-Fei Li,

Frustratingly Easy Domain Adaptation

Self Taught Learning : Transfer learning from unlabeled data Presented by: Shankar B S DMML Lab Rajat Raina et al, CS, Stanford ICML 2007.

Multiple Instance Learning

Sparse vs. Ensemble Approaches to Supervised Learning

Cross Domain Distribution Adaptation via Kernel Mapping Erheng Zhong † Wei Fan ‡ Jing Peng* Kun Zhang # Jiangtao Ren † Deepak Turaga ‡ Olivier Verscheure.

Unsupervised Models for Named Entity Classification Michael Collins and Yoram Singer Yimeng Zhang March 1 st, 2007.

Spatial Semi- supervised Image Classification Stuart Ness G07 - Csci 8701 Final Project 1.

Active Learning with Support Vector Machines

1 How to be a Bayesian without believing Yoav Freund Joint work with Rob Schapire and Yishay Mansour.

Data Mining with Decision Trees Lutz Hamel Dept. of Computer Science and Statistics University of Rhode Island.

Region Based Image Annotation Through Multiple-Instance Learning By: Changbo Yang Wayne State University Department of Computer Science.

Knowledge Transfer via Multiple Model Local Structure Mapping Jing Gao† Wei Fan‡ Jing Jiang†Jiawei Han† †University of Illinois at Urbana-Champaign ‡IBM.

Sparse vs. Ensemble Approaches to Supervised Learning

CS Ensembles and Bayes1 Semi-Supervised Learning Can we improve the quality of our learning by combining labeled and unlabeled data Usually a lot.

Maria-Florina Balcan A Theoretical Model for Learning from Labeled and Unlabeled Data Maria-Florina Balcan & Avrim Blum Carnegie Mellon University, Computer.

Learning from Multiple Outlooks Maayan Harel and Shie Mannor ICML 2011 Presented by Minhua Chen.

Introduction to domain adaptation

Training and future (test) data follow the same distribution, and are in same feature space.

(ACM KDD 09’) Prem Melville, Wojciech Gryc, Richard D. Lawrence

Transfer Learning From Multiple Source Domains via Consensus Regularization Ping Luo, Fuzhen Zhuang, Hui Xiong, Yuhong Xiong, Qing He.

Semi-Supervised Learning with Concept Drift using Particle Dynamics applied to Network Intrusion Detection Data Fabricio Breve Institute of Geosciences.

Active Learning for Class Imbalance Problem

Shai Ben-David University of Waterloo Towards theoretical understanding of Domain Adaptation Learning ECML/PKDD 2009 LNIID Workshop.

Machine Learning1 Machine Learning: Summary Greg Grudic CSCI-4830.

Transfer Learning Part I: Overview Sinno Jialin Pan Sinno Jialin Pan Institute for Infocomm Research (I2R), Singapore.

1 Logistic Regression Adapted from: Tom Mitchell’s Machine Learning Book Evan Wei Xiang and Qiang Yang.

Predictive Modeling with Heterogeneous Sources Xiaoxiao Shi 1 Qi Liu 2 Wei Fan 3 Qiang Yang 4 Philip S. Yu 1 1 University of Illinois at Chicago 2 Tongji.

Kernel Classifiers from a Machine Learning Perspective (sec ) Jin-San Yang Biointelligence Laboratory School of Computer Science and Engineering.

Xiaoxiao Shi, Qi Liu, Wei Fan, Philip S. Yu, and Ruixin Zhu

Regression Using Boosting Vishakh Advanced Machine Learning Fall 2006.

Universit at Dortmund, LS VIII

EVALUATING TRANSFER LEARNING APPROACHES FOR IMAGE INFORMATION MINING APPLICATIONS Surya Durbha*, Roger King, Nicolas Younan, *Indian Institute of Technology(IIT),

Transfer Learning Task. Problem Identification Dataset : A Year: 2000 Features: 48 Training Model ‘M’ Testing 98.6% Training Model ‘M’ Testing 97% Dataset.

Transfer Learning with Applications to Text Classification Jing Peng Computer Science Department.

Unsupervised Constraint Driven Learning for Transliteration Discovery M. Chang, D. Goldwasser, D. Roth, and Y. Tu.

Modern Topics in Multivariate Methods for Data Analysis.

Data Mining Practical Machine Learning Tools and Techniques Chapter 4: Algorithms: The Basic Methods Section 4.6: Linear Models Rodney Nielsen Many of.

Source-Selection-Free Transfer Learning

Transfer Learning for Image Classification Group No.: 15 Group member : Feng Cai Sauptik Dhar Sauptik.

Today Ensemble Methods. Recap of the course. Classifier Fusion

Ensemble Learning Spring 2009 Ben-Gurion University of the Negev.

Extending the Multi- Instance Problem to Model Instance Collaboration Anjali Koppal Advanced Machine Learning December 11, 2007.

Advisor : Prof. Sing Ling Lee Student : Chao Chih Wang Date :

Advisor : Prof. Sing Ling Lee Student : Chao Chih Wang Date :

Bing LiuCS Department, UIC1 Chapter 8: Semi-supervised learning.

Iterative similarity based adaptation technique for Cross Domain text classification Under: Prof. Amitabha Mukherjee By: Narendra Roy Roll no: Group:

Wenyuan Dai, Ou Jin, Gui-Rong Xue, Qiang Yang and Yong Yu Shanghai Jiao Tong University & Hong Kong University of Science and Technology.

Self-taught Clustering – an instance of Transfer Unsupervised Learning † Wenyuan Dai joint work with ‡ Qiang Yang, † Gui-Rong Xue, and † Yong Yu † Shanghai.

Machine Learning Lecture 1: Intro + Decision Trees Moshe Koppel Slides adapted from Tom Mitchell and from Dan Roth.

Web-Mining Agents: Transfer Learning TrAdaBoost R. Möller Institute of Information Systems University of Lübeck.

Bayesian Active Learning with Evidence-Based Instance Selection LMCE at ECML PKDD th September 2015, Porto Niall Twomey, Tom Diethe, Peter Flach.

Bridging Domains Using World Wide Knowledge for Transfer Learning

Machine Learning – Classification David Fenyő

Deep Learning Amin Sobhani.

Cross Domain Distribution Adaptation via Kernel Mapping

Transfer Learning in Astronomy: A New Machine Learning Paradigm

Introductory Seminar on Research: Fall 2017

Machine Learning Week 1.

CSCI B609: “Foundations of Data Science”

Overview of Machine Learning

Using Clustering to Make Prediction Intervals For Neural Networks

Presentation transcript:

HAITHAM BOU AMMAR MAASTRICHT UNIVERSITY Transfer for Supervised Learning Tasks

Motivation Model Training Data ? Test Data Assumptions: 1.Training and Test are from same distribution 2.Training and Test are in same feature space Not True in many real-world applications

Examples: Web-document Classification Model ? Physics Machine Learning Life Science

Examples: Web-document Classification Model ? Physics Machine Learning Life Science Content Change ! Assumption violated! Learn a new model

Learn new Model : 1.Collect new Labeled Data 2.Build new model Learn new Model : 1.Collect new Labeled Data 2.Build new model Reuse & Adapt already learned model !

Examples: Image Classification Model One Features Task One Task One

Examples: Image Classification Cars Motorcycles Task Two Features Task One Features Task Two Reuse Model Two

Traditional Machine Learning vs. Transfer Source Task Knowledge Target Task Learning System Different Tasks Learning System Traditional Machine LearningTransfer Learning

Questions ?

Transfer Learning Definition Notation:  Domain :  Feature Space:  Marginal Probability Distribution: with  Given a domain then a task is : Label SpaceP(Y|X)

Transfer Learning Definition Given a source domain and source learning task, a target domain and a target learning task, transfer learning aims to help improve the learning of the target predictive function using the source knowledge, where or

Transfer Definition Therefore, if either : Domain Differences Task Differences

Examples: Cancer Data Age Smoking AgeHeight Smoking

Examples: Cancer Data Task Source: Classify into cancer or no cancer Task Target: Classify into cancer level one, cancer level two, cancer level three

Quiz When doesn’t transfer help ? (Hint: On what should you condition?)

Questions ?

Questions to answer when transferring What to Transfer ? How to Transfer ? When to Transfer ? Instances ? Model ? Features ? Map Model ? Unify Features ? Weight Instances ? In which Situations

Algorithms: TrAdaBoost Assumptions:  Source and Target task have same feature space:  Marginal distributions are different: Not all source data might be helpful !

Algorithms: TrAdaBoost (Quiz) What to Transfer ? How to Transfer ? Instances Weight Instances

Algorithm: TrAdaBoost Idea:  Iteratively reweight source samples such that:  reduce effect of “bad” source instances  encourage effect of “good” source instances Requires:  Source task labeled data set  Very small Target task labeled data set  Unlabeled Target data set  Base Learner

Algorithm: TrAdaBoost Weights Initialization Hypothesis Learning and error calculation Weights Update

Questions ?

Algorithms: Self-Taught Learning Problem Targeted is : 1.Little labeled data 2.A lot of unlabeled data Build a model on the labeled data Natural scenes Car Motorcycle

Algorithms: Self-Taught Learning Assumptions:  Source and Target task have different feature space:  Marginal distributions are different:  Label Space is different:

Algorithms: Self-Taught Learning (Quiz) What to Transfer ? How to Transfer ? 1. Discover Features 2. Unify Features Features

Algorithms: Self-Taught Learning Framework:  Source Unlabeled data set:  Target Labeled data set: Natural scenes Build classifier for cars and Motorbikes

Algorithms: Self-Taught Learning Step One: Discover high level features from Source data by Regularization TermRe-construction Error Constraint on the Bases

Algorithm: Self-Taught Learning Unlabeled Data Set High Level Features

Algorithm: Self-Taught Learning Step Two: Project target data onto the attained features by Informally, find the activations in the attained bases such that: 1.Re-construction is minimized 2.Attained vector is sparse

Algorithms: Self-Taught Learning High Level Features

Algorithms: Self-Taught Learning Step Three: Learn a Classifier with the new features Target Task Source Task Learn new features (Step 1) Project target data (Step 2) Learn Model (Step 3)

Conclusions Transfer learning is to re-use source knowledge to help a target learner Transfer learning is not generalization TrAdaBoot transfers instances Self-Taught learning transfer unlabeled features

hmm