Incorporating Game Theory in Feature Selection for Text Categorization Nouman Azam and JingTao Yao Department of Computer Science University of Regina.

Slides:



Advertisements
Similar presentations
Introduction to Game Theory
Advertisements

Module 4 Game Theory To accompany Quantitative Analysis for Management, Tenth Edition, by Render, Stair, and Hanna Power Point slides created by Jeff Heyl.
Contingency Tables Chapters Seven, Sixteen, and Eighteen Chapter Seven –Definition of Contingency Tables –Basic Statistics –SPSS program (Crosstabulation)
Chapter Twenty-Eight Game Theory. u Game theory models strategic behavior by agents who understand that their actions affect the actions of other agents.
The Competitive Effects of Ownership of Financial Transmission Rights in a Deregulated Electricity Industry Manho Joung and Ross Baldick Electrical and.
Chapter 6 Game Theory © 2006 Thomson Learning/South-Western.
MIT and James Orlin © Game Theory 2-person 0-sum (or constant sum) game theory 2-person game theory (e.g., prisoner’s dilemma)
Multiple Criteria Decision Analysis with Game-theoretic Rough Sets Nouman Azam and JingTao Yao Department of Computer Science University of Regina CANADA.
Game Theory Advertising Example 1. Game Theory What is the optimal strategy for Firm A if Firm B chooses to advertise? 2.
© 2015 McGraw-Hill Education. All rights reserved. Chapter 15 Game Theory.
Peter Lam Discrete Math CS. Outline  Use game theory to solve strictly determining games  Non strictly games  Create models for games  Find optimal.
4 Why Should we Believe Politicians? Lupia and McCubbins – The Democratic Dilemma GV917.
Linear Model Incorporating Feature Ranking for Chinese Documents Readability Gang Sun, Zhiwei Jiang, Qing Gu and Daoxu Chen State Key Laboratory for Novel.
Games What is ‘Game Theory’? There are several tools and techniques used by applied modelers to generate testable hypotheses Modeling techniques widely.
Economics 202: Intermediate Microeconomic Theory 1.HW #6 on website. Due Thursday. 2.No new reading for Thursday, should be done with Ch 8, up to page.
An Introduction to Game Theory Part I: Strategic Games
Chapter 6 © 2006 Thomson Learning/South-Western Game Theory.
1 Business System Analysis & Decision Making - Lecture 5 Zhangxi Lin ISQS 5340 July 2006.
Algorithmic Game Theory - Basic Solution Concepts and Computational Issues Éva Tardos and Vijay V. Vazirani Presentation Reiknirit, rökfræði og reiknanleiki.
Satisfaction Equilibrium Stéphane Ross. Canadian AI / 21 Problem In real life multiagent systems :  Agents generally do not know the preferences.
Eponine Lupo.  Game Theory is a mathematical theory that deals with models of conflict and cooperation.  It is a precise and logical description of.
A camper awakens to the growl of a hungry bear and sees his friend putting on a pair of running shoes, “You can’t outrun a bear,” scoffs the camper. His.
Sampling & External Validity
Chapter Twenty-Eight Game Theory. u Game theory models strategic behavior by agents who understand that their actions affect the actions of other agents.
Lectures in Microeconomics-Charles W. Upton Game Theory.
CS 589 Information Risk Management 23 January 2007.
Introduction to experimental errors
Abstract Though previous explorations of equilibria in game theory have incorporated the concept of error-making, most do not consider the possibility.
PRISONER’S DILEMMA By Ajul Shah, Hiten Morar, Pooja Hindocha, Amish Parekh & Daniel Castellino.
An Introduction to Black-Box Complexity
Game Theory.
Review of Probability and Binomial Distributions
Decision Tree Models in Data Mining
1 of 27 PSYC 4310/6310 Advanced Experimental Methods and Statistics © 2013, Michael Kalsher Michael J. Kalsher Department of Cognitive Science Adv. Experimental.
Fundamentals of Statistical Analysis DR. SUREJ P JOHN.
Economics for Business II Day 12 – Some Macro Numbers and Answers Dr. Andrew L. H. Parkes “A Macroeconomic Understanding for use in Business” 卜安吉.
Game Theory The Prisoner’s Dilemma Game. “Strategic thinking is the art of outdoing an adversary, knowing that the adversary is trying to do the same.
A Game-Theoretic Approach to Strategic Behavior. Chapter Outline ©2015 McGraw-Hill Education. All Rights Reserved. 2 The Prisoner’s Dilemma: An Introduction.
Classifying Attributes with Game- theoretic Rough Sets Nouman Azam and JingTao Yao Department of Computer Science University of Regina CANADA S4S 0A2
Some Analysis of Coloring Experiments and Intro to Competitive Contagion Assignment Prof. Michael Kearns Networked Life NETS 112 Fall 2014.
Querying Structured Text in an XML Database By Xuemei Luo.
Q 5-2 a. E = Efficiency score wi = Weight applied to i ’s input and output resources by the composite hospital.
Feature selection LING 572 Fei Xia Week 4: 1/29/08 1.
Game theory & Linear Programming Steve Gu Mar 28, 2008.
DISCRIMINATIVE TRAINING OF LANGUAGE MODELS FOR SPEECH RECOGNITION Hong-Kwang Jeff Kuo, Eric Fosler-Lussier, Hui Jiang, Chin-Hui Lee ICASSP 2002 Min-Hsuan.
Finite Iterated Prisoner’s Dilemma Revisited: Belief Change and End Game Effect Jiawei Li (Michael) & Graham Kendall University of Nottingham.
Enhancing Cluster Labeling Using Wikipedia David Carmel, Haggai Roitman, Naama Zwerdling IBM Research Lab (SIGIR’09) Date: 11/09/2009 Speaker: Cho, Chin.
Codeville Revision control computer program – Written by Ross Cohen with some design by Bram Cohen – Use Python – Use merging algorithm called “Codeville.
Two Variable Statistics Introduction To Chi-Square Test for Independence.
Class Imbalance in Text Classification
Introduction to Game Theory Presented by 蘇柏穎 2004/12/9 2004/12/9.
Empirical Aspects of Plurality Elections David R. M. Thompson, Omer Lev, Kevin Leyton-Brown & Jeffrey S. Rosenschein COMSOC 2012 Kraków, Poland.
1 Tom Edgar’s Contribution to Model Reduction as an introduction to Global Sensitivity Analysis Procedure Accounting for Effect of Available Experimental.
Lec 23 Chapter 28 Game Theory.
Game Theory Day 10.
Q 2.1 Nash Equilibrium Ben
Contents of the Talk Preliminary Materials Motivation and Contribution
Microeconomics Course E
Inferential Statistics
Tools for Decision Analysis: Analysis of Risky Decisions
Project BEST Game Theory.
R. E. Wyllys Copyright 2003 by R. E. Wyllys Last revised 2003 Jan 15
Communication Complexity as a Lower Bound for Learning in Games
Game Theory Day 3.
Game Theory Solutions 1 Find the saddle point for the game having the following payoff table. Use the minimax criterion to find the best strategy for.
Molly W. Dahl Georgetown University Econ 101 – Spring 2009
Game Theory Day 2: More Simple Games.
Lecture Game Theory.
COMPARING VARIABLES OF ORDINAL OR DICHOTOMOUS SCALES: SPEARMAN RANK- ORDER, POINT-BISERIAL, AND BISERIAL CORRELATIONS.
Game Theory: The Nash Equilibrium
Presentation transcript:

Incorporating Game Theory in Feature Selection for Text Categorization Nouman Azam and JingTao Yao Department of Computer Science University of Regina CANADA S4S 0A2

Acknowledgement Thanks to Dr. Dominik Slezak for presenting this work on our behalves. J T Yao Incorporating Game Theory in Feature Selection for TC 1

J T Yao Incorporating Game Theory in Feature Selection for TC 2 Introduction Feature selection. –Selecting a subset of important features. Text categorization. –Assigning textual documents to predefined categories. Text categorization and high imbalance. –The number of instances in categories varies significantly. –Importance of features vary accordingly. –Hard to apply feature selection techniques directly.

J T Yao Incorporating Game Theory in Feature Selection for TC 3 Feature Selection in Text Categorization Assigning positive or negative values to features. –The values indicate importance of features. –Positive values indicates importance for positive category. –Negative values indicates importance for negative category.

J T Yao Incorporating Game Theory in Feature Selection for TC 4 Existing Feature Selection Approaches One sided approaches. –Selecting features with high positive values. Two sided approaches. –Selecting features with high absolute value. Explicit combinational approach. –Selecting features with high positive or negative values generated by a one sided method.

J T Yao Incorporating Game Theory in Feature Selection for TC 5 Limitations of Existing Approaches Favours features indicative of either positive or negative category. –There may be features that indicates both categories. –It is plausible to include such features in some applications. Dilemma: positive features vs. negative features. However, we need to find a way to select these features. –Incorporating Game Theory in Feature Selection to deal with this issue.

J T Yao Incorporating Game Theory in Feature Selection for TC 6 Incompetence of Existing Approaches An Example. –Considering an imbalanced data set with 10 documents in positive and 100 in negative categories. –There are eight words in these documents. Considering four methods. –One sided approaches: correlation coefficient and GSS coefficient. –Two sided approaches: chi square and gini index.

J T Yao Incorporating Game Theory in Feature Selection for TC 7 Probabilities of Words in Categories Meaning of probabilities. –Referring to fraction of documents from a category containing the word.

J T Yao Incorporating Game Theory in Feature Selection for TC 8 Scores of Words

J T Yao Incorporating Game Theory in Feature Selection for TC 9 Rankings of Words Observations –w7 and w8 are not considered as important by any method. –They will be ignored, if we select three features.

J T Yao Incorporating Game Theory in Feature Selection for TC 10 A Simple Solution Using an explicit combinational approach. –Probabilities in respective categories are used for rankings. –The new rankings. –Considering positive category twice as important as negative category. We may select w1, w8 and w4. We note that w8 which indicates both categories is selected.

J T Yao Incorporating Game Theory in Feature Selection for TC 11 A feature may be considered as good for, –Positive category, –Negative category, –Both of them, or –Neither of them. We are trying to find a systematic method, that finds the best decision choice. Game theory may be useful for formulating such method. Conclusion from the Simple Solution

J T Yao Incorporating Game Theory in Feature Selection for TC 12 Game theory is a core subject in decision sciences. –Prisoners Dilemma. A classical example in Game Theory. Game Theory

J T Yao Incorporating Game Theory in Feature Selection for TC 13 Formulating problems with Game Theory requires to, –Identify the player set. –Identify the strategy set. –Determine the payoff functions. –Implement a competition. Feature Selection with Game Theory

J T Yao Incorporating Game Theory in Feature Selection for TC 14 Two players were selected. The players represents positive and negative category. –The player C+ represents positive category. –The player C- represents negative category. Each player determine the features’ utility for its respective category. The Player Set

J T Yao Incorporating Game Theory in Feature Selection for TC 15 Two actions were formulated for each player. –Action a1 for keeping a feature. –Action a2 for discarding a feature. For Differentiating the actions of the two players – denote the actions of C+. – denote the actions of C-. The Strategy Set

J T Yao Incorporating Game Theory in Feature Selection for TC 16 The Payoff Functions Notation for a payoff function. –Payoff of player i, performing action j, given action k of opponent is denoted as. The payoff sets.

J T Yao Incorporating Game Theory in Feature Selection for TC 17 Defining the Payoff Functions Let cat and cat represents positive and negative categories. –A and B represent the number of documents from cat and cat containing word w. –C and D represent the number of documents from cat and cat that does not contain w. Conditional probabilities of w in cat and cat are

J T Yao Incorporating Game Theory in Feature Selection for TC 18 Payoffs Functions for Players Both players deciding to keep a feature. The payoffs of players are calculated as average.. Both players deciding to discard a feature. –The payoffs are calculated as. C+ deciding to keep while C- discard. –The payoffs are and respectively. C+ deciding to discard while C- keep. –The payoffs are and respectively.

J T Yao Incorporating Game Theory in Feature Selection for TC 19 Actions Scenarios for Players

J T Yao Incorporating Game Theory in Feature Selection for TC 20 Implementing Competition Representing the game in a payoff table. –Determining Nash equilibrium for finding the actions of players.

J T Yao Incorporating Game Theory in Feature Selection for TC 21 Selected Features Set Defining two features sets. –FS+ as set of features representing positive category. –FS- as set of features representing negative category. The game will determine the inclusion or exclusion of features in these sets. –Final selected features is the union of FS+ and FS-.

J T Yao Incorporating Game Theory in Feature Selection for TC 22 A Demonstrative Example Considering earlier example.

J T Yao Incorporating Game Theory in Feature Selection for TC 23 The bold cells represents Nash equilibrium. –Considering w1. The actions of players in equilibrium are for C+ and for C-. The actions of players decides to include w1 in FS+. Payoff Tables for Words

J T Yao Incorporating Game Theory in Feature Selection for TC 24 Payoff Tables for Words

J T Yao Incorporating Game Theory in Feature Selection for TC 25 Result of implementing game for features. –FS+ = {w1, w7, w8} and FS- = {w4, w7,w8}. –FS = {w1, w4, w7, w8}. Observation. –The words w7 and w8 are selected. –The suggested approach selects features, that indicates both categories. Selected Features

J T Yao Incorporating Game Theory in Feature Selection for TC 26 Conclusion Limitations of existing approaches. –Preference is given to features indicating positive or negative category. The may not be suitable for selecting features indicating both categories. Game theory based method. –Implements a game between categories. Importance of the method. –Useful in selecting features indicating positive category, negative category or both of them.