Posner and Keele; Rosch et al.. Posner and Keele: Two Main Points Greatest generalization is to prototype. –Given noisy examples of prototype, prototype.

Slides:



Advertisements
Similar presentations
Clustering. How are we doing on the pass sequence? Pretty good! We can now automatically learn the features needed to track both people But, it sucks.
Advertisements

Sam Hastings University of North Texas School of Library and Information Sciences User Input into Image Retrieval Design.
Yansong Feng and Mirella Lapata
Pseudo-Relevance Feedback For Multimedia Retrieval By Rong Yan, Alexander G. and Rong Jin Mwangi S. Kariuki
Announcements •Homework due Tuesday. •Office hours Monday 1-2 instead of Wed. 2-3.
Mathematics SL Internal Assessment: Type II. Portfolio Type I: Investigation (done last year) Type II: Modeling.
CSCTR Session 11 Dana Retová.  Start bottom-up  Create cognition based on sensori-motor interaction ◦ Cohen et al. (1996) – Building a baby ◦ Cohen.
Information Professionals and Learning Object Repositories … more than just metadata quality … Sarah Currier Stòr Cùram Project Librarian JISC X4L Repository.
Data Mining Methodology 1. Why have a Methodology  Don’t want to learn things that aren’t true May not represent any underlying reality ○ Spurious correlation.
Chapter 7 Knowledge Terms: concept, categorization, prototype, typicality effect, object concepts, rule-governed, exemplars, hierarchical organization,
Data preprocessing before classification In Kennedy et al.: “Solving data mining problems”
Relational Learning with Gaussian Processes By Wei Chu, Vikas Sindhwani, Zoubin Ghahramani, S.Sathiya Keerthi (Columbia, Chicago, Cambridge, Yahoo!) Presented.
Self Taught Learning : Transfer learning from unlabeled data Presented by: Shankar B S DMML Lab Rajat Raina et al, CS, Stanford ICML 2007.
Knowledge ß How do we organize our knowledge? ß How do we access our knowledge? ß Do we really use categories?
Chapter 1: Introduction to Pattern Recognition
Posner & Keele Demo. Prototype Low Distortions High Distortions Random Patterns.
Concepts and Categories. Functions of Concepts By dividing the world into classes of things to decrease the amount of information we need to learn, perceive,
Concepts and Categories. Functions of Concepts By dividing the world into classes of things to decrease the amount of information we need to learn, perceive,
Knowing Semantic memory.
Natural Categories Hierarchical organization of categories –Superordinate (e.g., furniture) –Basic-level (e.g., chair) –Subordinate (e.g., armchair) Rosch.
Pattern Recognition Pattern - complex composition of sensory stimuli that the human observer may recognize as being a member of a class of objects Issue.
MSRC Summer School - 30/06/2009 Cambridge – UK Hybrids of generative and discriminative methods for machine learning.
From Prototypes to Abstract Ideas A review of On The Genesis of Abstract Ideas by MI Posner and SW Keele Siyi Deng.
Multi-voxel Pattern Analysis (MVPA) and “Mind Reading” By: James Melrose.
Categorization  How do we organize our knowledge?  How do we retrieve knowledge when we need it?
ART AND PERCEPTUAL EXPERTISE. Structure Applying principles of perception to art-making Why study representational drawing? How to quantify drawing ability.
Warm Up Answers 3. YYURYYUBICURYY4ME Coffin
General Knowledge Dr. Claudia J. Stanny EXP 4507 Memory & Cognition Spring 2009.
Copyright R. Weber Machine Learning, Data Mining ISYS370 Dr. R. Weber.
Classification. An Example (from Pattern Classification by Duda & Hart & Stork – Second Edition, 2001)
© Negnevitsky, Pearson Education, Will neural network work for my problem? Will neural network work for my problem? Character recognition neural.
1 Thinking in Objects and Classes © Datasim Education BV, 2010 All rights reserved. No part of this book may be reproduced, stored in a database or retrieval.
PSY 323 – COGNITION Chapter 9: Knowledge.  Categorization ◦ Process by which things are placed into groups  Concept ◦ Mental groupings of similar objects,
Data Mining – Intro. Course Overview Spatial Databases Temporal and Spatio-Temporal Databases Multimedia Databases Data Mining.
Data Reduction via Instance Selection Chapter 1. Background KDD  Nontrivial process of identifying valid, novel, potentially useful, and ultimately understandable.
Category Structure Psychology 355: Cognitive Psychology Instructor: John Miyamoto 05/20 /2015: Lecture 08-2 This Powerpoint presentation may contain macros.
What is a concept? Part of semantic memory (vs. episodic memory) A class of items that seem to belong together –‘dog’, ‘balloon’, ‘terrorist’ (things)
Computer Vision Group University of California Berkeley On Visual Recognition Jitendra Malik UC Berkeley.
Learning Analytics: Process & Theory March 24, 2014.
 Classification 1. 2  Task: Given a set of pre-classified examples, build a model or classifier to classify new cases.  Supervised learning: classes.
Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.
Categories What are categories? The internal structure of categories Rule-based approaches Similarity-based approaches Theory-based approaches.
Cognitive Processes PSY 334 Chapter 5 – Meaning-Based Knowledge Representation.
Image Classification over Visual Tree Jianping Fan Dept of Computer Science UNC-Charlotte, NC
The Emergent Structure of Semantic Knowledge
Topic by Topic Performance of Information Retrieval Systems Walter Liggett National Institute of Standards and Technology TREC-7 (1999)
RESEARCH METHODS IN INDUSTRIAL PSYCHOLOGY & ORGANIZATION Pertemuan Matakuliah: D Sosiologi dan Psikologi Industri Tahun: Sep-2009.
PSY 402 Theories of Learning Chapter 8 – Stimulus Control How Stimuli Guide Instrumental Action.
Concepts And Generic Knowledge
A PAC-Bayesian Approach to Formulation of Clustering Objectives Yevgeny Seldin Joint work with Naftali Tishby.
Lecture 8 – Categories 1 great detail is needed for planning & executing current responses some detail about context of new learning can be emcoded with.
Bar Graphs Used to compare amounts, or quantities The bars provide a visual display for a quick comparison between different categories.
Lesson 3 Measurement and Scaling. Case: “What is performance?” brandesign.co.za.
PatReco: Model and Feature Selection Alexandros Potamianos Dept of ECE, Tech. Univ. of Crete Fall
Cluster Analysis This work is created by Dr. Anamika Bhargava, Ms. Pooja Kaul, Ms. Priti Bali and Ms. Rajnipriya Dhawan and licensed under a Creative Commons.
Chapter 9 Knowledge. Some Questions to Consider Why is it difficult to decide if a particular object belongs to a particular category, such as “chair,”
What Is Cluster Analysis?
CSC2535: Computation in Neural Networks Lecture 11 Extracting coherent properties by maximizing mutual information across space or time Geoffrey Hinton.
Statistical Data Analysis
Lexical interface 4 Oct 30, 2017 – DAY 26
پرسشنامه کارگاه.
Strengths and Weaknesses
CS 188: Artificial Intelligence Fall 2008
Generalization in deep learning
Statistical Data Analysis
The Network Approach: Mind as a Web
Classic categorization models
Using Link Information to Enhance Web Page Classification
Combining Noisy Measurements
Advisor: Dr.vahidipour Zahra salimian Shaghayegh jalali Dec 2017
Presentation transcript:

Posner and Keele; Rosch et al.

Posner and Keele: Two Main Points Greatest generalization is to prototype. –Given noisy examples of prototype, prototype is as well classified as examples. Prototype isn’t only thing learned. –Amount of variability in training examples influences representations.

How the Experiments Work Generate prototype. Then distortions. Train subject to know one level of distortions. Judge ability to classify –Training set. –More distorted ones –Equally distorted but different. –Prototypes. Matlab

From Palmeri and Flanery

Conclusions of Experiment 3 Train on distorted images. Performance as good on prototype as training set. Worse on less distorted images, of equal avg. distance to training set as prototype. Even worse on new of equal distortion as training set. Representation favors prototypes.

Conclusions of Experiment 1&2 Train on a) less or b) more distorted versions. Test on even more distorted. Better if you trained on more distorted. Representation is more than prototypes.

Questions What is learned? –Prototype? Not just prototype. Examples plus prototype. –Distribution? Gaussian? Seems like examples mattered. Could distribution overfit the data? –Examples + Weighted distances.

Is this domain sufficiently realistic? –Are dots just dots? Maybe shape is important. This might mean forming links between dots, which noise disrupts. Perhaps exps 1&2 have more to do with set of shapes learned than variance in features. –If real categories have structure, does this domain have too little structure?

Rosch Categories are in the world. –Objects have structure, correlations of attributes. Basic categories are those with greatest cue validity. –Cue predicts category. –Superordinates don’t have many attributes in common. –Subordinates share many attributes with other subordinates. –Why cue validity?

Experiments 1-4 Main points –Categories have shared properties –Basic categories are where most of these first appear. Experiments 1.Collect attribute lists. Example: # common attributes for fruit: superordinate – 3, basic – 8.3, subordinate – Document actions with objects. Similar pattern of attributes. 3.Similarity of shape. 4.Average shape. Basic categories have similar shape; no evidence subordinates are less similar.

Experiments 5-12 Main point –Basic categories are psychologically real. Experiments 5 & 6 Prime with category name then compare/detect with quick exposure. 7 Category name is query compared to image, not prime. –1 st task where performance is best for basic categories. 8 & 9 Children sort into basic categories earlier. 10 People name with basic categories. 11 Children learn these words first. 12 ASL is missing many subordinate and superordinate words.

Conclusions Is this belaboring the obvious? –Well, it wasn’t obvious. –Convergence of evidence more convincing? Categorization is for inference. –This seems like a very modern view. Different kinds of attributes common at basic level. –This is what makes visual classification possible (if true). Are categories completely in the world? –May depend on extent of knowledge. –Context.