INFORMATION RETRIEVAL VECTOR SPACE MODEL IN-DEPTH PART 2 Thomas Tiahrt, MA, PhD CSC492 – Advanced Text Analytics

Inverse Document Frequency (IDF) 2

Inverse Document Frequency 3

4

Document/Term Matrix 5

Weight Factor Computation 6

VSM Pros and Cons 7  Benefits  Documents can be ordered by importance  Threshold display limits are easy to honor  Documents similar to the query retrieved early can be used for relevance feedback  Drawbacks  Orthogonal terms assumption is false  Some vector operations have no theoretical justification

References 8 Sources: Introduction to Information Retrieval by Christopher Manning, Prabhakar Raghavan and Hinrich Schütze, The Cambridge University Press Automatic Text Processing Gerard Salton, Addison-Wesley Publishing.

The end of the second in-depth description of the vector space model slide show has come. End of the Slides 9