1. www.sharon-it.com1 Refining – Finding Words/expanding Taly Sharon taly@sharon-it.com sharont@alum.mit.edu

2. www.sharon-it.com2 Contents Expanding/Learning terms Categorization/Clustering engines Google Suggest SurfWax FocusWords When you don’t know where to start

3. www.sharon-it.com3 Make Longer Queries Yahoo Harvest Digital Average Search Terms per Query Overall Experienced

4. www.sharon-it.com4 Adding Words Holocaust23,200,000Holocaust holocaust memorial 836,000holocaust memorial holocaust memorial budapest 42,300holocaust memorial budapest holocaust memorial budapest danube 4,910holocaust memorial budapest danube holocaust memorial budapest danube promenade 692holocaust memorial budapest danube promenade

5. www.sharon-it.com5 Classification/Categorization Classification: the process of deciding the appropriate category for a given document. Examples: –deciding what newsgroup an article belongs to. –what folder an email message should be directed to. –what is the general topic of an essay.

6. www.sharon-it.com6 Clustering The process of automatically grouping documents.

7. www.sharon-it.com7 Search Categorization/Clustering The result documents are ordered according to categories. The searcher can select the relevant category to display the related documents. Examples: –Vivisimo/Clusty –Excite –Teoma –Exalead

8. www.sharon-it.com8 Clusty

9. www.sharon-it.com9 Excite

10. www.sharon-it.com10 Ask

11. www.sharon-it.com11 Exalead

12. www.sharon-it.com12 Google Suggest As you type – you get query suggestions and number of results per query.

13. www.sharon-it.com13 Google Suggest (2)

14. www.sharon-it.com14 Google Suggest

15. www.sharon-it.com15

16. www.sharon-it.com16 Yahoo Search Assist

17. www.sharon-it.com17 SurfWax FocusWords SurfWax has an option “Focus” This option invokes the FocusWords mechanism You get suggestions to make your query: –Broader –Similar –Narrower http://www.surfwax.com

18. www.sharon-it.com18 SurfWax FocusWords

19. www.sharon-it.com19 When you don’t know how to start Reverse Dictionary Glossaries and Dictionaries Taxonomy/Folksonomy Pearl Culturing Analyzing pages Finding similar pages –Google’s related: –Alexa www.alexa.comwww.alexa.com

20. www.sharon-it.com20 Reverse Dictionary OneLook reverse dictionary: http://www.onelook.com/reverse- dictionary.shtml http://www.onelook.com/reverse- dictionary.shtml Example: “bird of prey” => raptor Example: economical measure of a nation’s wealth => Gross Domestic Product

21. www.sharon-it.com21

22. www.sharon-it.com22 Glossaries and Dictionaries Google search: – –glossary OR thesaurus OR dictionary OR taxonomy Example 1: agriculture glossary –http://www.cnie.org/nle/AgGlossary/AgGlossary.htmhttp://www.cnie.org/nle/AgGlossary/AgGlossary.htm –http://www.cahe.nmsu.edu/news/aggloss.htmlhttp://www.cahe.nmsu.edu/news/aggloss.html –http://agriculture.house.gov/info/glossary.htmlhttp://agriculture.house.gov/info/glossary.html Example 2: agriculture thesaurus –http://agclass.nal.usda.gov/agt/agt.shtmlhttp://agclass.nal.usda.gov/agt/agt.shtml –http://www.fao.org/aims/ag_intro.htm (multilingual)http://www.fao.org/aims/ag_intro.htm http://www.glossarist.com –http://www.glossarist.com/glossaries/business/primary- industry/agriculture.asphttp://www.glossarist.com/glossaries/business/primary- industry/agriculture.asp

23. www.sharon-it.com23

24. www.sharon-it.com24 Taxonomy/Folksonomy Taxonomies –Found via directory search (example DMOZ): http://search.dmoz.org/cgi- bin/search?search=taxonomy http://search.dmoz.org/cgi- bin/search?search=taxonomy –www.taxonomywarehouse.com (paid)www.taxonomywarehouse.com Folksonomy –Use tags in Technorati www.technorati.comwww.technorati.com Delicious www.del.icio.uswww.del.icio.us

25. www.sharon-it.com25 del.icio.us

26. www.sharon-it.com26 del.icio.us

27. www.sharon-it.com27 Pearl Culturing What to do when you don’t have the category nor the right keywords? Find one good relevant website Look it up in directories You will find: –the category/main keywords –authoritative websites Useful search engine: ExaleadExalead

28. www.sharon-it.com28 Analyze Pages Distilling: what is problematic in a bad page? –what is wrong? Is there an interfering keyword/term appearing. –Remove interfering terms (using “-”). Identifying clues and patterns in a good page. –Read the document, what are the clues? –Look for new keywords, word combinations and other things differentiating between it to non-authoritative documents. –Use frequency counter: http://www.wordcounter.com/ http://www.georgetown.edu/faculty/ballc/webtools/web_freq s.htmlhttp://www.georgetown.edu/faculty/ballc/webtools/web_freq s.html

29. www.sharon-it.com29 Frequency Counter

30. www.sharon-it.com30

31. www.sharon-it.com31 Wordcounter

32. www.sharon-it.com32

33. www.sharon-it.com33 References http://hacks.oreilly.com/pub/ht/2 www.batesinfo.com http://www.searchtools.com/info/classifier s.htmlhttp://www.searchtools.com/info/classifier s.html

34. www.sharon-it.com34 Exercises 1.How are bad user interfaces called (hint: try Google suggest) 2.Reverse dictionary a.Find relevant keywords for chemistry b.What is the terminology for when menstruation stops? c.How was the separation between the west and the soviet union called? 3.What are the related terms to Competitive Intelligence? 4.Check suggestions from Google Suggest for a query starting with biofuel. 5.Using SurfWax, learn options to focus or broaden the query: biodiesel. 6.Identify the most relevant terms in the website: www.uspto.govwww.uspto.gov 7.Identify the most relevant terms in the Biofuel Wikipedia entry http://en.wikipedia.org/wiki/Biofuel. http://en.wikipedia.org/wiki/Biofuel 8.Search in Onelook reverse dictionary and in other glossaries terms: fuel, natural energy, geothermal, and other terms. Look at the results.