1. BINGO!: Bookmark-Induced Gathering of Information Sergej Sizov, Martin Theobald, Stefan Siersdorfer, Gerhard Weikum University of the Saarland Germany

2. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Part I System Overview

3. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Motivation Web search engines The vector space model Link analysis & authority ranking Information demands Mass queries (“madonna tour”) Needle-in-a-haystack queries (“solidarity eisler”) ?

4. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Overview (II) WWW ROOT Semistructured Data DB Core Technology Networking Workflow and E-Services Web Retrieval Data Mining XML Semistructured Data DB Core Technology Networking Workflow and E-Services Web Retrieval Data Mining XML

5. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Focused Crawling Crawler Queue Results Classifier

6. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Focused Crawling (2) Key aspects: the mathematical model and algorithm that are used for the classifier (e.g., Naive Bayes vs. SVM) the feature set upon which the classifier makes its decision (e.g., all terms vs. a careful selection of the "most discriminative" terms) the quality of the training data

7. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Focused Crawling (3) Crawler Re-Training Queue SVM Classifier H I T S SVM Archetypes Hubs Authorities

8. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information System Overview Crawler Document Analyzer Feature Selection Classifier Adaptive Re-Training Link Analyzer URL Queue Docs Feature Vectors Ontology Index Training Docs Book- marks Hubs & Authorities W W W......................

9. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Part II System Components

10. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Focus Manager Focusing strategies Depth-first (df): Breadth-first (bf): Strong focus (learning phase) Soft focus (harvesting phase) Tunneling

11. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Focus Manager (2) Sample URL Prioritization confidence = 0.3 topic=A 1 2 3 56 4 78910 confidence = 0.4 topic=A confidence = 0.85 topic=A confidence = 0.6 topic=B DF strong order: 1–2–5–3–6–4–9–10.. BF strong order:1–2–5–3–4–6–9–10.. DF soft order: 1–2–5–6–3–7–8–4–9–10.. BF soft order:1–2–5–3–6–4–7–8–9–10..

12. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Feature Selection Mutual Information (MI) criterion: A is the number of documents in Vj containing Xi, B is the number of documents with Xi in "competitive" topics C is the number of documents in Vj without Xi N is the overall number of documents in Vj and its competitive topics Time complexity: O(n)+O(mk) for n documents, m terms and k competitive topic.

13. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Feature Selection (2) Top features for the topic “DB Core Technology" with regard to tf*idf (left) and MI (right) tf*idf score MI weight below 1.4927 storag 0.1428 et 1.2778 modifi 0.1258 graph 1.2446 sql 0.1209 involv 1.0406 disk 0.1179 accomplish 0.9491 pointer 0.1150 backup 0.8613 deadlock 0.1001 command 0.8567 redo 0.1001 exactli 0.8112 implement 0.0963 feder 0.7764 correctli 0.0911 histor 0.6822 size 0.0911

14. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Classifier δ ¬ V V ? δ x1x1 x2x2 Training: Compute Classification: Check Input: n training vectors with components (x 1,..., x m, C) and C = +1 or C = -1 σ

15. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Hierarchical Classification Recursive classification by the taxonomy tree. Decisions based on topic-specific feature spaces Semistructured Data DB Core Technology ROOT Networking Workflow and E-Services Web Retrieval Data Mining XML 0.8 0.1 -0.5 0.2 -0.70.2 Semistructured Data 0.4 Data Mining

16. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Link Analysis The HITS Algorithm Iterative approximation of the dominant Eigenvectors of A T A and AA T :  Web graph G = (S, E) ?

17. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Retraining based on Archetypes Two sources of potential archetypes: Link analysis → N auth good authorities SVM classifier → N conf best-rated docs To avoid the "topic drift" phenomenon: the classification confidence of an archeteype must be higher than the mean confidence of the previous iteration's training documents.

18. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Retraining (2) if {at least one topic has more than Nmax positive documents or all topics have more than Nmin positive documents} { for each topic Vi { link analysis using all documents of Vi as base set; hubs (Vi) = top Nhub documents; authorities (Vi) = top Nauth documents; sort docs of Vi in descending order of confidence; archetypes (Vi) = top Nconf from confidence ranking  auth (Vi); remove from archetypes(Vi) all docs with confidence < mean of the previous iteration; archetypes (Vi) = archetypes(Vi)  bookmarks (Vi) }; for each topic Vi { perform feature selection based on archetypes (Vi); re-compute SVM decision model for Vi } re-initialize URL queue using hubs (Vi) to URL queue } }

19. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Part III Evaluation

20. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Testbed Bookmarks: homepages of researchers in the various areas Leaf nodes were filled with 9 -15 bookmarks The total training data comprised 81 documents Focused crawl: Crawling time: 6h Visited: 11000 pages (1800 hosts), link distances 1 – 7 4230 positively classified (675 different hosts) Entire crawl: 7 iterations with re-training. Parameters: Nmin = 50, Nmax = 200, Nhub = 50, Nauth = 20, Nconf = 20. Feature selection: MI criterion, best 300 for each topic; Authority ranking: HITS algorithm

21. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Crawling Precision IterationData MiningXML Entire ontology 10,980,940,98 2 0,930,98 30,990,970,96 40,870,990,97 50,900,950,96 60,98 0,95 70,940,970,96

22. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Crawling Precision (2) IterationBINGO! with focusing, no MI no focusing, no MI 10,980.890.84 20,980.86 30,960.750.79 40,970.780.73 50,960.550.63 60,950.540.52 70,960.630.50

23. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Crawling Recall IterationData MiningXML Entire ontology 1307117807 25523431615 310923962436 415534423245 520715624072 626786274898 730277015715

24. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Archetype Selection Topic „Data Mining“: URLSVM confidence http://www.it.iitb.ernet.in/~sunita/it642/1.35 http://www.research.microsoft.com/research/datamine/1.31 http://www.acm.org/sigs/sigkdd/explorations/1.28 http://robotics.stanford.edu/users/ronnyk/1.24 http://www.kdnuggets.com/index.html1.18 http://www.wizsoft.com/1.16 http://www.almaden.ibm.com/cs/people/ragrawal/1.14 http://www.cs.sfu.ca/~han/DM_Book.html1.14 http://db.cs.sfu.ca/sections/publication/kdd/kdd.html1.14 http://www.cs.cornell.edu/johannes/publications.html0.78

25. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Archetype Selection (2) IterationData MiningXML Entire ontology 110 (1)5 (0)24 (4) 210 (2)11 (0)27 (5) 39 (1)17 (1)32 (4) 48 (0)7 (0)29 (3) 522 (2)26 (2)62 (8) 643 (4)12 (2)77 (10) 738 (0)13 (1)75 (8)

26. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Feature Selection Topic „Data Mining“: Feature MI weight mine 0.178 knowledg 0.122 olap 0.106 frame 0.086 pattern 0.066 genet 0.061 discov 0.053 miner 0.053 cluster 0.049 dataset 0.044

27. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Future Work Large-scale experiments (portal generator) Annotation and semantic classification of HTML sources (e.g. transformation of HTML to XML for improved data management, detection of “information units”) Advanced feature construction and feature selection algorithms Fault tolerance on document collections with wrong samples, adaptive re-training... ?

28. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information

29. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Crawler Key features: asynchronous DNS lookups with caching multiple download attempts advanced duplicate recognition following multiple redirects advanced topic-balanced URL-queue document filters for common datatypes focusing strategies

30. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Classifier (II) Training: Find hyperplane that separates the samples with maximum margin (quadratic optimization task): Classification: Test unlabeled vector y for Very efficient runtime in O(m)

31. Sergej Sizov BINGO!: Bookmark-Induced Gathering of Information Related Work General-purpose crawling Focused crawling Authority ranking Classification of Web documents Web ontologies