Presentation is loading. Please wait.

Presentation is loading. Please wait.

Qing-Cai Chen; Xiao-Hong Yang; Xiao-Long Wang Machine Learning and Cybernetics (ICMLC), 2011 International Conference on Year: 2011, Page(s): 1878 – 1883.

Published byWilfred Woods Modified over 9 years ago

Similar presentations

Presentation on theme: "Qing-Cai Chen; Xiao-Hong Yang; Xiao-Long Wang Machine Learning and Cybernetics (ICMLC), 2011 International Conference on Year: 2011, Page(s): 1878 – 1883."— Presentation transcript:

1 Qing-Cai Chen; Xiao-Hong Yang; Xiao-Long Wang Machine Learning and Cybernetics (ICMLC), 2011 International Conference on Year: 2011, Page(s): 1878 – 1883 1 Speaker : Chang, Kun-Hsiang

2 Outline  Abstract  P2P based passive web crawling system  Crawler server registering  Content updated notification  Download updated content by P2P network  Website discovering 2

3 Abstract  This paper proposes an innovative client/server based web crawling system.  main benefits : Capability of timely management web changes for a crawle. The saving of website bandwidth resources. The capability of downloading large files or multimedia content features. The capability of protection intellectual properties while indexing and searching the content. 3

4 The basic principle of a Crawler 4

5 P2P based passive web crawling system 5

6 Responsibilities Assignment for Crawler Server and Crawler Client 6

7 Crawler server registering  robots.xml Port IP address. 7

8 Content updated notification 8  a new registered server, it has to wait for several days or weeks to be notified to download all history contents on this website.

9 Download updated content by P2P network 9

10 Website discovering 10

11 END 11

Download ppt "Qing-Cai Chen; Xiao-Hong Yang; Xiao-Long Wang Machine Learning and Cybernetics (ICMLC), 2011 International Conference on Year: 2011, Page(s): 1878 – 1883."

Similar presentations

PEER-TO-PEER Is a type of network in which each workstation has equivalent capabilities and responsibilities. This differs from client/server architectures,

PEER-TO-PEER Is a type of network in which each workstation has equivalent capabilities and responsibilities. This differs from client/server architectures,
Guo Guohong, Wei WeiComputational Internet Technology and Applications (iTAP), 2011 International Conference on Publication Year: 2011, Page(s): 1 - 4.

Guo Guohong, Wei WeiComputational Internet Technology and Applications (iTAP), 2011 International Conference on Publication Year: 2011, Page(s):
XenClient Enterprise 4.5 Network Bandwidth Policies.

XenClient Enterprise 4.5 Network Bandwidth Policies.
Web Crawlers Nutch. Agenda What are web crawlers Main policies in crawling Nutch Nutch architecture.

Web Crawlers Nutch. Agenda What are web crawlers Main policies in crawling Nutch Nutch architecture.
Administrative  Philosophy  Class survey  Grading  Proposal (5 points max)  Small projects (10 points each max)  Project (40 points max)  Presentation.

Administrative  Philosophy  Class survey  Grading  Proposal (5 points max)  Small projects (10 points each max)  Project (40 points max)  Presentation.
Web Characterization Week 9 LBSC 690 Information Technology.

Web Characterization Week 9 LBSC 690 Information Technology.
Basic Computer Networks Configurations (cont.) School of Business Eastern Illinois University © Abdou Illia, Spring 2006 Week 2, Thursday 1/19/2006)

Basic Computer Networks Configurations (cont.) School of Business Eastern Illinois University © Abdou Illia, Spring 2006 Week 2, Thursday 1/19/2006)
Problem Addressed Attempts to prove that Web Crawl is random & biased image of Web Graph and does not assert properties of Web Graph Understanding the.

Problem Addressed Attempts to prove that Web Crawl is random & biased image of Web Graph and does not assert properties of Web Graph Understanding the.
NAS-7101 / NAS-7201 TorrentFlux Utility Installation

NAS-7101 / NAS-7201 TorrentFlux Utility Installation
Create a Website Lesson 1 – Part 3. Domain Names 2 Domain names are used to identify one or more IP addresses (213.175.211.12). For example, the domain.

Create a Website Lesson 1 – Part 3. Domain Names 2 Domain names are used to identify one or more IP addresses ( ). For example, the domain.
Boyu Chen Yulin Xia Haoyu Xu Viterbi School of Engineering University of Southern California 2012.5 P2P file sharing system with a central server.

Boyu Chen Yulin Xia Haoyu Xu Viterbi School of Engineering University of Southern California P2P file sharing system with a central server.
Chapter 26 Client Server Interaction Communication across a computer network requires a pair of application programs to cooperate. One application on one.

Chapter 26 Client Server Interaction Communication across a computer network requires a pair of application programs to cooperate. One application on one.
Installing Ricoh Driver. Items you need to know IP address of Printer Options that are installed And Paper Sizes To get all this information you can print.

Installing Ricoh Driver. Items you need to know IP address of Printer Options that are installed And Paper Sizes To get all this information you can print.
FTP. SMS based FTP Introduction Existing System Proposed Solution Block Diagram Hardware and Software Features Benefits Future Scope Conclusion.

FTP. SMS based FTP Introduction Existing System Proposed Solution Block Diagram Hardware and Software Features Benefits Future Scope Conclusion.
Internet Communication Models. Two Communication Paradigms: Stream vs. Message StreamMessage Connection-orientedConnectionless 1-1 communication1-1, 1-many,

Internet Communication Models. Two Communication Paradigms: Stream vs. Message StreamMessage Connection-orientedConnectionless 1-1 communication1-1, 1-many,
1 Network Statistic and Monitoring System Wayne State University Division of Computing and Information Technology Information Technology.

1 Network Statistic and Monitoring System Wayne State University Division of Computing and Information Technology Information Technology.
Intro to the Internet CSCI 101 Free Powerpoint Templates.

Intro to the Internet CSCI 101 Free Powerpoint Templates.
1 One-Click Hosting Services: A File-Sharing Hideout Demetris Antoniades Evangelos P. Markatos ICS-FORTH Heraklion,

1 One-Click Hosting Services: A File-Sharing Hideout Demetris Antoniades Evangelos P. Markatos ICS-FORTH Heraklion,
Introduction to the Internet Introduction to the Internet CSCI 101 Rouda - Week Three Outline for this week: What is the internet History and How it Works.

Introduction to the Internet Introduction to the Internet CSCI 101 Rouda - Week Three Outline for this week: What is the internet History and How it Works.
WADL 2013 July 25-26 th Indianapolis, IN Martin SiteStory Archiving Done Differently

WADL 2013 July th Indianapolis, IN Martin SiteStory Archiving Done Differently

Similar presentations

Ads by Google