Presentation is loading. Please wait.

Presentation is loading. Please wait.

Prometheus Webcrawler

Similar presentations


Presentation on theme: "Prometheus Webcrawler"— Presentation transcript:

1 Prometheus Webcrawler
Matthew Helmbrecht

2

3 Web Crawler WelcomeJSP
Enter link, search term (if needed), depth, and Single/ Multithreaded run. Servlet Crawler  ThreadPool  Search Map parsed content to Hashmaps Per thread content parser Response to search query Servlet Response Give information on crawler runtime, db / file time. Database Aggregated reduce over all threads Create Flatfiles for use by GAE Web Crawler

4 GetWCCount Class computes the word count
WelcomeJSP Enter Search Term Servlet GetWCCount Class computes the word count Map parsed content to Hashmaps Servlet Response Give information on crawler runtime, db / file time. Response to search query Aggregated reduce over all threads Flat Files generated by WebCrawler Word Count from localhost


Download ppt "Prometheus Webcrawler"

Similar presentations


Ads by Google