Prometheus Webcrawler Matthew Helmbrecht http://mjhelmb.appspot.com
Web Crawler WelcomeJSP Enter link, search term (if needed), depth, and Single/ Multithreaded run. Servlet Crawler ThreadPool Search Map parsed content to Hashmaps Per thread content parser Response to search query Servlet Response Give information on crawler runtime, db / file time. Database Aggregated reduce over all threads Create Flatfiles for use by GAE Web Crawler
GetWCCount Class computes the word count WelcomeJSP Enter Search Term Servlet GetWCCount Class computes the word count Map parsed content to Hashmaps Servlet Response Give information on crawler runtime, db / file time. Response to search query Aggregated reduce over all threads Flat Files generated by WebCrawler Word Count from localhost