TEAM 02 Prototype Presentation Presented By Yan Zhang, Wenchen Tu, Qing Hu This template can be used as a starter file for presenting training materials in a group setting. Sections Sections can help to organize your slides or facilitate collaboration between multiple authors. On the Home tab under Slides, click Section, and then click Add Section. Notes Use the Notes pane for delivery notes or to provide additional details for the audience. You can see these notes in Presenter View during your presentation. Keep in mind the font size (important for accessibility, visibility, videotaping, and online production) Coordinated colors Pay particular attention to the graphs, charts, and text boxes. Consider that attendees will print in black and white or grayscale. Run a test print to make sure your colors work when printed in pure black and white and grayscale. Graphics, tables, and graphs Keep it simple: If possible, use consistent, non-distracting styles and colors. Label all graphs and tables.

Introduction

Project #19 Soccer Data Web Crawler Team 02 Trupti, Project Manager Wenchen Tu, Prototyper Qing Hu, Life Cycle Planer Amir Ali Tahmasebi, Shaper Zhitao Zhou, Feasibility Analyst Pranshu Kumar, Requirments Enginner Yan Zhang, Operational Concept Engineer Subessware Selvameena Karunamoorthy, System/Software Architect This is another option for an overview using transitions to advance through several slides.

SportTech B.I.

Application Architecture Project Overview Features

Program Model

Prototype Use a section header for each of the topics, so there is a clear transition to the audience.

Crawler Architecture Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Crawler Architecture Program Demo Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Algorithm How do we prevent visiting an already visited page? The web is a graph-based structure, and we commonly use DFS(depth first search) and BFS(breadth first search) for traversing graphs. Now we use BFS to complete this！ Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Algorithm We implement it using two data structures. A queue – holds all the URLs that are yet to be crawled A dictionary – holds the (key, value) of all websites that are crawled. Key – IP address of URL Value - timestamp Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Algorithm Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Algorithm Queue Q; //stores the URLs to be crawled Dictionary D; // stores the URLs crawled as (IP, timestamp) revisitPeriod; //defines the time to revisit the page to capture changes in the website data while( !Q.isEmpty() ) { url = Q.dequeue() //fetch the next URL from queue find IP address of the url //Python has socket library that lets us fetch the IP if (IP in dictionary) { //the URL was crawled before prevCrawlTime = check the timestamp of the last visit //value in dictionary if (currentTime - prevCrawlTime < revisitPeriod ) { no need to crawl the URL. Fetch the next URL from Q } else {//there may be changes in the website data so capture those changes Update this timestamp to current time fetch data from URL and parse } } else { Add the IP, current time to the dictionary fetch data from URL and parse } } Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Algorithm Honeypot Traps  -  Some site designers put honeypot traps inside websites to detect web crawlers, They may be links that normal user can’t see and a crawler can.  Crawling Pattern - Only robots follow the same crawling pattern, sites that have intelligent anti-crawling mechanisms can easily detect crawlers from finding pattern in their actions. Humans won’t perform repetitive tasks a lot of times. Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Questions?

New Work This is another option for an overview using transitions to advance through several slides.

New Environment

New Colleagues

Welcome

Today’s Overview 1 2 3 Familiarize yourself with your new assignment Explore your new environment 3 Meet your new colleagues This is another option for an overview slide.

Learning Objectives Technology Procedure Policies Benefits What will the audience be able to do after this training is complete? Briefly describe each objective and how the audience will benefit from this presentation.

New Work The technology learning curve Add slides to each topic section as necessary, including slides with tables, graphs, and images. See next section for sample table, graph, image, and video layouts.

Who’s Who Lead Contact information Jim Jim@company.com Dee Dee@gcompany.com Mavis Mavis@company.com Doug Doug@company.com Keep it brief. Make your text as brief as possible to maintain a larger font size.

Working Toward Mastery Achieve Mastery Get Experienced Projects Worked On Get Familiar Time Spent

Doing Your Best Work Working from home Working offsite Technology requirements If there is relevant video content, such as a case study video, demo of a product, or other training materials, include it in the presentation as well.

Case Study Jeremy His first day Mistakes made Successes achieved The moral of the story Add a case study or class simulation to encourage discussion and apply lessons.

Discussion What we can learn from Jeremy Best practices Take-aways Discuss outcomes of the case study or class simulation. Cover best practices.

Summary Define your challenges Set realistic expectation Technological as well as personal Set realistic expectation Mastery is not achieved overnight Keep your eye on the goal Mentorship programs Summarize presentation content by restating the important points from the lessons. What do you want the audience to remember when they leave your presentation?

Resources <Intranet site text here> <hyperlink here> <Additional reading material text here> <hyperlink here> This slide deck and related resources: <hyperlink here>

Appendix Is your presentation as crisp as possible? Consider moving extra content to the appendix. Use appendix slides to store content that you might want to refer to during the Question slide or that may be useful for attendees to investigate deeper in the future.