1. Automation of Web Form Queries Beth Watson Jared Coplin Mentor: Dr. Anne Ngu WEAvE: Web Exploration and Analytic Engine

2. Automation of Web Form Queries Outline Problem/Motivation Associated Works Automated URL Clustering – Jared Automated Query Submission – Beth Goals for Desired Endstate Questions/Comments

3. Automation of Web Form Queries Motivation Current search engines cannot access the Deep Web Those that can do not submit queries for you Compile results pages into sortable, committable units Military: lack of efficient data mining methods on classified systems Easier to make small businesses and startups “searchable” URL database grows organically Potential for personalized URL caches Make what YOU search for easier for YOU Parental controls, preferences…. Employs crowd sourcing to learn as it grows Rapid, relevant information retrieval from ALL THE SOURCES

4. Automation of Web Form Queries Associated Works I am a placeholder

5. Automation of Web Form Queries Jared Have done Will do before next presentation

6. Automation of Web Form Queries Beth’s Part Identifying input fields Mapping input fields to query needs Submitting queries Cataloging query paths, successful/unsuccessful

7. Automation of Web Form Queries Beth’s Part: Last Summer’s Work Finds textboxes No radio buttons, drop down Allows query input Checks validity of web source Catalogues web sources

8. Automation of Web Form Queries Beth’s Part: Current Work Locate input fields with Selenium’s keyboard interface Captures text, radio, check and dropdown Object Oriented Easier to format, organize information

9. Automation of Web Form Queries Beth’s Part: Goals Successfully query wide variety of sites within domain

10. Automation of Web Form Queries Goals for Project Endstate

11. Automation of Web Form Queries Questions? Comments?