Automation of Web Form Queries Beth Watson Jared Coplin Mentor: Dr. Anne Ngu WEAvE: Web Exploration and Analytic Engine

Automation of Web Form Queries Outline Problem/Motivation Associated Works Automated URL Clustering – Jared Automated Query Submission – Beth Goals for Desired Endstate Questions/Comments

Automation of Web Form Queries Motivation Current search engines cannot access the Deep Web Those that can do not submit queries for you Compile results pages into sortable, committable units Military: lack of efficient data mining methods on classified systems Easier to make small businesses and startups “searchable” URL database grows organically Potential for personalized URL caches Make what YOU search for easier for YOU Parental controls, preferences…. Employs crowd sourcing to learn as it grows Rapid, relevant information retrieval from ALL THE SOURCES

Automation of Web Form Queries Associated Works I am a placeholder

Automation of Web Form Queries Jared Have done Will do before next presentation

Automation of Web Form Queries Beth’s Part Identifying input fields Mapping input fields to query needs Submitting queries Cataloging query paths, successful/unsuccessful

Automation of Web Form Queries Beth’s Part: Last Summer’s Work Finds textboxes No radio buttons, drop down Allows query input Checks validity of web source Catalogues web sources

Automation of Web Form Queries Beth’s Part: Current Work Locate input fields with Selenium’s keyboard interface Captures text, radio, check and dropdown Object Oriented Easier to format, organize information

Automation of Web Form Queries Beth’s Part: Goals Successfully query wide variety of sites within domain

Automation of Web Form Queries Goals for Project Endstate

Automation of Web Form Queries Questions? Comments?