WebVizOr: A Fault Detection Visualization Tool for Web Applications Goal: Illustrate and evaluate the uses of WebVizOr, a new tool to aid web application testing  Test web applications for correctness  Problem: Difficult to analyze results of large test suites  Our Contribution:  Visualization tool that enables navigation of test suite results  Integration of various test oracles that identify possible faults in web applications Uses in Industry and Research General Web Application Testing Process Motivation View Detailed Test Case Info Visualize Oracle Comparator Results Highlighted differences in filtered responses allow the user to quickly monitor HTML tag change Page content change Figure 1: A screen snapshot of WebVizOr presenting the results of executing the same test suite on two versions of a web application. Current Test Case Oracle Views Available Current Response Current Oracle View Navigation Buttons Navigation Frame Side by Side View of Two Sets of Responses Highlighting Indicating Found Differences Detailed Test Case Information WebVizOr Execute Oracles Identify Faults Present Results Oracle Scripts (Filter) Oracle Reports Oracle Script (Compare) Fault Information Directory of HTML Responses Test Case (HTTP Requests) Information Summary of Evaluation Ease of Navigation:  Navigate to any response in 4 clicks or less  Go directly to responses listed in fault report Oracle Integration:  Integrated seven oracles  Created fault report for easy access to oracle results Subject Web Applications: Extensibility:  Update a single configuration file to integrate new oracles Portability:  Under investigation Time and Space Costs: WebVizOr Architecture Tool Features Test case details allow user to View complete HTTP request Determine if error in response corresponds with request parameters Jump to and view associated response View Saved HTML Responses Single Suite Version: View results of test suite execution (responses) in rendered or raw HTML form Test Suite Fault Report Real-world web application testing: Regression Testing  Useful during maintenance or before release of a new application version Oracle Development:  Use of the tool within our group has already led to the development of two new oracles Holly EsquivelSara Sprenkle and Lori PollockBarbara Hazelwood Department of Computer Science & Information Systems h t t p : / / w w w. c i s. u d e l. e d u / ~ h i p e r Requests Web Application Server code … Test Suite HTML responses … Actual Results … Expected Results Possible Fault Figure 2: A screen snapshot of WebVizOr’s fault report. Oracle Detected faults in the Suite Oracle Detected Faults in this Test Case Test Case’s Responses Oracle Not Run All Test Cases Listed No Faults Found Faults Found WebVizOr’s fault report allows the user to View suite’s results Jump to and view a test case or response View an oracle’s results on the suite or a test case Dual Suite Version: View results of two sets of test suite executions (responses) side by side Utilize oracles to compare, view, and detect potential faults in responses O u r w o r k w a s f u n d e d b y C R A – W D i s t r i b u t e d M e n t o r P r o j e c t Oracle Future Work Pass Responses WebVizOr  Evaluate Oracles Some oracles are better at catching certain faults Quantitative and qualitative analysis of oracles’ false positives and false negatives  Develop New Oracles Use analysis to create more accurate oracles 22,129 1,107 Total # Requests 12.2 requests1,800Digital Publications Library DSpace 6.6 requests169Regional Workshop Registration and Management Masplas Avg. Case Size# Test CasesDescription Application Usage Filtered Text Files 1 per oracle 2 per oracle2 Compare Dual Application Versions Comparison Files 0 0 Generated HTML Files View Single Application Version 2 Masplas DSpace Masplas 1 sec 5-15 sec 5 sec 22 sec Initialization Time