Presentation is loading. Please wait.

Presentation is loading. Please wait.

Shauvik Roy Choudhary, Dan Zhao, Husayn Versee, and Alessandro Orso Georgia Institute of Technology.

Published byDwight Greenhalgh Modified over 9 years ago

Similar presentations

Presentation on theme: "Shauvik Roy Choudhary, Dan Zhao, Husayn Versee, and Alessandro Orso Georgia Institute of Technology."— Presentation transcript:

1 Shauvik Roy Choudhary, Dan Zhao, Husayn Versee, and Alessandro Orso Georgia Institute of Technology

2 2 Test Machine Web Server Test Slave http://www.website.com Web Application Tests Web Application Tests Browser Automation Framework Browser Automation Framework Web Application Web Application Tests Web Application Tests Web Application Tests Web Application Tests

3 3 Test Machine Web Server Test Slave http://www.website.com Web Application Tests Web Application Tests Browser Automation Framework Browser Automation Framework Web Application* Changed Outdated tests Web Application Tests* Web Application Tests* Web Application Tests* Web Application Tests* Web Application Tests* Web Application Tests*

4 1. 2. 3. My Web Search 4. 5. 6. 7. 8. 9. 10. Georgia Institute of Technology 11. 12. Includes offices, departments, news 13. room, professional education... 14. www.gatech.edu 15. 16.... 17.... 18. 19. 4 HTML Source of “My Web Search”

5 1. 2. 3. My Web Search 4. 5. 6. 7. 8. 9. 10. Georgia Institute of Technology 11. 12. Includes offices, departments, news 13. room, professional education... 14. www.gatech.edu 15. 16.... 17.... 18. 19. 5 CommandArg 1Arg 2 open/search.php typeqGeorgia Tech clickAndWaitid=search assertTextdocument.links[0]Georgia Institute of Technology assertText//body/div[1]/spanwww.gatech.edu A Selenium Test Case for “My Web Search” HTML Source of “My Web Search”

6 1. 2. 3. My Web Search 4. 5. 6. 7. 8. 9. 10. Georgia Institute of Technology 11. 12. Includes offices, departments, news 13. room, professional education... 14. www.gatech.edu 15. 16.... 17.... 18. 19. 6 CommandArg 1Arg 2 open/search.php typeqGeorgia Tech clickAndWaitid=search assertTextdocument.links[0]Georgia Institute of Technology assertText//body/div[1]/spanwww.gatech.edu HTML Source of “My Web Search” A Selenium Test Case for “My Web Search” Change 1

7 1. 2. 3. My Web Search 4. 5. 6. 7. 8. 9. Georgia Tech 10. 11. Includes offices, departments, news 12. room, professional education... 13. www.gatech.edu 14. 15.... 16.... 17. 18. 7 CommandArg 1Arg 2 open/search.php typeqGeorgia Tech clickAndWaitid=search assertTextdocument.links[0]Georgia Institute of Technology assertText//body/div[1]/spanwww.gatech.edu HTML Source of “My Web Search” A Selenium Test Case for “My Web Search” Change 2

8 1. 2. 3. My Web Search 4. 5. 6. Advanced Search 7. 8. 9. 10. Georgia Institute of Technology 11. 12. Includes offices, departments, news 13. room, professional education... 14. www.gatech.edu 15. 16.... 17.... 18. 19. 8 CommandArg 1Arg 2 open/search.php typeqGeorgia Tech clickAndWaitid=search assertTextdocument.links[0]Georgia Institute of Technology assertText//body/div[1]/spanwww.gatech.edu HTML Source of “My Web Search” A Selenium Test Case for “My Web Search” Change 3

9 1. 2. 3. My Web Search 4. 5. 6. 7. 8. 9. 10. Georgia Institute of Technology 11. 12. Includes offices, departments, news 13. room, professional education... 14. www.gatech.edu 15. 16.... 17.... 18. 19. 9 CommandArg 1Arg 2 open/search.php typeqGeorgia Tech clickAndWaitid=search assertTextdocument.links[0]Georgia Institute of Technology assertText//body/div[1]/spanwww.gatech.edu HTML Source of “My Web Search” A Selenium Test Case for “My Web Search” Change 4

10  Structural Changes leads to  locator errors  form-data population problem  Content Changes leads to  obsolete content problem  Blind Changes  do not reflect on the client side 10

11 11 Test Web-App old Web-App old Web-App new Web-App new Execute test DOM Tree + Failure Message (1) Tests with repairs Tests with repairs Tests with repairs Tests with repairs Tests with repairs Tests with repairs (2) Generate repair candidates Generate repair candidates Discard failed Suggest passed Execute candidates (3)

12  Error messages:  “Locator not found” – Moved Element  “Assertion failed” – Wrongly selected element 12 Old DOM Tree body div h1h1 h1h1 a a ul div ul div New DOM Tree body div h1h1 h1h1 a a ul div ul div DOM Node locating properties = { id, xpath, class, linkText, name }

13  Repairing failing asserts  Replace expected value with actual value  Negate assertion condition  Form data population  Find newly added elements in the DOM  Choose random values for the elements to generate repair candidates 13

14  RQ1: Can WATER suggest repairs for most broken test scripts in a web application?  RQ2: Can WATER do so without providing too many false positives? 14

15  Three real world web applications with test cases. 15 TypeContent Management System Business Process Management User Automation Scripts

16  Three real world web applications with test cases. 16 TypeContent Management System Business Process Management User Automation Scripts PlatformPHPJavaDSL

17  Three real world web applications with test cases. 17 TypeContent Management System Business Process Management User Automation Scripts PlatformPHPJavaDSL Test Scripts42 selenium tests16 selenium tests180 (out of 5123) scripts translated to selenium

18  Three real world web applications with test cases. 18 TypeContent Management System Business Process Management User Automation Scripts PlatformPHPJavaDSL Test Scripts42 selenium tests16 selenium tests180 (out of 5123) scripts translated to selenium Test scripts run onVersions from SVN Live site daily

19 VersionsT broken C fail S avg T fix V fix 19478 – 194802(4,4)(3,3)219484 20430 – 204311(1) 120448 20739 – 207401(1)(0)020776 20769 – 207702(1,1) 220777 19 VersionsT broken C fail S avg T fix V fix 963271 – 9634102(1,1) 1v1.7 997469 – 9974701(5)(1.4)1v1.29

20 20 ScriptDomainChangedFixedSuggestions 10043careers.yahoo.comFormNo(15, 15, 0) 10754www.icade.frForm, Reloc.No0 11525www.terra.com.brLink textYes285 13389www.terra.com.brLink textYes285 18164www.google.com.brLink textYes1

21  RQ1: Effectiveness  WATER could suggest repairs to broken test cases  Joomla & Ofbiz studies: Suggestions correspond to actual fixes made by developers.  RQ2: Efficiency (wrong suggestions)  Joomla & Ofbiz study: 1-3 suggestions  Coscripter study: 1-285 suggestions 21

22  Repair of JUnit tests  Daniel et. al (ReAssert) [ASE’09][ISSTA’10]  Regression testing for Web applications  Alshahwan & Harman [ICST’08]  Dobolyi & Weimer [ISSRE’09]  Roest, Mesbah & Van Deursen [ICST’10]  GUI Test repair  Memon & Soffa [FSE’03]  Grechanik, Xie & Fu [ICSE’09] 22

23 23

Download ppt "Shauvik Roy Choudhary, Dan Zhao, Husayn Versee, and Alessandro Orso Georgia Institute of Technology."

Similar presentations

Hossain Shahriar Mohammad Zulkernine. One of the worst vulnerabilities in web applications It involves the generation of dynamic HTML contents with invalidated.

Hossain Shahriar Mohammad Zulkernine. One of the worst vulnerabilities in web applications It involves the generation of dynamic HTML contents with invalidated.
Shauvik Roy Choudhary, Alex Orso Georgia Institute of Tech nology.

Shauvik Roy Choudhary, Alex Orso Georgia Institute of Tech nology.
/ department of mathematics and computer sciencedepartment of mathematics and computer science / architecture of information systems.

/ department of mathematics and computer sciencedepartment of mathematics and computer science / architecture of information systems.
Test Automation: Coded UI Test

Test Automation: Coded UI Test
HI-TEC 2011 SQL Injection. Client’s Browser HTTP or HTTPS Web Server Apache or IIS HTML Forms CGI Scripts Database SQL Server or Oracle or MySQL ODBC.

HI-TEC 2011 SQL Injection. Client’s Browser HTTP or HTTPS Web Server Apache or IIS HTML Forms CGI Scripts Database SQL Server or Oracle or MySQL ODBC.
Hands-on SQL Injection Attack and Defense HI-TEC July 21, 2013.

Hands-on SQL Injection Attack and Defense HI-TEC July 21, 2013.
Source: ojects/tabber/ ojects/tabber/

Source: ojects/tabber/ ojects/tabber/
Programming Club IIT Kanpur. Work environment Before you begin coding,always set up your work environment to your needs IDE Notepad++ Sublime Text 2.

Programming Club IIT Kanpur. Work environment Before you begin coding,always set up your work environment to your needs IDE Notepad++ Sublime Text 2.
Www.corewebprogramming.com JSP1 Java Server Pages (JSP) Introducing JavaServer Pages TM (JSP TM ) JSP scripting elements.

JSP1 Java Server Pages (JSP) Introducing JavaServer Pages TM (JSP TM ) JSP scripting elements.
Digital Infrastructures for Humanities Research Matthew Milner Assistant Director McGill Digital Humanities institute Edward Bilodeau.

Digital Infrastructures for Humanities Research Matthew Milner Assistant Director McGill Digital Humanities institute Edward Bilodeau.
JQuery CS 380: Web Programming. What is jQuery? jQuery is a fast and concise JavaScript Library that simplifies HTML document traversing, event handling,

JQuery CS 380: Web Programming. What is jQuery? jQuery is a fast and concise JavaScript Library that simplifies HTML document traversing, event handling,
Shauvik Roy Choudhary, Husayn Versee, and Alessandro Orso Georgia Institute of Technology Partially supported by the NSF awards CCF-0916605 and CCF-0725202.

Shauvik Roy Choudhary, Husayn Versee, and Alessandro Orso Georgia Institute of Technology Partially supported by the NSF awards CCF and CCF
Lecture 6/2/12. Forms and PHP The PHP $_GET and $_POST variables are used to retrieve information from forms, like user input When dealing with HTML forms.

Lecture 6/2/12. Forms and PHP The PHP $_GET and $_POST variables are used to retrieve information from forms, like user input When dealing with HTML forms.
Pubman and Selenium tests. What is Selenium Selenium is a suite of Web application test automation tools for any browser on any operating system –Firefox,

Pubman and Selenium tests. What is Selenium Selenium is a suite of Web application test automation tools for any browser on any operating system –Firefox,
Test Automation Framework Ashesh Jain 2007EE50403 Manager Amit Maheshwari.

Test Automation Framework Ashesh Jain 2007EE50403 Manager Amit Maheshwari.
X-PERT: Accurate Identification of Cross-Browser Issues in Web Applications Shauvik Roy Choudhary, Mukul Prasad, Alessandro Orso Labs of America Partially.

X-PERT: Accurate Identification of Cross-Browser Issues in Web Applications Shauvik Roy Choudhary, Mukul Prasad, Alessandro Orso Labs of America Partially.
Component 4: Introduction to Information and Computer Science Unit 9: Components and Development of Large Scale Systems Lecture 5 This material was developed.

Component 4: Introduction to Information and Computer Science Unit 9: Components and Development of Large Scale Systems Lecture 5 This material was developed.
Multiple Tiers in Action

Multiple Tiers in Action
BTW Information Annotation By Rudd Stevens, Jason Endo.

BTW Information Annotation By Rudd Stevens, Jason Endo.
Dynamic Web Pages Bert Wachsmuth. Review  Internet, IP addresses, ports, client-server, http, smtp  HTML, XHTML, XML  Style Sheets, external, internal,

Dynamic Web Pages Bert Wachsmuth. Review  Internet, IP addresses, ports, client-server, http, smtp  HTML, XHTML, XML  Style Sheets, external, internal,

Similar presentations

Ads by Google