Testing Web Based Applications Differences in Traditional Legacy Testing vs. Web Systems Testing

AGENDA Overview Discussion of Key Differences Web Testing Processes Tools of the Trade Learning from History Q & A Session

Overview Web Testing is Different but…. – Life Cycle Methodology – Planning * Planning * Planning – Change Control Types of Business Activity – Corporate Home Page – eCommerce Activity On-line Ordering On-line Payment – Business to Business – Structured Inquiry vs. Query Reports – Front-end to Legacy Systems Audience Mix Terms

WWW Survey Results Demographics Survey Respondents 38.5 % Female (41 % 2000) (Compared to 5% in 1994) 82.5 % Vote Most Important Issue Facing the Internet? Privacy (30%) Censorship (24%) Navigation (16 %) "Copyright Georgia Tech Research Corporation. All rights Reserved. Source: GVU's WWW User Survey

WWW Survey Results Technical Demographics 55% < 33.6K 39 % Speed upgrades within last year 71 % have not switched browsers in last 12 months 46% have created a Web Page "Copyright Georgia Tech Research Corporation. All rights Reserved. Source: GVU's WWW User Survey

Tremendous Web Growth 64 Million U.S. Adults regular Internet users (NUA) 56 % of US companies will sell their products on-line in 2000 – up from 24% in (NUA) 800 Million Web pages (NEC Research). In 1999, 80 million Americans had Internet Connectivity compared to 3 million in (U.S. Department of Commerce)

Public Web Sites U.S. Owns largest share of sites Percentage of U.S. Internet Connected Households soars to 60% in (On-line Computer Library Center)

What they use the Web for.. Information Gathering Community Services Some Shopping (but not for everything) Game Playing Novelty Effect Wearing Off

Toward Quality Systems …the market for technology and services is not a market for novelty any more, but a market for quality, which increasingly has to serve an experienced user base. This will open a host of new possibilities for companies willing to question and improve existing tools and services.  2000 Pfeiffer Consulting

Discussion of Key Differences Direct Access into Company – No Customer Service Middle-man – Security Risks – Critical Access and Timing – Can’t Shut It Down Plethora of Environments – Computers/Operating Systems/Browsers – Settings/Custom Desktop – Software Languages – Embedded Components

Differences (continued) Rapidly Changing Technology Management Perception of Time Management Perception of Quality The Need for Speed – Time to Market – Operational Performance Training and Education of the User

Web Testing Processes Establishing Quality Assurance Practices Life Cycle Process Definition Establish Meaningful Standards Information Layout (Content, Navigation, etc.) Rules (Colors, fonts, graphics, page size, etc) Embedded Components Coding Standards Interfaces Change Control Communications Checklists Templates

Test Planning Key to Achieving Quality Results Vary Approach Based on Critical Factors Type of Application Risks Timing Size of Effort Test Plan Checklist Checklist Checklist Review of Test Plan Template Internet Test Plan Template Internet Test Plan Template Web Testing Processes

Test Plan Template 1. Introduction 2. Objectives and Tasks 2.1 Objectives 2.2 Tasks 3. Risks 3.1 Identify and prioritize risk areas 3.2 Identify test dependencies on external milestones 3.3 Contingency plan for risks 4. Test Strategy 4.1 Functional Testing 4.2 GUI Testing 4.3 Usability Testing 5. Hardware & Software Requirements 6. Environment Requirements 6.1 Client Operating Systems 6.2 Configuration of hardware/ software environment 6.3 Clean and Dirty Machines 7. Test and Project Schedules 8. Resources 9. Test Procedures 10. Control Procedures 11. Retention Policy 12. Approval Process 13. Template and Samples Web Testing Processes

Creating Test Scenarios Checklists for Common Testing Activities GUI Checklist Use of Matrices / Application Test Templates Generic Matrix Results Tracking Generic Matrix Results Tracking Create Positive and Negative Tests Required Fields, Boundary Values, and Data Types Web Testing Processes

Test Lab / Environment Establishing Test Environments – Configuration – Scalability – Recoverability – Controllability – Manageability Common Components – Hardware – Software – Operating Systems – Network Support – Databases – Procedures Procedures Common Components (cont.) – Test Tools Metrics Compare Utilities Capture/Playback Management – Recovery Tools Environment Management – Accesses and Authorities Facility Network Application – Updating Components – Recovery – Archival – Trouble Shooting Web Testing Processes

Test Execution Types of Testing – Usability Testing – GUI Testing – Functional Testing – Regression Testing – Interface Testing – Performance Testing – Recovery Testing Manual vs. Automated Testing Web Testing Processes

Tools of the Trade Link Checkers –Xenu –CyberSpyder HTML Validators –Doctor HTML –HTML PowerTools Functional Test Tools Performance Test Tools Code Management Tools Major Tool Providers – Mercury Interactive – Rational Software – Segue Solutions – RSW – eTest Suite – RadView – ParaSoft – Jtest – Compuware – QA Load – Benchmark Factory (Quest) – Expanded List at Site Below ml#FUNC

Learning From Past Mistakes Web Offers New Delivery Opportunities Web Introduces New Challenges Quality Oriented Practices – Life Cycle Oriented – Structured Processes Employed – Test Planning Instrumental in Achieving Success

Questions From The Audience