Copyright (c) 1994-2001 Cem Kaner. All Rights Reserved. 1 Black Box Software Testing (Professional Seminar) Cem Kaner, J.D., Ph.D. Professor of Computer.

Slides:



Advertisements
Similar presentations
Four Schools of Software Testing Workshop on Teaching Software Testing, Florida Tech, February 2003.
Advertisements

Software Quality Assurance Plan
1 Test Planning CSSE 376, Software Quality Assurance Rose-Hulman Institute of Technology March 9, 2007.
1 CSc Senior Project Software Testing. 2 Preface “The amount of required study of testing techniques is trivial – a few hours over the course of.
Operating Systems.
Copyright Shanna Smith & Tom Bohman (2003). This work is the intellectual property of the authors. Permission is granted for this material to be shared.
The Project AH Computing. Functional Requirements  What the product must do!  Examples attractive welcome screen all options available as clickable.
Copyright (c) Cem Kaner. All Rights Reserved. 1 Black Box Software Testing (Professional Seminar) Cem Kaner, J.D., Ph.D. Professor of Computer.
ET Workshop v Opening©2002 Amland Consulting0-1 Exploratory Testing v Workshop in Risk-Based Agile Testing Parts of this class have been.
Copyright (c) Cem Kaner. All Rights Reserved. 1 Black Box Software Testing (Academic Course – Fall 2001) Cem Kaner, J.D., Ph.D. Professor of.
Copyright (c) Cem Kaner. All Rights Reserved. 1 Black Box Software Testing (Professional Seminar) Cem Kaner, J.D., Ph.D. Professor of Computer.
Copyright (c) Cem Kaner Black Box Software Testing (Academic Course - Fall 2001) Cem Kaner, J.D., Ph.D. Florida Institute of Technology Section:
Copyright (c) Cem Kaner Black Box Software Testing (Academic Course - Fall 2001) Cem Kaner, J.D., Ph.D. Florida Institute of Technology Section:
Copyright (c) Cem Kaner Black Box Software Testing (Academic Course - Fall 2001) Cem Kaner, J.D., Ph.D. Florida Institute of Technology Section:
Copyright (c) Cem Kaner Black Box Software Testing (Academic Course - Fall 2001) Cem Kaner, J.D., Ph.D. Florida Institute of Technology Section:
Copyright (c) Cem Kaner. All Rights Reserved. 1 Black Box Software Testing (Professional Seminar) Cem Kaner, J.D., Ph.D. Professor of Computer.
Copyright (c) Cem Kaner Black Box Software Testing (Academic Course - Fall 2001) Cem Kaner, J.D., Ph.D. Florida Institute of Technology Section:
Copyright (c) Cem Kaner Black Box Software Testing (Academic Course - Fall 2001) Cem Kaner, J.D., Ph.D. Florida Institute of Technology Section:
Copyright (c) Cem Kaner. All Rights Reserved. 1 Black Box Software Testing (Professional Seminar) Cem Kaner, J.D., Ph.D. Professor of Computer.
Copyright (c) Cem Kaner. All Rights Reserved. 1 Black Box Software Testing (Professional Seminar) Cem Kaner, J.D., Ph.D. Professor of Computer.
Copyright (c) Cem Kaner. All Rights Reserved. 1 Black Box Software Testing (Professional Seminar) Cem Kaner, J.D., Ph.D. Professor of Computer.
Copyright (c) Cem Kaner. All Rights Reserved. 1 Black Box Software Testing (Professional Seminar) Cem Kaner, J.D., Ph.D. Professor of Computer.
Black Box Software Testing Copyright © 2003 Cem Kaner & James Bach 1 Black Box Software Testing Fall 2004 PART 21: ELEMENTS OF TEST DOCUMENATION by Cem.
Copyright (c) Cem Kaner. All Rights Reserved. 1 Black Box Software Testing (Professional Seminar) Cem Kaner, J.D., Ph.D. Professor of Computer.
Black Box Software Testing Copyright © Cem Kaner & James Bach 1 Black Box Software Testing Spring 2005 by Cem Kaner, J.D., Ph.D. Professor of.
Black Box Software Testing Copyright © Cem Kaner & James Bach 1 Black Box Software Testing Fall 2005 Overview—Part 2 (Mission of Testing) Cem Kaner,
VERIFICATION OF ASPECT-ORIENTED MODELS Review of Aspect-Oriented Definitions aspect – crosscutting concern that may involve multiple classes pointcut –
Black Box Software Testing Copyright © 2003 Cem Kaner & James Bach 1 Black Box Software Testing Spring 2005 PART 7 -- FUNCTION TESTING by Cem Kaner, J.D.,
Black Box Software Testing Copyright © Cem Kaner & James Bach 1 Black Box Software Testing Spring 2005 REQUIREMENTS ANALYSIS FOR TEST DOCUMENTATION.
Copyright (c) Cem Kaner. All Rights Reserved. 1 Black Box Software Testing (Professional Seminar) Cem Kaner, J.D., Ph.D. Professor of Computer.
Copyright (c) Cem Kaner. All Rights Reserved. 1 Black Box Software Testing (Professional Seminar) Cem Kaner, J.D., Ph.D. Professor of Computer.
Copyright (c) Cem Kaner Black Box Software Testing (Academic Course -Fall 2001) Cem Kaner, J.D., Ph.D. Florida Institute of Technology Section:
Copyright (c) Cem Kaner Black Box Software Testing (Academic Course - Fall 2001) Cem Kaner, J.D., Ph.D. Florida Institute of Technology Section:
Copyright (c) Cem Kaner Black Box Software Testing (Academic Course - Fall 2001) Cem Kaner, J.D., Ph.D. Florida Institute of Technology Section:
Copyright (c) Cem Kaner Black Box Software Testing (Academic Course - Fall 2001) Cem Kaner, J.D., Ph.D. Florida Institute of Technology Section:
Copyright (c) Cem Kaner Black Box Software Testing (Academic Course - Fall 2001) Cem Kaner, J.D., Ph.D. Florida Institute of Technology Section:
Copyright (c) Cem Kaner. All Rights Reserved. 1 Black Box Software Testing (Professional Seminar) Cem Kaner, J.D., Ph.D. Professor of Computer.
Copyright (c) Cem Kaner Black Box Software Testing (Academic Course - Fall 2001) Cem Kaner, J.D., Ph.D. Florida Institute of Technology Section:
Copyright (c) Cem Kaner. All Rights Reserved. 1 Black Box Software Testing (Professional Seminar) Cem Kaner, J.D., Ph.D. Professor of Computer.
Copyright (c) Cem Kaner. All Rights Reserved. 1 Black Box Software Testing (Professional Seminar) Cem Kaner, J.D., Ph.D. Professor of Computer.
Copyright (c) Cem Kaner. All Rights Reserved. 1 Black Box Software Testing (Professional Seminar) Cem Kaner, J.D., Ph.D. Professor of Computer.
Copyright (c) Cem Kaner Black Box Software Testing (Academic Course - Fall 2001) Cem Kaner, J.D., Ph.D. Florida Institute of Technology Section:
EPSII Lecture Section AAA 1505 SC Professor Terry A. Braun Biomedical Engineering, Ophthalmology and Visual Sciences.
Copyright (c) Cem Kaner. All Rights Reserved. 1 Black Box Software Testing (Professional Seminar) Cem Kaner, J.D., Ph.D. Professor of Computer.
Black Box Software Testing Copyright © 2003 Cem Kaner & James Bach 499 Black Box Software Testing Part 12. Introduction to Test Documentation Co-authors:
Copyright (c) Cem Kaner. All Rights Reserved. 1 Black Box Software Testing (Professional Seminar) Cem Kaner, J.D., Ph.D. Professor of Computer.
Copyright (c) Cem Kaner. All Rights Reserved. 1 Black Box Software Testing (Professional Seminar) Cem Kaner, J.D., Ph.D. Professor of Computer.
Copyright (c) Cem Kaner. All Rights Reserved. 1 Black Box Software Testing (Professional Seminar) Cem Kaner, J.D., Ph.D. Professor of Computer.
Chapter 27 Network Management Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display.
Copyright (c) Cem Kaner. All Rights Reserved. 1 Black Box Software Testing (Professional Seminar) Cem Kaner, J.D., Ph.D. Professor of Computer.
Black Box Software Testing (Professional Seminar)
DIT314 ~ Client Operating System & Administration
Black Box Software Testing 2004 Academic Edition
Black Box Software Testing (Academic Course - Fall 2001)
Black Box Software Testing (Academic Course - Fall 2001)
Systems Analysis and Design 5th Edition Chapter 8. Architecture Design
Systems Analysis and Design in a Changing World, 6th Edition
Black Box Software Testing (Academic Course - Fall 2001)
“The UML Collaboration, a Standard for Role Modeling.”
Black Box Software Testing Fall 2005 Overview – Part 1 of 3
Black Box Software Testing 2004 Academic Edition
Black Box Software Testing (Academic Course - Fall 2001)
Black Box Software Testing (Academic Course - Fall 2001)
Black Box Software Testing (Academic Course - Fall 2001)
Black Box Software Testing (Academic Course - Fall 2001)
Rapid Software Testing
Black Box Software Testing (Professional Seminar)
Black Box Software Testing (Professional Seminar)
Black Box Software Testing (Professional Seminar)
Black Box Software Testing (Professional Seminar)
Presentation transcript:

Copyright (c) Cem Kaner. All Rights Reserved. 1 Black Box Software Testing (Professional Seminar) Cem Kaner, J.D., Ph.D. Professor of Computer Sciences Florida Institute of Technology Section:22 Introduction to Test Documentation Summer, 2002 Contact Information: (testing website) (legal website) I grant permission to make digital or hard copies of this work for personal or classroom use, with or without fee, provided that (a) copies are not made or distributed for profit or commercial advantage, (b) copies bear this notice and full citation on the first page, and if you distribute the work in portions, the notice and citation must appear on the first page of each portion, (c) each page bear the notice "Copyright (c) Cem Kaner" or if you changed the page, "Adapted from Notes Provided by Cem Kaner". Abstracting with credit is permitted. The proper citation for this work is Cem Kaner, A Course in Black Box Software Testing (Professional Version), Summer-2002, To copy otherwise, to republish or post on servers, or to distribute to lists requires prior specific permission and a fee. Request permission to republish from

Copyright (c) Cem Kaner. All Rights Reserved. 2 Black Box Software Testing Introduction to Test Documentation Co-author: James Bach Acknowledgement Some of this material is from the Third Los Altos Workshop on Software Testing (LAWST), February 7 and 8, I founded the LAWST and was co-organizer of LAWST 3. At LAWST, we discussed test documentation (test planning strategies and materials). The agenda item was: » How do we know what test cases we have? How do we know which areas of the program are well covered and which are not? » How do we develop this documentation EFFICIENTLY? As many of you know, I despise thick test plans and I begrudge every millisecond that I spend on test case documentation. Unfortunately, some work is necessary. My question is, how little can we get away with, while still preserving the value of our asset? The following people attended LAWST 3: Chris Agruss, James Bach, Karla Fisher, David Gelperin, Kenneth Groder, Elisabeth Hendrickson, Doug Hoffman, III, Bob Johnson, Cem Kaner, Brian Lawrence, Brian Marick, Thanga Meenakshi, Noel Nyman, Jeffery E. Payne, Bret Pettichord, Johanna Rothman, Jane Stepak, Melora Svoboda, Jeremy White, and Rodney Wilson.

Copyright (c) Cem Kaner. All Rights Reserved. 3 Definitions The test planning documents include: The Testing Project Plan, which identifies classes of tasks and broadly allocates people and resources to them; High-level designs for test cases (individual tests) and test suites (collections of related tests); Detailed lists or descriptions of test cases; Anything else that you would put in a hard copy or virtual binder that documents the collection of test cases that you will develop and run. This collection of materials is sometimes called the test plan and sometimes called the test documentation.

Copyright (c) Cem Kaner. All Rights Reserved. 4 Levels of Analysis 1-Variable Basic user interface verification Filters Many testers stop here, at the most superficial level of testing 2-Variable Shared or related filters Logical relationships among variables Multi-Variable The core problem is the vastness of the space of test cases. We need a sampling strategy.

Copyright (c) Cem Kaner. All Rights Reserved. 5 Basic Test Documentation Components Lists: Such as lists of fields, error messages, DLLs Outlines: An outline organizes information into a hierarchy of lists and sublists Such as the testing objectives list later in the course notes Tables: A table organizes information in two dimensions showing relationships between variables. Such as boundary tables, decision tables, combination test tables Matrices: A matrix is a special type of table used for data collection. Such as the numeric input field matrix, configuration matrices Refer to Testing Computer Software, pages For more examples, see page Testing Computer Software, page 218.

Copyright (c) Cem Kaner. All Rights Reserved. 6 Configuration Planning Table Var 1Var 2Var 3Var 4Var 5 Config 1V1-1V2-1V3-1V4-1V5-1 Config 2V1-2V2-2V3-2V4-2V5-2 Config 3V1-3V2-3V3-3V4-3V5-3 Config 4V1-4V2-4V3-4V4-4V5-4 Config 5V1-5V2-5V3-5V4-5V5-5 Config 6V1-6V2-6V3-6V4-6V5-6 This table defines 6 standard configurations for testing. In later tests, the lab will set up a Config-1 system, a Config-2 system, etc., and will do its compatibility testing on these systems. The variables might be software or hardware choices. For example, Var 1 could be the operating system (V1-1 is Win 2000, V1-2 is Win ME, etc.) Var 2 could be how much RAM on the computer under test (V2-1 is 128 meg, V2-2 is 32 meg., etc.). Var 3 could be the type of printer, Var 4 the machine’s language setting (French, German, etc.). Config planning tables are often filled in using the All Pairs algorithm.

Copyright (c) Cem Kaner. All Rights Reserved. 7 Configuration Test Matrix Config 1Config 2Config 3Config 4Config 5Config 6 Test 1Pass Test 2FailPass Test 3Pass Test 4PassFail Pass Test 5FailPassFailPass This matrix records the results of a series of tests against the 6 standard configurations that we defined in the Configuration Planning Table. In this table, Config 1 has passed 3 tests, failed 1, and hasn’t yet been tested with Test 2. Config 6 is still untested.

Copyright (c) Cem Kaner. All Rights Reserved. 8 Notes ___________________________________________________________ ___________________________________________________________ ___________________________________________________________ ___________________________________________________________