© Telcordia Technologies 2004 – All Rights Reserved AETG Web Service Tutorial AETG is a service mark of Telcordia Technologies. Telcordia Technologies - Licensed Material Access to this tutorial is provided solely to the registered users who have agreed to access and use the AETG Web Service according to the terms of the Click-on license agreement accepted during the registration process.

Page – 2 © Telcordia Technologies 2004 – All Rights Reserved AETG Web Service Create tests for: – Communications protocols – Feature interaction – Interoperability – Graphical User Interfaces (GUIs) – Contracts – etc. Improves tester productivity by allowing a tester to create more, higher quality tests

Page – 3 © Telcordia Technologies 2004 – All Rights Reserved AETG Web Service WHAT - Helps testers design test sets. – Is especially helpful where combinatorial explosion of input combinations is a problem. HOW - Tester provides input parameters and parameter values. – AETG Web provides test cases with a specific value for each parameter. AETG Web lets you choose the degree of interaction between the parameters – E.g., degree of interaction = 2 means pair-wise combinations

Page – 4 © Telcordia Technologies 2004 – All Rights Reserved Example Scenario, part 1 Call Processing – Consider testing telephone-switch software – A call has the following characteristics: Call Type: one of Local, Long Distance, International Billing: one of Caller, Collect, 800 Access: one of Loop, ISDN, PBX Result: one of Success, Busy, Blocked – This scenario uses 4 input parameters, each with 3 possible values Just using valid values in this example All combinations are valid.

Page – 5 © Telcordia Technologies 2004 – All Rights Reserved Example Scenario, part 2 Each call characteristic is called a field – The AETG term for a test parameter Values and relationships among fields appear in a relation – The AETG term for a collection of fields that together model a test scenario The AETG model that you will build in this tutorial will have: – 4 fields (call type, etc.) – 1 relation with the 3 values for each field (local, etc.) This basic example does not use any compounds or constraints

Page – 6 © Telcordia Technologies 2004 – All Rights Reserved Numbers of Tests Consider just 2 parameters: Call Type and Billing – Each has 3 distinct values. We need 3 x 3 = 9 tests to test all possible combinations of two parameters. Consider all 4 parameters – Testing all possible combinations of the 4 parameters requires 3 x 3 x 3 x 3 = 81 tests. AETG Web can cover all pair-wise combinations of these 4 parameters with only 9 tests.

Page – 7 © Telcordia Technologies 2004 – All Rights Reserved Using the AETG Web Service for the Example In the basic tutorial you will – Create a Test Specification (TS) Specify fields Specify relations (field interactions) Specify valid values No invalid values – Generate test sets – View, download, and print test sets

Page – 8 © Telcordia Technologies 2004 – All Rights Reserved AETG Web Service - Access Access URL – Note that all access to the service uses secure http (i.e., https) Any modern web browser should work – E.g., Firefox, Internet Explorer, Netscape, Mozilla

Page – 9 © Telcordia Technologies 2004 – All Rights Reserved Click on Log In under Registered Users Access to user documentation requires login. Please check the news page occasionally. Home Page

Page – 10 © Telcordia Technologies 2004 – All Rights Reserved Enter your user name & password to start a new session. Please do not bookmark this page. Note the lock icon in the browser. Login Page

Page – 11 © Telcordia Technologies 2004 – All Rights Reserved Bookmark this page! Welcome Page

Page – 12 © Telcordia Technologies 2004 – All Rights Reserved Steps to create a New Test Specification 1. Pick a name and create an empty test specification 2. Open the test specification for edit 3. Create all required fields in the spec 4. Create a relation 5. Select fields for that relation 6. Enter values for each field in the relation Refer to Section 2 : Starting a Test Generation Session in the User Manual

Page – 13 © Telcordia Technologies 2004 – All Rights Reserved This page shows folders and test specifications that you have defined. Links allow you to create, delete, rename, etc. Manage Specifications

Page – 14 © Telcordia Technologies 2004 – All Rights Reserved Enter a new name (calls) and click on the Add link to create an empty test specification. Enter name for the new specification

Page – 15 © Telcordia Technologies 2004 – All Rights Reserved Select the specification name in the list box and click on theEdit link to open it. Edit the newly created specification

Page – 16 © Telcordia Technologies 2004 – All Rights Reserved Enter each field name, and click on the Add link. Field names from the example: Call_Type Billing Access Result Create fields in the test specification

Page – 17 © Telcordia Technologies 2004 – All Rights Reserved Fields created in the test specification

Page – 18 © Telcordia Technologies 2004 – All Rights Reserved Enter a relation name, then click on the Add link. Create a relation in the test specification

Page – 19 © Telcordia Technologies 2004 – All Rights Reserved Next, click on the Select Components link to add fields to the relation. Empty relation created in the test specification

Page – 20 © Telcordia Technologies 2004 – All Rights Reserved Select all the fields, click on the >>Add>> link. Select fields for the newly created relation

Page – 21 © Telcordia Technologies 2004 – All Rights Reserved All fields are now in the Used column. Click on theSubmit Selections link at the bottom to save the changes. Fields selected for the newly created relation

Page – 22 © Telcordia Technologies 2004 – All Rights Reserved Click on theEdit values link next. Relation with fields

Page – 23 © Telcordia Technologies 2004 – All Rights Reserved Enter values, one per line, in the text boxes. Click on theSubmit values link to save changes. Enter values for fields in the relation

Page – 24 © Telcordia Technologies 2004 – All Rights Reserved Click on theGenerate tests link next. Generate tests

Page – 25 © Telcordia Technologies 2004 – All Rights Reserved Output from test generator (top) Next slide, please.

Page – 26 © Telcordia Technologies 2004 – All Rights Reserved Click on theView all test cases link next. Output from test generator (scrolled down)

Page – 27 © Telcordia Technologies 2004 – All Rights Reserved Click on theXML link to view as XML. Overview of generated tests

Page – 28 © Telcordia Technologies 2004 – All Rights Reserved XML is easily processed by programs, such as in a test harness. View generated tests as XML

Page – 29 © Telcordia Technologies 2004 – All Rights Reserved View generated tests as spreadsheet (DIF) Click on theDIF link from the results overview page to save or view the tests in spreadsheet format.

Page – 30 © Telcordia Technologies 2004 – All Rights Reserved Duplicate Values For performance, load balancing, or user data simulation purposes, we may want to ensure that certain values are represented more often than others AETG Web will accept duplicate values for a parameter. Duplicate values are treated as if they are distinct.

Page – 31 © Telcordia Technologies 2004 – All Rights Reserved Exercise Modify the relation by inserting a duplicate value 800 for the parameter billing, then generate tests – How many valid tuples does it find? – Are there more tests? – Does 800 occur more often than other values? Remove the duplicate value & submit the relation.

Page – 32 © Telcordia Technologies 2004 – All Rights Reserved Test Seeds Seeds are used to specify tests that must be in the test set (for example, you specify pairwise interaction, but you want a particular triple to be in the test set)

Page – 33 © Telcordia Technologies 2004 – All Rights Reserved Add seed tests Click on the Edit seeds link to specify seed tests.

Page – 34 © Telcordia Technologies 2004 – All Rights Reserved Choose values for seed tests Use the pull- down selection boxes to choose a value for each member of the seed tuple, then click on the Submit values link to save changes. Then click Generate Tests

Page – 35 © Telcordia Technologies 2004 – All Rights Reserved Re-generate to include seed tests Pairs covered by the seed are taken into account, so the addition of this seed test does not increase the total number of cases. Choosing a different seed can cause the generator to require 9 or even 10 cases. The starting point has a big influence.

Page – 36 © Telcordia Technologies 2004 – All Rights Reserved Generated tests with a seed test The seed is the last test. Note that the valid tests are different from those created without the seed.

Page – 37 © Telcordia Technologies 2004 – All Rights Reserved Exercises Create a second seed for the relation, view the spec, and generate tests Delete the seeds for the relation Generate tests for Interaction degree of – 3 (triples) – 1 (no pair-wise coverage requested) Note how many tests are created in each case