© 2003 Fokus/TIP 1 Testability Interface Test Runtime Interface (TRI) George Din, Andreas Hoffmann, Ina Schieferdecker { din | a.hoffmann | schieferdecker

© 2003 Fokus/TIP 2 Overview 1.Prerequisites –TTCN-3 Language –A TTCN-3 Runtime System 2.Testability interface –The TTCN-3 Runtime Interface (TRI) –Input for T11 - Generalized execution environment 3.TTCN-3 Logging compliant vs. Hyades Monitoring L. 2 –The TTCN-3 Logging Interface –Adapting TTCN-3 Logging to Hyades Logging Framework

© 2003 Fokus/TIP 3 1. TTCN-3 Language A TTCN-3 Runtime System

© 2003 Fokus/TIP 4 TTCN-3 The Testing and Test Control Notation (version 3) Standardized by ETSI The standardized test specification and test implementation language Wide scope of application –applicable to many kinds of test applications not just conformance, i.e. also for development, system, integration, interoperability, scalability … testing –applicable in the telecom and IT domains –used both for standardized test suites –and as a generic solution in software development More details about TTCN-3 in 2nd presentation this afternoon

© 2003 Fokus/TIP 5 Main Capabilities of TTCN-3 Dynamic concurrent testing configurations Synchronous and asynchronous communication mechanisms Encoding information and other attributes Data and signature templates with powerful matching mechanism Assignment and handling of test verdicts Test suite parameterization and testcase selection mechanisms Well-defined syntax, interchange format Type and value parameterization

© 2003 Fokus/TIP 6 TTCN-3 and Related Standards ETSI ES TTCN-3 Core Language (CL) 2nd presentation … ETSI ES TTCN-3 TTCN-3 Runtime Interface (TRI) Later in this presentation ETSI ES TTCN-3 TTCN-3 Control Interfaces (TCI) 2nd presentation

© 2003 Fokus/TIP 7 Test System User System Under Test (SUT) Test Execution (TE) Test Management (TM) Platform Adapter (PA) System Adapter (SA) Component Handling (CH) CoDec (CD) TTCN-3 Runtime System TTCN-3 programme Port implementation Timer and external functions implementation Communication between test components Type and Value Implem. Start and stop test cases …

© 2003 Fokus/TIP 8 Test System User System Under Test (SUT) Test Execution (TE) Test Management (TM) Platform Adapter (PA) System Adapter (SA) Component Handling (CH) CoDec (CD) Test Control Interface (TCI) TTCN-3 Runtime Interface (TRI) TTCN-3 Runtime System

© 2003 Fokus/TIP 9 Test Execution Test System + communication SUT TE ATS

© 2003 Fokus/TIP 10 Eclipse based TTCN-3 Editor Features Syntax Highlighting Syntax Error Checker Outline View Task viewer for errors Keyword completion Context sensitive To be integrated in Hyades

© 2003 Fokus/TIP The TTCN-3 Runtime Interface (TRI) Input for T11 - Generalized execution environment

© 2003 Fokus/TIP 12 TRI – Communication Adaptation Facts on the TTCN-3 Runtime Interface Standardized (part 5) Language independent specification (IDL) Multi-vendor support Communication adaptation Configuration dependent For each configuration done once Default timer implementation can be generated (PA) Input for T11: the definition of a testable interface to SUT TE Test System User SUT TCI TRI CH CD SAPA TM

© 2003 Fokus/TIP 13 TRI – Interface Structure Structure of interfaces applies to all TRI interfaces SA/PA reports status back to TE System adaptation: Communication with SUT Platform adaptation: timer and external functions implementation TE indicates error TE PA TriPlatformPA TriPlatformTE SA TriCommunicationSA TriCommunicationTE TE

© 2003 Fokus/TIP 14 The TciCommunicationSA Interface Defines setting up configuration and sending of message to and/or calling of operations in the SUT Complete set of operations TriStatusType triSAReset(); TriStatusType triExecuteTestCase(...); TriStatusType triMap(...); TriStatusType triUnmap(...); TriStatusType triSend(...); TriStatusType triCall(...); TriStatusType triReply(... ); TriStatusType triRaise(...); TriStatusType triSUTactionInformal(...); TriStatusType triSUTactionTemplate(...);

© 2003 Fokus/TIP 15 TriCommunicationTE Interface Defines receiving of messages and/or calling of operations in the TE Complete set of operations: void triEnqueueMsg(...); void triEnqueueCall(...); void triEnqueueReply(...); void triEnqueueException(...);

© 2003 Fokus/TIP 16 TriPlatform Interface Defines control of time and calling of external functions Complete set of operations (PA) TriStatusType triPAReset(); TriStatusType triStartTimer(...); TriStatusType triStopTimer(...); TriStatusType triReadTimer(...); TriStatusType triTimerRunning(...); TriStatusType triExternalFunction(...); Complete set of operations (TE) void triTimeout(...); TE PA TriPlatformPA TriPlatformTE

© 2003 Fokus/TIP 17 Adapting Test Systems to SUT with TRI TRI – test and platform specific adaptation layer TRI provides a set of operations... independent of the –target platform –SUT –middleware –implementation language TRI is a common interface to different types of SUTs –Defined in IDL –Mappings to Java and C exists Possible integration of existing Test Adapters (GSM, N-ISDN, B-ISDN, CORBA applications)

© 2003 Fokus/TIP 18 HTTP Test Adapter example public htmlTestAdapter extends TestAdapter { private URL url = null; public TriStatus triMap(TriPortId compPortId, TriPortId tsiPortId){ te.triMap(compPortId, tsiPortId); Thread runningThread = new Thread(){ public void run(){... while (...) { if(url != null){ StringBuffer sb = new StringBuffer(); InputStream is = url.openStream(); BufferedReader br = new BufferedReader(new InputStreamReader(is)); String line = br.readLine(); while (line != null) { sb.append(line); line = br.readLine(); } TriMessage rcvMessage = new TriMessageImpl(sb.toString().getBytes()); te.triEnqueueMsg(tsiPortId, new TriAddressImpl( new byte[] {}), compPortId.getComponent(), rcvMessage); }}}... } public TriStatus triSend(TriComponentId componentId, TriPortId tsiPortId, TriAddress address, TriMessage sendMessage){ byte[] mesg = sendMessage.getEncodedMessage(); url = new URL(new String(mesg)); }

© 2003 Fokus/TIP The TTCN-3 Logging Interface Adapting TTCN-3 Logging to Hyades Logging Framework

© 2003 Fokus/TIP 20 TTCN-3 Logging Interface Logging of the TTCN-3 Execution Environment Not standardized but adopted by TestingTech, Nokia Logging Types: –TCI specific: management of components, tests –TRI specific: management of timers, communication with SUT –Error Handling: exceptions, errors –Debug: debugging information at execution Contains ~ 60 methods The implementations usually produce XML events

© 2003 Fokus/TIP 21 Test Logging API logStartTestCase() logStopTestCase() logTestCaseStarted logTestCaseTerminated... logCreateTestComponent() logStartTestComponent() logStopTestComponent()... logSendConnected() logCallConnected() logReplyConnected() logRaiseConnected()... logDebug() logEvent() logError()

© 2003 Fokus/TIP 22 Compliance with Monitoring Level 2 Data Collection –The Logging Interface is implemented as RAC server –Hyades can connect anytime and collect logging data Visualization –Hyades views can be used –For more detailed visualization, the Hyades views should be extended Implementation –Common Logging format for TTCN-3 (XML Schema) –Common parser (TTCN-3 XML Logs CBE Events) Benefits –One common RAC Server for TTCN-3 Logging

© 2003 Fokus/TIP 23 Summary Integration of TTCN-3 Editors in Hyades Propose TRI as SUT testable interface Input for T11 - Generalized execution environment Adopt TRI as general interface to SUT A large number of implementations already exist RAC server for TTCN-3 Logging interface TTCN-3 specific Logs can be visualized in Hyades