TC MTS / STF 430 Close Debriefing Report TTCN language evolution Presented by Stephan Schulz © ETSI 2011. All rights reserved Version: 7 December 2012

Review of completed STFs B88(12)030r1: help Board make more informed decisions on future funding requests Requirement: TB Chairmen to present a few slides on the outcome of the STF, at the Board that follows its conclusion © ETSI 2011. All rights reserved

STF Close (GoTo)Meeting When After conclusion of the work and approval of deliverables Who Reference TB/WG Chairman STF Leader STF Manager Technical Officer editHelp EC Relations Officer (EC/EFTA contracts) CTI Officer (testing STFs) What Review STF work Exchange experience, propose improvement Prepare “STF Close Debriefing Report” © ETSI 2011. All rights reserved

Guidelines for the STF Close Debriefing Report © ETSI 2011. All rights reserved

STF / Project summary Subject: TTCN3 language evolution Objective: handle TTCN-3 CRs, reporting defects / requesting clarifications and requesting new features and implement the solutions in the related ETSI standards. Keep TTCN-3 up to date with standard implementation requirements. Deliverables: upgrade of TTCN-3 set of standards (revised ES’s) Related STFs STF finished: 187, 213, 253, 256, 337, 349, 380, 393, 430 STF in course: 446 (planned ES’s delivery April 2013) New STF 2013: XG (Board approved, start after publication ES’s STF 446) Duration: from 2001 to 2013 Total cost : 710 k€ (average 54,6k€/year) © ETSI 2011. All rights reserveG

STF summary - experts Experts STF 430 Experts related STFs Ina Schieferdecker Fraunhofer FOKUS Jens Grabowski Institut für Informatik György Réthy Ericsson Hungary Jacob Wieland Testing Technologies Experts related STFs Gyorgy Rethy Ericsson Hungary Tibor Csöndes Ericsson Hungary Tamas Kasza Ericsson Ina Schieferdecker Fraunhofer FOKUS Sebastian Müller FSCOM Xiaoming Fu IITB Zhen Ru Dai IITB Benjamin Zeiss Institut für Informatik Jens Grabowski Institut für Informatik Paul Baker Motorola UK Frédéric Roudaut Université de Rennes Colin Willcock Nokia Corporation Stephan Schulz Nokia Corporation Stephan Tobies Nokia Corporation Andreas Ulrich Nokia Siemens Thomas Deiss Nokia Siemens Tomas Urban OU Elvior Steve Randall PQM Consultants Ekkart Rudolph Techn. Univ. Munich Johan Nordin TELELOGIC AB Jacob Wieland Testing Technologies Claude Martin Actimage © ETSI 2011. All rights reserveG

Cost of project Funding overview Total 709 800 EUR 2001 81 000 2002 65 000 2003 61 200 2004 151 800 2005 27 000 2007 12 600 2008 63 600 2009 70 800 2010 39 400 2011 46 800 2012 40 200 2013 50 400 Total 709 800 EUR Average 54 600 €/year © ETSI 2011. All rights reserved

Quality of deliverables All deliverables published ? Yes  No  8 revised ES’s (CR’s, upgrade) 2 new ES’s (new features) Quality of deliverables (content): Added-value of content Technical consistency Precision of content Quality of deliverables (editorial / presentation): Respect of editing rules Structure coherence Clarity /readability © ETSI 2011. All rights reserved

Achievements & unresolved issues Key results achieved with the support of the STF Results that could not have been achieved without the STF TTCN-3 language is one of the success stories of ETSI but requires a continuous maintenance and extension process to be aligned with the evolution of the technologies on which it is applied. This activity requires very specific competence and cannot be effectively completed without the support of an STF. Results expected when proposing the STF and that have not been achieved: reasons and corrective actions. © ETSI 2011. All rights reserved

Impact of deliverables Where and how the STF deliverables will be used by the industry, market impact, expected benefits How standards will be developed and maintained, will new STF funding be required ? © ETSI 2011. All rights reserved

Innovation aspects Innovation aspects may be found in the subject of the STF, the techniques / methodologies applied, opening for ETSI in new domains, interest to attract new ETSI Members © ETSI 2011. All rights reserved

Overall assessment of the STF Did the outcome of the STF meet expectations ? Has the STF been an effective tool to progress the standardization work ? Following this experience, would you recommend your TB to apply again for STF funding ? General comments, suggestions for improvement © ETSI 2011. All rights reserved

Annex – KPI’s © ETSI 2011. All rights reserved

Effectiveness * mark with a cross your assessment for each item (from 1 = poor to 5 = excellent) 2 3 4 5 Comments Achievement of objectives Respect of time scale Quality of deliverables Quality of reporting Respect of TB guidance Respect of ETSI editing rules Respect of ETSI admin. rules Quality of expert’s team Support from secretariat © ETSI 2011. All rights reserved

Interaction with TB (comments/optional) Interest of TB delegates and other stakeholders in STF work: Quantitative (e.g. number of meetings, documents, draft reviews, comments) Qualitative (e.g. comments, technical contributions, etc.) Consultation of TB and stakeholders Initiatives to get directions from Members and other stakeholders Support from stakeholders Voluntary / financial contribution, equipment, etc. Development of related standards: How the STF work can benefit to the development /quality of other standards Suggestions to improve involvement of stakeholders © ETSI 2011. All rights reserved

Quality of STF team (comments/optional) Technical competence Mix of expertise Teamwork Commitment Leadership Respect of TB guidance Quality of reporting Relations with TB delegates and stakeholders Suggestions for improvement © ETSI 2011. All rights reserved

Support from ETSI Secretariat (comments/optional) Technical Officer support Liaison with EC/EFTA, stakeholders, etc. Editing, document processing support IT services Project management support Administrative processes Logistic support, meeting organization Suggestions for improvement © ETSI 2011. All rights reserved