1. ReviewsReviews Copyright, 2002 © Jerzy R. Nawrocki Jerzy.Nawrocki@put.poznan.pl www.cs.put.poznan.pl/jnawrocki/mse/quality/ Quality Management Auxiliary Material Quality Management Auxiliary Material

2. J. Nawrocki, Reviews IntroductionIntroduction The relative time to identify defects (IBM ): during design reviews: 1 during code inspections: 20 during machine test: 82 Some fix time data Cost of fixing a defect

3. J. Nawrocki, Reviews Statement of work IntroductionIntroduction Statement of work External commitments Project at selected  milestones The software baseline (audit) Reviews at CMM Level 2

4. J. Nawrocki, Reviews Generic FTR procedure Parameters to be specified in SDP Name of the product URL of the standard doc-struct Due date for approved product Producer Review leader (SQA group) Recorder (SQA group) Reviewers (including recorder) Expected preparation time Expected meeting duration  SDSD P

5. J. Nawrocki, Reviews Generic FTR procedure Steps (I) Producer informs the project leaders + review leader + area manager (Bartek) that the product is ready and sends them a copy of it. The review leader contacts all the participants of the review meeting to establish the date of the meeting (preferably in 3 days). He also distributes copies of the product to the reviewers.

6. J. Nawrocki, Reviews Generic FTR procedure Steps (II) The review leader is responsible for establishing an agenda for the review meeting. The meeting takes place The recorder prepares a review report and sends it to the participants of the meeting. A copy of it must also go to the project managers, the area manager and the SDS supervisor.

7. J. Nawrocki, Reviews FTR meeting A proposed agenda (I) Review leader: Introduction of the agenda. Participants can propose some changes. Recorder: Collecting the preparation forms (copies) Producer: Presentation of the material. The producer “walks through” the material and explains, while reviewers raise issues. The recorder takes notes of valid defects and problems.

8. J. Nawrocki, Reviews FTR meeting A proposed agenda (II) Recorder: Summary of defects and problems. All attendees except producer: Anonymous (in written) presentation of early decision. Recorder: Collecting of early decisions and their presentation. Producer: “Last word” All attendees except producer: Making final decision

9. J. Nawrocki, Reviews FTR meeting The decision Accept. No modifications are necessary Accept provisionally. There are some minor defects that must be corrected but no additional review is required (the project manager is responsible for checking the follow-up). Reject. There are severe defects and another review is necessary.

10. J. Nawrocki, Reviews FTR meeting The decision If the decision made by the reviewers is not clear (e.g. some are for Accept, some for Reject), the final decision belongs to the area manager.

11. J. Nawrocki, Reviews Preparation form for FTR Heading Name of the product & its version:... Producer:............................................. Reviewer:............................................. The product received on:................... Expected preparation time:............... Actual preparation time:.................... Meeting scheduled on:...................... Early decision:....................................

12. J. Nawrocki, Reviews Preparation form for FTR Body Severe defects & problems (e.g. hidden problems, ambiguity, lack of understanding, etc.) Problem description (annotation) Minor problems (e.g. spelling, grammar, format etc.) Problem description (annotation)

13. J. Nawrocki, Reviews Preparation form for FTR Education: don’t understand Communication: not properly informed Oversight: omitted doing something Transcription: knew & did but made a mistake Process: due to the process “Two” or “too”? Annotations - Basic defect causes

14. J. Nawrocki, Reviews Fagan inspections Design Code Test External specifications (function) Internal specifications (module) - I 0 Logic specifications (logic) - I 1 design inspec Coding (logic) - I 2 code inspec Unit testing The lifecycle Function, component, system test

15. J. Nawrocki, Reviews Fagan inspections Other inspections: IT 1 - test plan inspection IT 2 - test case inspection PI 0, PI 1, PI 3 - publication inspections

16. J. Nawrocki, Reviews Fagan inspections DesignDesignCodeCodeUnittestUnittest I1I1 I2I2 I3I3 Net savings (hours/KLOC): I 1 : 94 I 2 : 51 I 3 : -20

17. J. Nawrocki, Reviews Designer Fagan inspections Implementor Moderator Tester Review session

18. J. Nawrocki, Reviews Fagan inspections 1. Overview (whole team) 2. Preparation (individual) 3. Inspection (whole team) 4. Rework 5. Follow-up Designer Implem. Moderator Tester Review session

19. J. Nawrocki, Reviews Fagan inspections Overview (whole team) 500 not necessary Preparation (individual) 100 125 Inspection (whole team) 130 150 Rework 50 60 Follow-up - - I1I1I1I1 I2I2I2I2 Rate of progress (loc/h) Inspection session <= 2 hours 1 - 2 sessions per day

20. J. Nawrocki, Reviews Fagan inspections CD: CB definition CU: CB usage IC: Interconnect calls LO: Logic MD: More detail MN: Maintainability OT: Other PE: Performance PR: Prolog... Design error types Question: What should be the design error types for UML?

21. J. Nawrocki, Reviews Fagan inspections CC: Code comments CU: CB usage DE: Design error IC: Interconnect calls LO: Logic MN: Maintainability OT: Other PE: Performance PR: Prolog... Code error types Question: What should be the design error types for Java or HTML?

22. J. Nawrocki, Reviews Fagan inspections Are all constants defined? If a queue is being manipulated, can the execution be interrupted; If so, is queue protected by a locking structure? Are registers being restored on exits? Are all increment counts properly initialised (0 or 1)? Are absolutes shown where there should be symbolics? Are all blocks shown in design necessary? Checklist for design inspection Ex Wr Missing

23. J. Nawrocki, Reviews Fagan inspections Is correct condition tested? Is correct variable used or test? Is each branch target correct? Is the most frequently exercised test leg the THEN clause? Are all required parameters passed set correctly? Does the inline expansion contain all required code? Checklist for code inspection Test branch Interconnect

24. J. Nawrocki, Reviews Fagan inspections PR/M/Min L3: the prologue in the REMARKS section needs expansion. LO/W/Maj L172: NAME-CHECK is performed one time too few. DE/W/Min L175: the design should allow for the occurrence of a period in a last name. Error list

25. J. Nawrocki, Reviews Fagan inspections CC: Code comments CU: CB usage DE: Design error IC: Interconnect calls LO: Logic MN: Maintainability OT: Other PE: Performance PR: Prolog Major Minor Major Minor M W E M W E M W E M W E Date.............. Code inspection report Mod/Mac:....................... Total

26. J. Nawrocki, Reviews Active design reviews Parnas and Weiss, 1985 Questions posed by the author of the design - to encourage a thorough review Several brief reviews focusing on a part of a work product (part of a design document)

27. J. Nawrocki, Reviews Phased inspections 1 Compliance with required internal documentation format. Also spelling and grammar can be checked here. 2. Source code layout. 3. Readability. 4. Good programming practice (gotos, global variables,..). 5. Correct use of various programming constructs (updating control variables for while, closing files,...). 6. Functional correctness.

28. J. Nawrocki, Reviews Phased inspections Defects: indigenous seeded

29. J. Nawrocki, Reviews SummarySummary Review procedures can be stated in a generic form. The main difference between a Fagan inspection and walk- through is: lack of checklists for walk- throughs, and lack of presentations for Fagan inspections.

30. J. Nawrocki, Reviews Further readings M. Fagan, “Design and Code Inspections..”, IBM System J., vol. 15, no.3, 1976, 182-211. M. Fagan, “Advances in Software Inspections”, IEEE TSE, vol. SE-12, no. 7, 1986. J.C. Knight, E.A. Myers, An improved inspection technique, CACM, vol. 36, No.11, Nov. 1993, pp. 51-61. 

31. J. Nawrocki, Reviews Quality assessment 1. What is your general impression? (1 - 6) 2. Was it too slow or too fast? 3. What important did you learn during the lecture? 4. What to improve and how?