1. Callis ApS, Copyright © 2007-10 Reviewer Training Material Callis Reviewer version 1.1

2. Copyright © 2009, Callis Why are Peer Reviews interesting? Peer reviews are the only technique available to detect defects in life-cycle work products in the early phases of development Peer reviews are a reliable way of measuring the quality of the work that has been performed Peer reviews reduces cost and time in later phases of development, e.g. test and integration Peer reviews reduces total system maintenance cost dramatically (up til 10 to 1 according to Kasse, 2007) Are You a believer?

3. Copyright © 2009, Callis Often, this is the situation! Peer review process is poorly defined Process is often not followed No controlled use of checklists People are not thoroughly trained Issues are not systematically tracked to closure No or limited tool support means low efficiency Data are not collected and used to improve process Limited visibility into scheduling and results Callis Reviewer helps these issues by providing a standardized review solution

4. Callis Reviewer is A standard solution supporting the peer review process Planning including roles, documents, focus areas, and checklists, generating standard invitation Reporting defects including description, type and severity of defect, if found by checklist Processing defects including presenting defects in relevant order, defining actions, allocating responsibility Approval and reporting including presenting defect distribution, defect density, prepation rate, approval categories, and generating review report in pdf Presenting overviews and indicators, e.g. ”my reviews”, reviews performed, defects found, checklist efficiency, and review timeline Configuration of relevant parameters easy, including roles, document categories, severity and type codes, approval types, checklists, etc. Copyright © 2010, Callis

5. Overview of Review Process Copyright © 2010, Callis Four Phases: Plan: Add purpose, roles, documents, generate invitation Prepare: Reviewers registers findings and can get an personal reciept Conclude: Conclusion are made on documents, meeting data are registered Follow up: Corrector corrects document and sets resolution state on findings. Review report can be generated. Three documents: Invitation, My findings, and Review report Metrics collected in database

6. Callis Reviewer Callis Reviewer Tech. Overview Copyright © 2010, Callis MSSQL Rich Web2.0 user interface Review report Indicators/data MS IIS Review Invitation

7. Callis ApS, Copyright © 2010 My Reviews ”My Reviews” lists all reviews that you are invited to (or have created=Owner) Selecting a node in the ”Projects” tree below will show reviews sorted on specific projects When ”Show all” is selected, both opened and closed reviews are listed The state of a specific review is displayed in the ”Status” coloumn – both using colors and text The ”New Review” button is used to create a new review An existing review can be opened by double clicking on the relevant row in the list

8. Review process and status overview Callis ApS, Copyright © 2010 State Participants Phases Process and work products Metrics

9. Callis ApS, Copyright © 2010 Short-cut keys supported (from help)

10. Callis ApS, Copyright © 2009 Review Planning Coloring groups tabs into review phases (plan, prepare, conclude, follow up) Numbers on tab (1+2+3) documents sequence in actions needed to plan review) Please notice that an asterisk (*) will indicate unsaved data on tab (not shown here)

11. Callis ApS, Copyright © 2010 Participants – Select user Press ”New” to define new review participant Select participant in list and press ”Edit” to change participant data ”Can Manage Review” gives the user rights to change review meeting setup data, e.g. documents to review etc. ”Can view all findings” makes it possible to view findings made by other reviewers

12. Callis ApS, Copyright © 2010 Participants – Select user User name on review participants are fetched from MS Active Directory Short names can also be typed directly, if known Select user in list and press OK

13. Callis ApS, Copyright © 2010 Build-in display of configuration data Description text on all configurable data can be displayed by hovering the parameter. This includes Review types Role definitions Document types Severity codes Defect type codes Conclusion types Resolution types Hover this!

14. Callis ApS, Copyright © 2009 Documents HTTP-links to document can be entered or use file browser to browse to file location Size data are used to produce metrics and indicators HTTP-link here!

15. Callis ApS, Copyright © 2009 Documents - Browse to file location Alternatively, select the icon to browse to the file in a shared part of your file system. Only supported in in MS Internet Explorer...

16. Callis ApS, Copyright © 2010 Generate review invitation

17. Callis ApS, Copyright © 2009 Additional Material Add background information / additional material, as needed Same method as when adding documents...

18. Callis ApS, Copyright © 2010 Prepare Please notice that the prepare phase starts with entering findings (next tab and next slide!) ”Minutes used preparing” is used to calculate prepation rates, indicators etc. ”Mark as completed” indicates to review leader and other reviewers, that your are ready to meet and review the documents

19. Callis ApS, Copyright © 2009 My Findings

20. Callis ApS, Copyright © 2010 All Findings To refresh for new findings from other users, use

21. Callis ApS, Copyright © 2009 Conclude – part 1 Approval of the individual documents

22. Conclude – part 2 Callis ApS, Copyright © 2009

23. Callis ApS, Copyright © 2010 Follow up Complete the review Generate the review report (can also be done from the “Overview” tab Please notice that you can set resolution on findings on the findings tab Data on tabs can not be changed, when the review is closed (without opening the review first)

24. Callis ApS, Copyright © 2010 Generate review report Generate the review report (can also be done from the “Overview” tab

25. Copyright © 2009, Callis An sustainable solution Callis Reviewer is an easy sustainable peer review solution Tool supporting the review process including planning, reporting in and processing defects and generating review report Predefined indicators for sustaining implementation, management insight and continuous improvement Training material supporting use of the tool With the following customer business characteristics Reduced risk – By offering a complete and ready-to-go solution in stead of a internal development project or inefficient spread sheets/paper solutions Reduced cost – By making your reviews more effective and efficient - with a break even measured in (a few) months for most organizations Reduced schedule – By providing a COTS solution including tool, process descriptions and training material – and a trainer, if needed Building on a proven solution which is maintained, improved and extended with new functionality

26. Thank you for using Callis Reviewer! Please point anyone you think could benefit from Callis Reviewer to our website: www.callis.dkwww.callis.dk This will help us add more and more functionality into the solution – and your organization will benefit from that! Copyright © 2007 - 10, Callis