1. CS 350: Introduction to Software Engineering Slide Set 1 C. M. Overstreet Old Dominion University Fall 2006

2. CS 350/ODU2 Lecture overview Announcements Class expectations Structure, grading, project, logistics, semester structure PSP: what’s it about TSP: what’s it about PSP0: details

3. Fall 2006CS 350/ODU3 CS 350: Intro to SE Texts: 1) PSP: A Self-Improvement Process for Software Engineers Watts S. Humphrey, Addison-Wesley, 2005. 2) Introduction to the Team Software Process, Watts S. Humphrey, Addison-Wesley, 2000 (not used till we finish PSP text).

4. Fall 2006CS 350/ODU4 Miscellaneous Class Information Class material is available on web (www.cs.odu.edu/~cmo under cs350) Issues: More time spent on process than coding Team organization for distance students will require more effort Reading assignments: PSP, chapters 1 & 2

5. Fall 2006CS 350/ODU5 Recitations - 1 Recitations are used for tools, mtgs. But no recitation this week!

6. Fall 2006CS 350/ODU6 Recitations - 2 Recitations: You must register for one You must attend Will be used for: Group meetings (later) Project discussions Covering some software tools Reviews of class performance on programming Your data compared to class averages Answering questions

7. Fall 2006CS 350/ODU7 Announcements You must have a CS dept account: Go to www.cs.odu.edu, pick Online Services, then select Account Creation.www.cs.odu.edu

8. Fall 2006CS 350/ODU8 General Information Prerequisites CS 361 or CS 330 UNIX exposure Helpful background Some simple statistics (but we’ll cover in class as needed)

9. Fall 2006CS 350/ODU9 Course Overview Activities: 5 programming assignments, PSP based 1 team project, TSP based 2 in-class exams & comprehensive final recitation/class assignments Grading: Individual projects:20% Team project:20% In-class exams:30% Recitation/class assignments: 5% Final exam:20%

10. Fall 2006CS 350/ODU10 From the Syllabus Honor code Lateness policy Special needs Read the syllabus!

11. Fall 2006CS 350/ODU11 Slides Available before class on Web Slides are OUTLINE only. For content, read textbooks, assigned readings For content, come to class If class is missed, get GOOD notes from class member

12. Fall 2006CS 350/ODU12 Structure/purpose of class projects Not about programming Focus is on the process used to develop software products. Learning the process involves using it to development some software. What’s turned in shows you followed TSP process Five individual projects involving coding However you will spend more time on process steps than coding Industry data: of total project time, 15% is coding Emphasize your Personal Software Process One team project Emphasizes the Team Software Process

13. Fall 2006CS 350/ODU13 Course Objectives 1: PSP Introduce you to a process-based approach to developing software Show you how to measure and analyze your Personal Software Process (PSP) Improve your software development skills: faster development fewer errors (i.e. better software) more predictable (more accurate estimates of time required to complete a project) Show you how to use data to improve your personal performance

14. Fall 2006CS 350/ODU14 Course Objectives 2: TSP Assumes large software project Many people Maybe > 100,000 KLOC Working on teams requires specific skills TSP goals: Understand how to build teams Understand different team roles Understand how to work on teams

15. Fall 2006CS 350/ODU15 A problem with teaching SE principles Students often don’t see need if they haven’t worked on large software projects if they haven’t worked on projects where quality is required Increasing reliance on software whose failure can do significant harm General observation: currently accepted SE principles slow things down in order to speed things up! These techniques work! But programmers (generally) don’t like them.

16. Fall 2006CS 350/ODU16 One definition of software engineering: Computer science with economics How to build a quality system cheaply? One definition of an engineer: Someone who can build for dime what any fool can build for a dollar.

17. Fall 2006CS 350/ODU17 Quick Survey (Quiz 1!) Due Tues.!! What’s best prog. language? What language do you prefer to use? What’s the best OS? What’s the best debugger! Your largest program: a) < 500 loc b) > 500 & < 1 kloc c) > 1 & < 10 kloc d) > 10 & < 100 kloc e) > 100 kloc What’s a kloc? a) comments inc.? b) declarations? c) only exec. stmts? d) number of CRs? Mail to cmo@cs.odu.educmo@cs.odu.edu by Tues. Aug. 29

18. Fall 2006CS 350/ODU18 SE emphasis on metrics & data It’s not engineering if you can’t measure and predict. You can’t predict if without data!

19. Fall 2006CS 350/ODU19 PSP composed of this week’s "best-known practices" May be different next year; likely very different in 10 years. Approaches similar to PSP are widely advocated, and often used in industry. Past perception: most software organizations use poor practices resulting in overly expensive, late, and unreliable software. This must change otherwise more software jobs will move to India! Now required of DoD software contractors.

20. Fall 2006CS 350/ODU20 Unpleasant Facts of life: Some PSP aspects I don’t like. Some I don't believe. You may not either, but after this course, you should be knowledgeable. You will have been exposed in detail to one highly regarded software process; there a many others. Future of software development? India has bright, well-trained software developers, that will work for much less than you. PSP is all about costs, predictability, and quality! In PSP: If you can find a better way to reduce costs, improve quality and improve predictability – and you have data shows it works, you should use it.

21. Fall 2006CS 350/ODU21 Process, Process, Process! Current industry belief: the process used to develop software has significant impact on quality and costs. Things like programming language or design notation mostly don’t C++, C#, Java, PHP, UML will be replaced with something else Maybe even better but we’re in a field too often driven by fads rather than facts! So get the process right! Warning: the software field has been the victim of many fads Process emphasis may be this week’s fad; I’m not sure. You may be able to tell in 5 years

22. Fall 2006CS 350/ODU22 The PSP Metaprocess A process consists of a defined sequence of a steps. For PSP, each step consists of: A set of entry criteria - step cannot start until all entry conditions are satisfied A sequence of carefully defined activities - this is the work to be done in this step A set of exit criteria - you’re not done with the step until these are satisfied

23. Fall 2006CS 350/ODU23 The Changing World of Software Software now controls most business, government, and military systems. Factories are managed by software. Most advanced products are controlled by software. Finance, administrative, and business operations are largely run by software. Cars may have 50 CPUs (microprocessors). The cost, schedule, and quality of software is now a critical business concern.

24. Fall 2006CS 350/ODU24 Software Products are Bigger

25. Fall 2006CS 350/ODU25 Big Software Projects Usually Fail With increased size, projects are more troubled. This is a problem of scale: current software practices do not scale up. Standish: Chaos Reports, 1999

26. Fall 2006CS 350/ODU26 Why Projects Fail - 1 Large and small software projects fail for four reasons. Project commitments are often unrealistic. The larger the project, the less influence we have. If we don’t have anything to say, nobody will listen. Larger projects are harder to control. Today, few developers have personal plans. Without a plan, you cannot know job status. If you don’t know where you are, management can’t understand job status. If management doesn’t understand job status, they can’t manage projects.

27. Fall 2006CS 350/ODU27 Why Projects Fail - 2 Quality problems get worse with project size. In software systems, if any part has quality problems, the system will have quality problems. If the developers do not manage quality, their teams cannot manage quality. When unmanaged, quality will always be poor. To be effective, teams need leadership and coaching. Leaders build team motivation and commitment. Coaching develops team cohesion. Cohesive, motivated, and committed teams do the best work.

28. Fall 2006CS 350/ODU28 The Need for Change Many lives and businesses now depend on software. We now need larger, more complex, and safer software systems on predictable schedules. Without different software practices, this will not happen. The Team Software Process (TSP) addresses this need. The PSP provides the knowledge and skill that developers need to work on TSP teams.

29. Fall 2006CS 350/ODU29 Management Support - 1 An initial TSP objective is to convince management to let your team be self directed. A self-directed team sets its own goals establishes its own roles decides on its own development strategy defines its own processes develops its own plans measures, manages, and controls its own work Self-directed teams do the best work.

30. Fall 2006CS 350/ODU30 Management Support - 2 Management will support you as long as you strive to meet their needs provide regular reports on your work convince them that your plans are sound do quality work respond to changing needs come to them for help when you have problems

31. Fall 2006CS 350/ODU31 Management Support - 3 Self-directed teams are a bargain. Management will agree to your managing your own work as long as they believe that you are doing a superior job. To convince them of this, you must maintain precise and accurate plans measure and track your work regularly show management that you are doing superior work The PSP shows you how to do this.

32. Fall 2006CS 350/ODU32 PSP Principles - 1 The quality of a software system is determined by the quality of its worst components. The quality of a software component is governed by the individuals who developed it. The quality of a software component is governed by the quality of the process used to develop it. The key to quality is the individual developer’s skill, commitment, and personal process discipline.

33. Fall 2006CS 350/ODU33 PSP Principles - 2 As a software professional, you are responsible for your personal process. You should measure, track, and analyze your work. You should learn from your performance variations You should incorporate lessons learned into your personal practices.

34. Fall 2006CS 350/ODU34 What Does a PSP Provide? A stable, mature PSP allows you to estimate and plan your work meet your commitments resist unreasonable commitment pressures You will also understand your current performance be better equipped to improve your capability

35. Fall 2006CS 350/ODU35 What Does the PSP Provide? The PSP provides a proven basis for developing and using an industrial-strength personal process a discipline that shows you how to improve your personal process the data to continually improve the productivity, quality, and predictability of your work

36. Fall 2006CS 350/ODU36 Warning 1: PSP omits keys steps in software development. e.g. I think the most fun and most creative part of software development is deciding what software should do. This is usually the most creative part Good news (I think): this is the part that is hardest to send off-shore Requires determining: What’s the real problem? Is it a problem susceptible to a computerized solution? Or a partial solution? What’s feasible? Technically? Economically? Of feasible solutions, does this one seem the best?

37. Fall 2006CS 350/ODU37 Warning 2. PSP does not discuss support of software after deployment. 80% of software costs is maintenance

38. Fall 2006CS 350/ODU38 Comment Previous slides are from Watts Humphrey Highly respected software engineer But not the only view! For example, some think the BEST way of developing software is the open source model Many people compete to extend, debug, improve software Must discussion within the software engineering community

39. Fall 2006CS 350/ODU39 What is the PSP? The PSP is a personal process for developing software or for doing any other defined activity. defined steps forms standards It provides a measurement and analysis framework for characterizing and managing your personal work. It is also a defined procedure that helps you to improve your personal performance.

40. Fall 2006CS 350/ODU40 The PSP Process Flow Requirements Finished product Project summary Project and process data summary report Planning Design Code Compile Test PM Scripts guide Logs

41. Fall 2006CS 350/ODU41 The Personal Software Process The PSP process is designed for individual use. It is based on scaled-down industrial software practice. The PSP course demonstrates the value of using a defined and measured process. It helps you and your organization meet the increasing demands for high quality and timely software.

42. Fall 2006CS 350/ODU42 Learning the PSP - 1 The PSP is introduced in several upward-compatible steps. You write one or more module- sized programs at each step. You gather and analyze data on your work. You use the results to improve your personal performance.

43. Fall 2006CS 350/ODU43 Learning the PSP - 2 PSP1 Size estimating Test report PSP2 Code reviews Design reviews TSP Team development PSP2.1 Design templates PSP1.1 Task planning Schedule planning PSP0 Current process Time recording Defect recording Defect type standard PSP0.1 Coding standard Size measurement Process improvement proposal (PIP)

44. Fall 2006CS 350/ODU44 Learning the PSP - 3 PSP0:You establish a measured performance baseline. PSP1:You make size, resource, and schedule plans. PSP2:You practice defect and yield management.

45. Fall 2006CS 350/ODU45 At Course Conclusion You can have practiced the key elements of an industrial-strength software process. You can understand which methods are most effective for you. You can do better work. You can have long-term improvement goals.

46. Fall 2006CS 350/ODU46 Course Results SEI now has data on over 30,000 programs written using the PSP. The following charts show how others have improved during the PSP course. size and effort estimating compile and test time productivity

47. Fall 2006CS 350/ODU47 PSP Estimating Accuracy Majority are underestimating With PSP, bal- ance of over- and underestimates Much tighter balance around zero

48. Fall 2006CS 350/ODU48 Compile and Test Time – 810 Engineers

49. Fall 2006CS 350/ODU49 Size and LOC/hour – 810 Engineers Size - LOC Productivity – LOC/hour

50. Fall 2006CS 350/ODU50 Messages to Remember The PSP is a defined process that can help you do better work. Once you have completed the course, you will know how to apply the PSP to your personal needs. You will have the knowledge and skill to be on a TSP team. With PSP0, the objective is to gather accurate and complete data on your work.

51. Fall 2006CS 350/ODU51 Messages to Remember In using PSP0, your principal objective is to learn to gather and report accurate and complete data on your work. Once you have completed this course, you will know how to adjust and extend the PSP to meet your future needs. Until then, make your best effort to follow the PSP process scripts and instructions.

52. Tutorial: Using PSP0

53. Fall 2006CS 350/ODU53 Tutorial Objectives After this tutorial, you will understand the PSP0 process know how to use PSP0 process scripts and forms be prepared to use PSP0 for program 1

54. Fall 2006CS 350/ODU54 PSP0 Process PSP0 is a simple, defined, personal process. Make a plan. Use your current design and development methods to produce a small program. Gather time and defect data on your work. Prepare a summary report.

55. Fall 2006CS 350/ODU55 PSP0 Objective The objective for PSP0 is to demonstrate the use of a defined process in writing small programs incorporate basic measurements in the software development process require minimal changes to your personal practices

56. Fall 2006CS 350/ODU56 PSP0 Process Phases - 1 PSP0 has six phases. Planning – produces a plan for developing the program defined by the requirements. Design – produces a design specification for the program defined by the requirements. Coding – transforms the design specification into programming language statements. Plan Design Code

57. Fall 2006CS 350/ODU57 PSP0 Process Phases - 2 Compile – translates the programming language statements into executable code. Test – verifies that the executable code satisfies the requirements. Postmortem – summarizes and analyzes the project data. Compile Test Postmortem

58. Fall 2006CS 350/ODU58 Phase Order Phase order is determined by the dependencies between phases. You can’t test the code before it’s compiled. You can’t compile the code before it’s written. You can’t use the design if it’s produced after the code is written. There’s no reason to make a plan after you’re done. You should start here Plan Design Code Compile Test

59. Fall 2006CS 350/ODU59 Process Flow For programs that are small or well understood, execute the phases in order. A plan is produced. All modules are designed. All modules are then coded. The coded program is compiled and tested. The project data are summarized during the postmortem. Plan Design Code Compile Test Postmortem Requirements Program and Project data

60. Fall 2006CS 350/ODU60 Cyclic Process Flow -1 Some programs may require an iterative approach. In this example the design is completed in one step. Two modules are identified during the design, modules A and B. Then each module is separately coded, compiled, and tested. This example uses the PSP0 phases and two cycles of code-compile-test. Plan Design Code Compile Test Postmortem Requirements Code Compile Test Module A Module B Program and Project data

61. Fall 2006CS 350/ODU61 Cyclic Process Flow - 2 There can be more than two cycles and cycles can also include the design phase as in this example. Note that each cycle is focused on producing part of the program, e.g. Module A, Module B, Module C. Part size is a key factor for determining cycles. a line of code is too small a program may be too large One or more classes, methods, procedures, functions, etc. are the appropriate size part for a cycle. Plan Design Code Compile Test Postmortem Requirements Module B Design Code Compile Test Module A Module C Design Code Compile Test Program and Project data

62. Fall 2006CS 350/ODU62 Process Scripts Process scripts provide “expert-level” guidance on how to use the process. They are one or two pages long. They describe the Purpose Entry criteria General guidelines Steps Exit criteria

63. Fall 2006CS 350/ODU63 The PSP0 Scripts - 1 Planning: Use your previous experience to estimate: the development time the program size (in LOC) Development: Develop the product using your current methods. Postmortem: Complete the project plan summary with the time spent and defects found and injected in each phase.

64. Fall 2006CS 350/ODU64 The PSP0 Scripts - 2 Design: Design the program using your current design methods. Coding: Implement the program. Compile: Compile until defect-free. Test: Test the program and fix all defects. Record defects in the defect log and time per phase in the time log.

65. Fall 2006CS 350/ODU65 Using Process Scripts Process scripts guide you through the process. You should check the entry criteria before starting a phase record the phase start time perform the phase steps and instructions record defects as they are found and corrected check the exit criteria before ending a phase record the phase end time go to the next phase Force yourself to use this paradigm until it becomes a habit.

66. Fall 2006CS 350/ODU66 PSP0 Measures and Forms PSP0 measures Time – track time in phase Defects – record defects as they are found and fixed PSP0 has four forms PSP0 Project Plan Summary – summarizes planned and actual time and defects by phase PSP0 Time Recording Log – used to record time PSP0 Defect Recording Log – used to record defects PSP0 Defect Type Standard – used to define standard defect types

67. Fall 2006CS 350/ODU67 Measurement Hints Gather and record data on your process as you work, not afterwards. If you forget, promptly make your best guess. Be precise and accurate. time in minutes count every defect You will be using your own data to manage your process; gather data that is worthy of your trust.

68. Fall 2006CS 350/ODU68 Defect Fix Time Defect fix time is often misunderstood. It is the time taken both to find and fix the defect. Example 8:05run compiler on p1a.c, “line 23 - type mismatch” 8:06run editor on p1a.c 8:15change declaration on line 6 from integer to real 8:16run compiler on p1a.c, “no errors” Q: What is the defect fix time? A: 10 minutes

69. Fall 2006CS 350/ODU69 Defect Phase Injected The injected phase for a defect depends on the phase the program is in. Example: Tom finds a major logic error in his program during test. He has to redesign and code part of his program. Q: What phase is Tom’s program in? A: Test Tom finds a defect in the new code he has written. Q: In what PSP phase was the defect injected? A: Test Plan Design Code Compile Test Postmortem Requirements Program and Project data

70. Fall 2006CS 350/ODU70 Measurement in the Cyclic Process Considerations Include a program part identifier in the notes field on time log entries. Add a similar annotation to defect log entries. Use “Test” as the phase removed when defects are found in a previously tested part. Example Tom finds and fixes an interface error in part A of his program while coding part B. Q: In what PSP phase was this defect removed? A: Test Plan Design Code Compile Test Postmortem Requirements Code Compile Test Module A Module B Program and Project data