1. COTS-Based System

2. Agenda Presentation –Project purpose –Introduction –COTS-Based System Types –COTS-Based System Development Process –Examples of COTS-Based System –Examples of CBS Management –Benefits of COTS-Based System –Weakness of COTS-Based System –Conclusion Question Exercise Discussion

3. Project Purpose –To define COTS Products, COTS-Based system –To show benefits and weakness of COTS- Based system –To explain COTS-Based system Development Process –To guide preparation and management of COTS-Based system particularly in Evaluation and Maintenance Management.

4. Introduction COTS ( Commercial Off The Shelf) COTS Product –is a software product that has been sold, leased, or licensed to the general public by a commercial entity in a business of making a profit from product with multiple identical copies available –where integrators use the product without modification of its internals –and the commercial entity provide product support and evolution. COTS-Based System (CBS) –Contains components of COTS-Products –Non-Developmental Items –Multiple components and vendors

5. COTS-Based System Types Turnkey systems are built around a suite of commercial products, such as Microsoft Office or Netscape Navigator. Only one COTS is used, and customization does not change the nature of the initial COTS. Intermediate systems are built around one COTS (e.g. Oracle) but integrate other components, commercially or produced or developed in-house. Intensive systems are built by integrating several COTS, all on the same level of importance.

6. COTS-Based System Development Process

7. A New Look at COTS-Based Systems Qualify Adapt Assemble Upgrade COTS Market Selected products are qualified to be “fit for use” as components Qualified products are adapted to be components that can be integrated Adapted components are assembled by using architecture, infrastructure, or middleware Upgrades to the system occur as needed and are facilitated by proceeding steps The market supplies products Copyright 1997 Software Engineering Institute

8. CBS Life-Cycle Qualification Adaptation Assembly Upgrade

9. Qualification A process of evaluation and selection. Not only product but also vendor and technology must be qualified

10. Qualification (Cont’d.) Product Considerations Wide customer base Continual improvement to stay in market Usability and reliability Open Interface Supporting TOOLS Useful documentations

11. Qualification (Cont’d.) Vendor considerations Relationship Maintenance ability Training ability Development Certification Product release plan

12. Qualification (Cont.) System Context considerations Requirements Constraints Previous products

13. Adaptation Adaptation in CBS is not modification Process of adapting the COTS Products to fit the requirements Sometimes the legacy system must be adapted to fit the products. COTS Products are black-boxes that have no source code, so some functions are written using “glueware” or “wrappers,” passing by API or SQL standards to make them compatible.

14. Assembly Process of integration among the products by using “wrappers” or “gluewares” Component combined to other components might be COTS Product or Non-COTS Product

15. Upgrade Involves upgrade product versions Involves upgrade technology The longest life phase Repeatable The most expensive phase Driven by external environment such as vendor and Technology change.

16. Development Process Outlines System analysis Product selection Product evaluation System Design Integration Testing Maintenance

17. Example of CBS Development Process Publication of investigating and improving CBS Development Process

18. CBS Roles & Responsibilities Qualify Adapt Assemble Update COTS Market Copyright 1997 Software Engineering Institute

19. Roles & Responsibilities RoleResponsibilities Project leader-Project Management Marketing-Market research of COTS Products -Licenses negotiation -Vendor relationship System Analyst-System analysis -Product selection and evaluation -Impact analysis System Design-Design a system and integrated parts Developer-Programming -System test Logistic support-Install system -Backup, and Recovery system Process Engineer-CBS Techniques and management tools -Development Process -System Configuration

20. Fundamental change of CBS approach

21. Key Activity Area Engineering Business Contract Program-wide

22. Key Activity Area Engineering Activities System context Marketplace Architecture and Design Construction Configuration Sustainment Evaluation

23. Key Activity Area Business Activities Business Case Estimate cost Maintain vendor relationship

24. Key Activity Area Contract Activities Contract requirement Solicitation Contract tracking and oversight License negotiation

25. Key Activity Area Program-wide Activities CBS Strategy Risk Management Tradeoffs Cultural transition Information Sharing

26. COTS Intensive System Evaluation Formative Evaluation Ensemble Evaluation Continuous Evaluation Business Evaluation Exploratory Evaluation

27. Formative vs. Normative Evaluation

28. Ensemble Evaluation

29. Continuous Evaluation

30. Continuous Evaluation (Cont’d.)

32. Business Evaluation

33. Exploratory Evaluation

34. CBS Maintenance Management Risks Management Activities

35. Risks in Maintenance phase Risk from upgrading product version Risk from product modification Risk from Technology change Multiple-COTS Products Quality viewed by supplier

36. Management Activities Market research Impact Analysis Configuration Logistic support

37. Market Research Guidance: How often are new versions released? How long are the products in market and how stable are they? How will new versions impact the other sites? What are the responses from other sites using the same products? What are the responses of the products and the services from other purchaser using products developed from same vendor as ours? What is the direction of development of hardware and software?

38. Impact Analysis The results from a market research are analyzed what the impact might happen and finally the impact protection activities must be defined.

39. Configuration Keep track all versions or releases of the products and product information and always having copy of every released. Vendor information. Referenced site information. Activity information What activities have been done, when, and by whom? What are the results of each release?

40. Logistic Support This activities include the acquisition, distribution, and installation of copies of upgraded COTS-Products. It also includes the re-installation when the upgraded version corrupts.

41. Example of COTS-Based System DeveloperCBS System EDO CooperationCombat System U.S. NavyRadar Tracking System NASAEPOCH2000 Satellite Ground System LABVIEW Advanced Orbiting System URL: http://joy.gsfc.nasa.gov/MSEE/tooleval.htmhttp://joy.gsfc.nasa.gov/MSEE/tooleval.htm

42. Examples of CBS Management CURE

43. Offered by Software Engineering Institute Focused on evaluation of CBS development project. Given during the early stages of a program and can even before a specific vendor has been chosen. Evaluated risk reports are delivered 2 weeks after onsite visit

44. Benefits of COTS-Based System To Improve software development process To reduce coding, debugging, unit testing, code inspection To reduce software life-cycle To reduce development cost

45. Weakness of COTS-Based System

46. A new COTS-based System! Copyright 1997 Software Engineering Institute

47. But Wait! An Upgrade! Copyright 1997 Software Engineering Institute

48. No problem! I’ll make it fit! Copyright 1997 Software Engineering Institute

49. Out of Business All done. (Maybe not) Copyright 1997 Software Engineering Institute

50. The moral of the story is… Integration is not a one time event. The COTS marketplace drives continuous system upgrade. Systems must be engineered to accommodate marketplace imperatives. Copyright 1997 Software Engineering Institute

51. Conclusion CBS – A new technology to improve software development process by integrating the previous Off-the- shelf products into a larger system. CBS benefit to improve software development process, reduce time and cost. CBS differs from Custom-Based Design System in many terms- Life cycle, Process, Activities, Role, Management, and Risk. To approach CBS all activities in the areas of system context, architecture & design, and marketplace are considered simultaneously New engineering activities, managing activities, methodologies, supporting tools, today, are researched for a CBS Success.

52. References 1. COTS Base System Initiative By Carnegie Mellon University URL: http://www.sei.cmu.edu/cbs/index.htmlhttp://www.sei.cmu.edu/cbs/index.html 2. SEI MONOGRAPHS ON THE Use of Commercial Software in Government Systems. Case Study: Evaluating COTS Products for DoD Information Systems. By Carol Sledge and David Carney URL: http://www.sei.cmu.edu/cbs/index.htmlhttp://www.sei.cmu.edu/cbs/index.html 3. The Basic for COTS Software Evaluation: Foundation for the design of CIS By Kurt C. Wallnau URL: http://www.sei.cmu.edu/cbs/index.htmlhttp://www.sei.cmu.edu/cbs/index.html 4. A Management Guide to Software Maintenance in COTS-Bases system By: Judith A. Clapp and Audrey E. Taub URL:http//www.mitre.org/resources/conters/sepo/sustainment/manage_guide_cotsbase.html 5. An Activity Framework for COTS-Based Systems. By: Lisa Brownsword, Patricia Oberndorf, and Carol A.Sledge URL: http://www.stsc.hill.af.mil/CrossTalk/2000/sep/brownsword.asphttp://www.stsc.hill.af.mil/CrossTalk/2000/sep/brownsword.asp

53. References (Cont’d) 6. Investigating and Improving a CBS Development Process By M. Morisio 1, C.B. Seaman 3,4, A. T. Parra 2, V.R. Basili 1,4, S.E. Kraft 5, S.E. Condon 2 1 University of Maryland College Park, MD 20742, USA, {morisio, basili}@ cs.umd.edu 2 Computer Sciences Corporation, Greenbelt, MD 20771, USA, {aparra, scondon} @ csc.com 3 University of Maryland Baltimore County, Baltimore, MD 21250, USA, cseaman@umbc.edu 4 Fraunhofer Center Maryland, College Park, MD 20742, USA, basili@ fc-md.umd.edu 5 NASA/Goddard Space Flight Center, Greenbelt, MD 20771, USA, stkraft@ gsfc.nasa.gov http://www.research.umbc.edu/~cseaman/papers/icse00.doc

54. Question

55. Exercise

56. CBS Case Study: Military Information System System Requirements Constraints Product Evaluations activities Results of evaluations Problems

57. Class Discussion

58. DISSCUSSION TOPICS Do you think what is the weakness or might be the problems of RAMESES Method? How custom-based design system differs from COTS- Based system in term of project planning? Is CBS project management more complicate or simple than custom-based design system?