1. Copyright © 2006, Systems and Software Consortium, Inc. www.systemsandsoftware.org Richard Turner SIS Producibility Workshop 6-7 September 2006 Status: Governance Structure for SIS Producibility Initiative

2. Copyright © 2006, Systems and Software Consortium, Inc. Status: Governance for SIS Producibility Initiative 2 Outline Background Governance Examples Current thoughts Next steps

3. Copyright © 2006, Systems and Software Consortium, Inc. Status: Governance for SIS Producibility Initiative 3 Background SIS Productivity needs an organizational structure to – Increase stakeholder confidence – Maintain initiative continuity – Measure progress – Adapt to change – Assure transition – Manage overall initiative activities

4. Copyright © 2006, Systems and Software Consortium, Inc. www.systemsandsoftware.org What is Governance?

5. Copyright © 2006, Systems and Software Consortium, Inc. Status: Governance for SIS Producibility Initiative 5 Governance Roles/Responsibilities - 1 Strategic management and vision – Guides the 7-year program, aligns work – Creates and maintains roadmap and goals – Maintains strategic coordination – Measures progress of program Tactical program management – Allocates resources – Monitors, controls and evaluates contracted work – Validates results – Drives transition

6. Copyright © 2006, Systems and Software Consortium, Inc. Status: Governance for SIS Producibility Initiative 6 Governance Roles/Responsibilities - 2 Tactical Research Management – Guides research – Allocates specific research resources – Designates specific research tasks – Manages IP rights – Coordinates publication and knowledge management – Prepares for transition Funding – Solicits and manages funding – Establishes contracting mechanisms

7. Copyright © 2006, Systems and Software Consortium, Inc. www.systemsandsoftware.org Examples We Found

8. Copyright © 2006, Systems and Software Consortium, Inc. Status: Governance for SIS Producibility Initiative 8 Summary of governance examples - 1 Versatile Affordable Advanced Turbine Engines (VAATE) – National program (Services, DARPA, NASA, DOE) – Directed by AFRL, managed by industry members – Detailed, hierarchical technology roadmap – Government contracted research Microelectronics Advanced Research Corp. (MARCO) – Executed through DARPA, directed by a consortium – Pools funding from industry and gov’t. sources – Consortium selects, contracts with and monitors self- organizing, self-managing Focused Research Centers

9. Copyright © 2006, Systems and Software Consortium, Inc. Status: Governance for SIS Producibility Initiative 9 Summary of governance examples - 2 Advanced Research and Technology for Embedded Intelligence and Systems (ARTEMIS) – European Union Joint Technical Initiative – Strategic Research Agenda and steering group – Supports various networks and conferences – Still researching funding approach IT for European Advancement 2 (ITEA-2) – Blue Book for strategic alignment – National funding and management – Projects nominated to receive ITEA-2 endorsement to help gain national funding

10. Copyright © 2006, Systems and Software Consortium, Inc. Status: Governance for SIS Producibility Initiative 10 Summary of governance examples - 3 High Dependability Computing Program (HDCP) – NASA initiative loosely led by CMU – Research in new approaches for developing mission critical systems – Development of testbeds was major part of initiative – Large number of research universities and affiliates participated – Several testbeds developed before funding was dropped in 2005

11. Copyright © 2006, Systems and Software Consortium, Inc. Status: Governance for SIS Producibility Initiative 11 Observations from examples VAATE has good roadmap depth and evaluation methods but no specific academic involvement MARCO’s independent consortium and research centers provide for mixed funding sources and research partnering Artemis roadmap is appropriate to much of our interest ITEA-2 funding strategy doesn’t provide “government buy-in for alignment” but evaluation process for projects is good HDCP experience with testbeds extremely valuable; lack of feedback from customer to researcher and lack of coordination between researchers were issues

12. Copyright © 2006, Systems and Software Consortium, Inc. www.systemsandsoftware.org Current Thoughts

13. Copyright © 2006, Systems and Software Consortium, Inc. Status: Governance for SIS Producibility Initiative 13 Trade Spaces (options not exclusive) Funding/Resources – Pooled – In-kind/IRAD – Company specific/designated – Existing/separately funded activities Resource allocation/selection – Collaborative decisions – Sponsor-directed decisions – “Seal of approval” Funding vehicles – Groups (FRCs) – Individual companies – Grants – Contracts Intellectual Property – Open source – Shared by all participants – Managed/negotiated Strategy and vision – Formal research agenda – Notional, evolving roadmap – Detailed, milestone-based – Steering group of stakeholders Management – Single office responsibility – Tiered structure – Multiple independent but coordinated offices Transition – Independent activity external to development management – Embedded in research and management – Hybrid Validation/Test Track Coordination – Part of management – Independent assessments – Yearly report cards – Shared responsibility – Managed, experiment-driven test beds

14. Copyright © 2006, Systems and Software Consortium, Inc. Status: Governance for SIS Producibility Initiative 14 Criteria for organization evaluation Efficiency of operations (low overhead) Strong, continuing relationship among sponsors, researchers, and users (feedback/cooperation assured) Strong, supportive management structure (intentional leadership) Effectiveness for transition Stability and longevity (in face of sponsor changes) Flexibility and adaptability (in face of technology changes) Multiple funding/resource streams ($, in-kind, IRAD) Minimal IP problems

15. Copyright © 2006, Systems and Software Consortium, Inc. Status: Governance for SIS Producibility Initiative 15 Some notional governance structures Researchers Sponsors Guidance/Mgmt MARCO-like ITEA-like VAATE-likeCentral Office

16. Copyright © 2006, Systems and Software Consortium, Inc. Status: Governance for SIS Producibility Initiative 16 Possible players Center for Empirically-Based System/Software Engineering (CeBASE: UMd/Fraunhofer, USC, Nebraska, Miss. St.) DARPA ESCHER NDIA Software Engineering Institute Service Labs/SW Centers Software Test Track Systems and Software Consortium

17. Copyright © 2006, Systems and Software Consortium, Inc. Status: Governance for SIS Producibility Initiative 17 FRCs Gov’t/ Industry FRCs Test Track Validation Activities Tryout Steering Group Management GroupSEI Guidance/ Prioritization/ Feedback Contracts SIS Producibility Consortium Resource Reporting Technical Reports/Interim Results Technical feedback/ Broad Coordination Funding Feedback Results Programs Productization, Transition, Deployment, Adoption, Use Successful approach Feedback Programs Tryout Feedback In-kind resources Feedback Conceptual MARCO Based Approach - Overview

18. Copyright © 2006, Systems and Software Consortium, Inc. Status: Governance for SIS Producibility Initiative 18 FRCs Gov’t/ Industry FRCs Self-organizing, self-managing research group; Lead organization may be a university, industry partner, or government lab. Research activities and research management Resource allocation and reporting Cross-FRC peer evaluation Publication – communication support FRCs Self-organizing, self-managing research group; Lead organization may be a university, industry partner, or government lab. Research activities and research management Resource allocation and reporting Cross-FRC peer evaluation Publication – communication support Test Track Validation Activities Tryout Steering Group Management GroupSEI Guidance/ Prioritization/ Feedback Contracts SIS Producibility Consortium Technical feedback/ Broad Coordination Funding Feedback Results Programs Productization, Transition, Deployment, Adoption, Use Successful approach Feedback Programs Tryout Feedback In-kind resources Feedback Conceptual MARCO Based Approach - FRCs

19. Copyright © 2006, Systems and Software Consortium, Inc. Status: Governance for SIS Producibility Initiative 19 SEI FRCs Gov’t/ Industry FRCs Test Track Validation Activities Tryout Steering Group SIS Producibility Consortium Guidance/ Prioritization/ Feedback Contracts Resource Reporting Technical Reports/Interim Results Technical feedback/ Broad Coordination Funding Feedback Results Programs Productization, Transition, Deployment, Adoption, Use Successful approach Feedback Programs Tryout Feedback In-kind resources Feedback Conceptual MARCO Based Approach – Mgmt. Group Management Group An independent group to oversee the following; possibly competed Program Mgt. Secretariat/facilitation Contracting RFP generation Proposal evaluation Participation monitoring Congressional interface Strategic progress monitoring Management Group An independent group to oversee the following; possibly competed Program Mgt. Secretariat/facilitation Contracting RFP generation Proposal evaluation Participation monitoring Congressional interface Strategic progress monitoring

20. Copyright © 2006, Systems and Software Consortium, Inc. Status: Governance for SIS Producibility Initiative 20 FRCs Gov’t/ Industry FRCs Test Track Validation Activities Tryout Steering Group Management Group Guidance/ Prioritization/ Feedback Contracts SIS Producibility Consortium Resource Reporting Technical Reports/Interim Results Technical feedback/ Broad Coordination Funding Feedback Results Programs Productization, Transition, Deployment, Adoption, Use Successful approach Feedback Programs Tryout Feedback In-kind resources Feedback SEI Technical monitoring Research Coordination Communications Technology Transfer Research Repository Validation support Conceptual MARCO Based Approach - SEI

21. Copyright © 2006, Systems and Software Consortium, Inc. Status: Governance for SIS Producibility Initiative 21 FRCs Gov’t/ Industry FRCs Test Track Tryout Steering Group Guidance/ Prioritization/ Feedback Contracts Management GroupSEI SIS Producibility Consortium Resource Reporting Technical Reports/Interim Results Technical feedback/ Broad Coordination Funding Feedback Results Programs Productization, Transition, Deployment, Adoption, Use Successful approach Feedback Programs Tryout Feedback In-kind resources Feedback Validation experiments Hands-on availability for acquisition programs Empirical Support An independent organization to design and conduct experiments; possibly competed Conceptual MARCO Based Approach - Test Track

22. Copyright © 2006, Systems and Software Consortium, Inc. Status: Governance for SIS Producibility Initiative 22 FRCs Gov’t/ Industry FRCs Test Track (Competed?) Tryout Steering Group Guidance/ Prioritization/ Feedback Contracts Management GroupSEI SIS Producibility Consortium Resource Reporting Technical Reports/Interim Results Technical feedback/ Broad Coordination Funding Feedback Results Programs Productization, Transition, Deployment, Adoption, Use (Shared responsibility?) TBD Productization, Transition, Deployment, Adoption, Use (Shared responsibility?) TBD Successful approach Feedback Programs Tryout Feedback In-kind resources Feedback Conceptual MARCO Based Approach - Transition

23. Copyright © 2006, Systems and Software Consortium, Inc. Status: Governance for SIS Producibility Initiative 23 Next Steps Get feedback from you on the concept presented – Political issues – Corporate issues – Academic issues – Other ideas, comments, (constructive) criticisms – Can your sponsors buy into something like this? Identify and develop other possible options – Establish costs, players, etc. – Evaluate pros and cons