May 2007Phase One Consulting Group, Inc. Applying NIST’s SOA Lifecycle Measures to NPS’ SOA Project October 2, 2007 Randy Leonard

May 2007Phase One Consulting Group, Inc. NIST’s Lifecycle Metrics Intent Highlight issues with SOA service/component integration Metrics collected early in SOA implementation Areas of coverage Service Usability Organizational Acceptance Technical Implementation Extensibility

May 2007Phase One Consulting Group, Inc. Score Card Beneficiaries Project Manager Ensure business case and ROI expectations Align project status with project plan Business Analyst Determine completeness of functional requirements Identify functional areas deserving additional attention Architect Measure security & policy implementation Measure orchestration capabilities Measure governance support

May 2007Phase One Consulting Group, Inc. Lifecycle Metrics at NPS Phase One is building an SOA for NPS: Is a sophisticated SOA spanning significant business processes Requires integration with diverse partners:  Park System and other NPS entities  Non-profits  Public facing portals Involves multiple services spanning multiple domains Adopting this Score Card at NPS accomplishes: Assessment of business case and ROI Measuring tangible benefits of each development iteration Evaluating SOA agility to keep pace with evolving processes

May 2007Phase One Consulting Group, Inc. Recommended Changes Sometimes seems focused on: Individual services, not necessarily holistic SOA Measuring requirements, not SOA Subjective evaluations can be difficult: “Ease of use in doing …” “Quality of information received…” “Estimate the number of times a customer changes…” “Answer following questions using the following ‘effort’ scale:” Presentation format: Distinct worksheet for each of four categories Create ‘Executive Summary’ displaying score card results