Web-centric BusinessNRIC V – June 26, 2001 NRIC V Council Meeting - June 26, 2001 Focus Group 2.B1 Network Reliability - Data Reporting & Analysis

NRIC V – June 26, Agenda Governance Charter Membership Key Deliverables Reliability Reporting

NRIC V – June 26, Governance Focus Group 2 Network Reliability Chair: Brian Moir, ICA (202) Focus Group 2.B2 on Data Reporting and Analysis for Packet Switching Chair: Paul Hartman Hartman Associates (913) Focus Group 2.A2 on Best Practices Packet Switching Chair: Karl Rauscher Lucent Technologies (908) Focus Group 2.B1 on Data Reporting and Analysis Chair: P.J. Aduskevicz, AT&T (908) Focus Group 2.A1 on Best Practices Chair: Rick Harrison Telcordia (732)

NRIC V – June 26, Charter I. Implement a voluntary one year trial with participation by Internet Service Providers, CMRS, satellite, cable, and data networking service providers to alert National Communications System/National Coordinating Center for Telecommunications (NCS/NCC) of outages that are likely to have significant public impact. Criteria for determining types of outages to be reported will be developed by each industry segment building on the recommendations from NRIC IV. The process for reporting data during the voluntary trial will be documented and implemented. Analysis of the data from the trial will be conducted by a neutral third party. Industry associations will be requested to encourage participation by their constituents. At the completion of the trial period, an evaluation of its effectiveness will be conducted and a recommendation made. II. Evaluate outage-reporting requirements and guidelines currently used by wireline carriers to improve the quality of outage reporting. III. Evaluate and report on the reliability and availability of the PSTN utilizing NRSC quarterly reports.

NRIC V – June 26, Membership 2.B1 - Data Reporting and Analysis Team

NRIC V – June 26, Key Deliverables I. Implement a voluntary one year trial with participation by Internet Service Providers, CMRS, satellite, cable, and data networking service providers to alert National Communications System/National Coordinating Center for Telecommunications (NCS/NCC) of outages that are likely to have significant public impact. Voluntary Trial Status Recommendation to NRIC IV to proceed with trial predicated on FOIA exemption NRIC V Chairman sent letter to industry association representatives reinforcing commitment to voluntary trial and explaining MOU (Memorandum of Understanding) signed by NCS/NCC and FCC ensuring that proprietary information provided under the agreement is protected against unauthorized use or disclosure Industry associations have reviewed the Chairman’s letter and the MOU with their members Flowchart of reporting process and criteria for data scrubbing by NCS/NCC have been validated and refined Trialed process Handed off data to Best Practices Team Overarching trial goals and data analysis options have been documented by the team and distributed to industry association representatives

NRIC V – June 26, Key Deliverables I. Implement a voluntary one year trial with participation by Internet Service Providers, CMRS, satellite, cable, and data networking service providers to alert National Communications System/National Coordinating Center for Telecommunications (NCS/NCC) of outages that are likely to have significant public impact. Voluntary Trial Status Progress has been made through the industry associations in identifying trial participants and obtaining positive reports when no outages have occurred; however, at this time, portions of the industry have insufficient participation to provide data needed for valid conclusions or recommendations Outreach activities have been initiated to increase participation ATIS Teleconference Series (INFOSYNC) presentation Contact Campaign NCS/NCC has received one report to date

NRIC V – June 26, Voluntary Trial Process Outage Occurs Determine if Outage Meets Vol. Trial Criteria Fax to NCS/NCC On ( ) Create Initial Report within 3 Days – Mark Company Proprietary Conduct Root Cause Analysis Identify Best Practices Fax Final Report with in 30 Days NCS/NCC Logs Report Scrub Data per Criteria Established by 2.B1 Share Scrubbed Data (i.e. NIPC) Handoff scrubbed data required by 2.A1 and 2.A2 (Best Practices) Does 2.B2 want to use data? Analyze Scrubbed Data: By Type/Segment Impact Frequency Root cause for Commonality Provide status at NRIC V Council meetings Make Recommendations Monitor Progress Concur or Provide Input on Recommendations Develop Final Report to Include Recommendations Service Provider NCS/NCC Subcommittee 2.B 1 NRIC V If yes Service Provider – Companies who provide CMRS, Satellite, Cable Telephony, ISP and Data Services NCS/NCC (National Communication System/National Coordinating Center) - Joint industry-government organization and mechanism by which the federal government and telecommunications industry respond to national security and emergency preparedness (NS/EP) telecommunications service requirements. Subcommittee 2.B1 – A subcommittee of the NRIC V Network comprised of representatives of industry associations, consultants, and providers for wireline and non-wireline services and equipment. NRIC V – A federal advisory committee that is chartered to evaluate and report on the reliability of public telecomm network services in the US including the reliability of packet switched networks. If no Local Root Cause Analysis InitialFinal Aggregate And Send Data InitialFinal File Final Report Determine whether request to share data should be made Take No Further Action If yes If no Grant Permission to Share Data? If no If yes

NRIC V – June 26, NON-WIRELINE VOLUNTARY NETWORK OUTAGE INITIAL REPORTING TEMPLATE Template

NRIC V – June 26, Voluntary Trial Outage Report - Scrubbed Data Criteria Agreement with Team – For Data Handoff

NRIC V – June 26, Potential Analysis Options Scrubbed Final Report fieldSample Analysis Action Outage Tag Start DateAggregate outages by unit time Start Time of Impact Estimated number of customers affected Types of Services Affected (if applicable)Identify new services affected within industry segments Duration of Outage (hours and minutes) Apply outage index Identify new outage index Apparent or known cause Specific Part of Network Involved Methods Used to Restore Service [OPT] Steps Taken to Prevent Recurrence Root Cause and Trouble Found [OPT] Applicable Best Practice [OPTIONAL] Filter data by industry segment in conjunction with other fields Potential Product or Conclusion Comparison of outage frequencies by industry segment Identification of any industry segment-specific anomalies Outage frequency graphs by week, quarter, time, etc. Date- or time-specific conclusions (e.g.,weekend vs weekday, holidays, rush hour outages) Apply outage index Identify new outage index Outage Index graphs (characterizing outage severity) Verification of /Additions to T1A1.2 outage index method New industry segment-specific outage indices Comparison of outage severity trends; recommendations on appropriate thresholds for reporting by industry segment Recommendation on outage index weightings for new services Outage Index graphs (characterizing outage severity) Verification of /Additions to T1A1.2 outage index method New industry segment-specific outage indices Recommendations onappropriate thresholds for reporting by industry segment Identify existing and new causes Aggregate outages by cause Graphs focusing on key causes by industry segment Recommendation of new causes to track/monitor/mitigate (e.g., DNS, cell site, head end, transponder) Aggregate outages by network part; Identify “new” parts (e.g.,radio access segment) Industry segment-specific graphs showing susceptible network parts (e.g., access vs transport): Conclusions on industry-wide “reliability” of network access, etc. Identify existing/new methods New best practices/Validation of existing practices Recommendations on restoral and prevention methods by industry segment. Recommendations on “crossover” methods (i.e., practices in one segment that may be of use in others)

NRIC V – June 26, Overarching Trial Goals Enable a general characterization of reported outages’ impact on the public Address effectiveness of trial Identify outage reporting similarities or differences across industry segments Show that industry has the initiative to gather “outage” information without government involvement Identify what data should/should not be reported Provide an opinion on the “State of Reliability” of the examined networks Address next steps (e.g., continue/stop trial) Identify the Root Cause(s) (i.e., chain(s) of events that led to an outage) for Best Practices review Allow Best Practices to be identified for entire industry benefit Allow unregulated voluntary outage reporting to assist national communications security and awareness Enable carrier and vendor service improvement for all consumers

NRIC V – June 26, Key Deliverables II. Evaluate outage-reporting requirements and guidelines currently used by wireline carriers to improve the quality of outage reporting. Revised Network Reliability Steering Committee Charter to Reflect intent to “improve” reliability verses previous charter to “monitor” Changed baseline for FCC Reportable Service Outages from first year to cumulative going forward Began conducting special analysis on detected trends (for example, single failure affecting large geographic areas) Began performing analysis on Emergency Services Outages FCC working to implement electronic filing and putting template into “user friendly” format.

NRIC V – June 26, Key Deliverables III. Evaluate and report on the reliability and availability of the PSTN utilizing NRSC quarterly reports. Utilize NRSC to report data analysis from process Outage results assembled and analyzed by Network Reliability Steering Committee Quarterly and annual results for overall outages and sub categories available on web site: Will incorporate analytics from Voluntary Outage Reporting Trial for cable, satellite, wireless, ISPs to extend Network Reliability Reporting based on the Voluntary Trial Data Analysis Options Formed study group to review CCS outages and identify possible causes of the recent increase and initiated an awareness program 2000 Annual Report in progress

NRSC – 1Q01 Results FCC Reportable Service Outages (by number of events) Reliability Reporting

NRSC – 1Q01 Results FCC Reportable Service Outages (by outage index) Reliability Reporting

NRSC – 1Q01 Results Failure Category - Common Channel Signaling (by number of events) Reliability Reporting

NRSC – 1Q01 Results Failure Category – CO Power (by number of events) Reliability Reporting

NRSC – Annual Control Chart FCC Reportable Service Outages (by number of events) Reliability Reporting

NRSC – Annual Control Chart FCC Reportable Service Outages (by outage index) Reliability Reporting

NRIC V – June 26, NRSC Significant Results Through 1Q01 Outage frequency overall was in the “Green” region and was the second lowest ever. Within failure categories, all outage frequencies were within the “Green” region. The aggregated outage index overall was in the “Green” region. The frequency of Facility outages was the lowest ever and the lowest total for any four consecutive quarters. The frequency of CCS outages over the last four quarters (24) was the greatest of any four consecutive quarters. The frequency of CO Power outages over the last four quarters (37) was the greatest of any four consecutive quarters.

NRIC V – June 26, NRSC Significant Results Through 1Q01 Based upon analysis of all outages reported from 1Q93 through 1Q01, the NRSC notes: There is an increasing trend in the number of Tandem Switch, CO Power, CCS, and DCS outages. There is an increasing trend in the frequency and aggregated outage index of Procedural Errors as the root cause of outages. There is a decreasing trend in the number of Facility and Local Switch outages.