1. NEXT GEN QUALITY ASSURANCE FOR PSAP Chris Gallahan – NICE Systems May 2014

2. Why QA Current QA Methods Next Gen QA Solution Example of a Next Gen QA Application

3. WHY QA

4. Purpose of QA  Promote service excellence  Adherence to standards, procedures and policies  Consistent performance and level of service In the QA process we want to evaluate the operator’s strength as well as identify areas for improvement

5.  CALEA Public Safety Communications Accreditation Program  APCO Project 33 Training Program Certification  IAED – International Academies of Emergency Dispatch  Total Response Accreditation by PowerPhone Standards/Accreditations

6. CALEA Certification and QA  CALEA Public Safety Communications Accreditation Program  CALEA standards relative to QA require:  Evaluate both call taking and dispatch processes  Document the QA evaluations  Enable the operator to feedback and comment on their evaluations  Generate reporting on evaluations  Benefits of the CALEA accreditation:  Management model for agency administration and operations  Better trained public safety personnel  Can limit an agency's liability and risk exposure  Greater accountability within the communications center  Verification of excellence  More details: http://www.calea.org/content/public-safety-communications-accreditation

7. APCO Project 33  APCO P33 Agency Training Program Certification is a formal mechanism for public safety agencies to certify their training programs as meeting APCO American National Standards (ANS)  The purpose of APCO P33 is to identify minimum training requirements for the public safety telecommunicator  Require agencies to meet or exceed the APCO ANS 3.103.1-2010: Minimum Training Standards for Public Safety TelecommunicatorsAPCO ANS 3.103.1-2010: Minimum Training Standards for Public Safety Telecommunicators

8. Other Accreditation Example: IAED  AQUA is a QA application by Priority Dispatch  Bundled with their flagship product ProQA  Evaluating on 9-1-1 calls only  Audio call in not available via AQUA  AQUA is positioned to help with accreditation from IAED  IAED = International Academies of Emergency Dispatch

9.  Developed by NENA Development Standards Committee Quality Assurance Working Group  Defines recommended minimum components of QA/QI program  Created to assist with the establishment, implementation and maintenance of a QA/QI program  Defines R&R of the Agency and the Evaluator  To be approved by APCO Standards Development Committee and released within few weeks Upcoming NENA/APCO Standards for QA/QI

10.  CALEA Public Safety Communications Accreditation Program  APCO Project 33 Training Program Certification  IAED – International Academies of Emergency Dispatch  NENA’s Recommended QA/QI Standards (to be released)  Main Requirements/Recommendations Common to all:  Establish fair and consistent evaluation program  Evaluate both call taking and dispatch processes  Document the QA evaluations  Enable the operator to feedback and comment their evaluations  Generate reporting on evaluations Standards and Accreditations

11.  Adherence to protocols and standard operating procedures  Overall performance of each operator  Customer service  Effective use of resources  Quality of operation as a whole What to QA

12.  Seamless/Non-intrusive  Random/Fair  On-going  Consistent  Comprehensive  Documented  Automated Attributes of an Effective QA Program

13. METHODS OF QA

14.  Manual  Semi automated  Automated  Next Gen QA Methods of QA Programs

15.  Word/Excel-based evaluation forms  Search and replay call  Live monitoring  Advantages:  Easy to learn  Low investment  Doesn’t require additional application  Disadvantages:  Cumbersome process  Live monitoring limited to evaluator’s shifts  Hard to follow consistent and fair selection  Highly time consuming reporting Manual QA Process

16.  Automated form based but not necessarily tied to audio recording  Doesn’t include screen and other media  Provided by non-logging vendors  Advantages:  Procedure specific, e.g. medical dispatch  Built for accreditation – e.g. IAED, Total Response  Disadvantages:  The user has to deal with two applications: reply and evaluation  Manual selection of calls – could be perceived as inconsistent and unfair  Limited to call-taker (phone only) evaluation Semi Automated

17.  Based/built for Commercial Call Center  Limited to single call – call-taker phone interaction  Partial compliance with QA accreditations/standards  Screen recording is optional, limited to single screen  Advantages:  Allows random selection of calls  Complete evaluation while listening to the call and watching screen activity  Includes reporting capability  Disadvantages:  Not comprehensive – no way to look at the entire incident handling process  No way to include multimedia incident data  Generally, not designed to comply with specific PS accreditation or standard Automated

18. NEXT GEN QA SOLUTION

19. Next Gen QA  Designed bottom up for Public Safety environments  Compliance with CALEA, APCO P33 and the upcoming NENA Standards  Tied to the incident communication capture system: phone, radio, text, screen, video, GIS, etc.

20. Next Gen QA Requirements  Call selection  Manual – important for high attention calls  Truly random  Flexible – minimum number of calls per incident type, user, etc.  Complete incident capture and review  Capture and synch all incident related voice recordings: phone and radio  Capture and synch operator’s screen  Assess operator’s quality of incident handling involving all forms of incoming data  Targeted coaching and training  Easily pin point knowledge gaps, e.g.: text interaction, reference to GIS data, etc.  Provide needs-based coaching and training to groups or specific operators  Ensure operator on track acquiring new skills and adhering to evolving procedures

21. Next Gen QA Requirements - Screen Recording  Capture all screens of operator’s workstation  Compliments entire incident evaluation  What action did the operator take on CAD / CPE / other? Operator’s Workstation Replay Workstation

22. Next Gen QA Requirements - Reporting  Activity reporting – insight into the volume of phone and radio traffic  Data to support staffing decisions  QA reporting - quality performance and trending each individual staff member  Measure performance against KPIs to maintain QA and Training accreditations

23.  Supervisors and Training Managers:  Reconstruct and evaluate  Identify knowledge gap  Provide proper training  Operator:  ‘how am I doing?’  Review evaluations  Feedback and sign-off  PSAP Managers:  Periodic reports to gauge overall team’s and center’s performance  Take improvement measures Workflow that Involves All Users Call / Incident Evaluation Operator Review Management Reports

24. Hosted/Cloud-based QA Solution QA & Screen Recording Quality Assurance Audio Recording & Analytics Operational Applications PSAP APSAP BPoliceFire DepartmentEMS Multi-Agency Datacenter

25. EXAMPLE OF A NEXT GEN QA APPLICATION 25

26. Automatic Selection of Calls for QA

27. Single Call/Call Taking Evaluation

28. Evaluation of Incident as a Whole Phone call and related dispatch radio Fill evaluation while listening

29. Multimedia Incident Evaluation

30. Operator’s Feedback

31. Flexible Evaluation Form Design

32. Reporting Capability

33.  Reduced turnover  Empowered call taker/dispatcher  Increased Professionalism  Adherence to existing and evolving protocols (e.g. Text-to-911)  Effectively and efficiently run PSAP The Value of Next Gen QA Program

34. ABOUT NICE

35. NASDAQ: ~25,000 Customers >80% Fortune 100 Customers $951M FY 2013 Non- GAAP Revenues >35 Local Offices >1000 Service Experts

36.  5,000 Installations Globally  Market share leader in US and Canada  Largest Cities trust NICE  Experience in IP Radio System Deployments  Large Projects Experience Unmatched Experience in Public Safety

37. Commitment to Partnerships Successfully Deployed in the Largest Cities in North America Strong Partnerships with Industry Leaders

38.  Industry Collaboration Events  ICE2 – Passive SIP based IP recording and Geo Location info  ICE3 – Passive VoIP recording and location information  ICE4 – Location services information and event logging and retrieval  ICE5 – Active SIP IP recording including video and text  ICE8 – Multimedia capabilities, allowing text, images, and real-time video  Active in shaping standards in NENA’s Long Term Development Working Group  SIPREC working group within IETF – active with the RFC for the SIP based recording  1M+ VoIP channels deployed  25K+ RoIP channels deployed  Invented, pioneered and patented VoIP recording Undisputed IP Leader

39. Q&A 39

40. Thank You