PROJECT BAU MODERNIZATION 2017-06-21 Project hammer SC_CA_ERE_08 sso LTE DT Analysis

SC_CA_ERE_08 CA-report – DT KPI overview – 4G PROJECT BAU MODERNIZATION 2017-06-21 SC_CA_ERE_08 CA-report – DT KPI overview – 4G # KPI Cluster KPI Target Result PASS/ Remarks   Celcom FAIL A.19.4.5.1 Coverage & Quality A.19.4.5.3 RSRP (Objective 95%) >=-105dBm @ 95% of the sample 97.42% Pass A.19.4.5.4 SINR (Objective >60% of samples >10dB; >95% samples >+5dB) >=0 db@ 95% of the sample 97.67% >=5 db@ 95% of the sample 86.36% Fail Refer to DT Analysis >=10 db@ 60% of the sample 64.23% A.19.4.5.5 LTE cell overlapping (LTE1800) No. of cells within 4dB window: >=4 <2% of area (RSRP>=-105 dbm) 0.51% No. of cells within 4dB window: >=2 <30% of area (RSRP>=-105 dbm) 20.42% No. of cell with 10dB window: >=7 <2% of area (RSRP>=-105 dbm) 0.02% LTE cell overlapping (LTE2600) 0.00% 10.64% A.19.4.5.20 Mobility Test (PS Short Call Open mode) A.19.4.5.21 Network Accessibility Success Rate @ 50km/h >=99.5% 100% A.19.4.5.22 Call Drop Rate @ 50 km/h <=0.6% 0% A.19.4.5.23 LTE -> UMTS re-selection success ratio >=95% A.19.4.5.24 LTE <-> GSM re-selection success ratio A.19.4.5.25 Mobility Test (PS Long Call Locked to LTE) A.19.4.5.26 Download average throughput (long call locked to LTE) 95% of bins in a cluster meeting the throughput as per design 95.24% Average: 28.11Mbps A.19.4.5.27 Upload average throughput (long call locked to LTE) 99.92% Average: 15.22Mbps A.19.4.5.28 Intra-LTE Handover Failure <= 2% A.19.4.5.29 CS Services A.19.4.5.30 CSFB call setup success rate >=98% A.19.4.5.31 CSFB Call setup time 95% of samples <=6.5 sec for Mobile-to-Mobile calls 60.61% 6.67s Refer to DT Analysis A.19.4.5.32 Reselection time back to LTE (after CSFB) 95% <=5 sec 96.34% 1.70s A.19.4.5.33 VolTe Call setup success ratio A.19.4.5.34 Volte MOS >3.5 3.96 A.19.4.5.35 VolTe Call drop <=0,5%

PROJECT BAU MODERNIZATION 2017-06-21 CONTENTS SINR Analysis CSFB Call Setup Time Analysis

PROJECT BAU MODERNIZATION 2017-06-21 SINR Analysis

SC_CA_ERE_08 DT KPI-4G DT KPI lte SINR PROJECT BAU MODERNIZATION 2017-06-21 SC_CA_ERE_08 DT KPI-4G DT KPI lte SINR Simulation SINR DT SINR Area1 Area2 Area3 Area4 Area5 Area6 Area7 KPI Cluster KPI Target Result PASS/   Celcom FAIL Coverage & Quality SINR (Objective >60% of samples >10dB; >95% samples >+5dB) >=0 db@ 95% of the sample 97.67% Pass >=5 db@ 95% of the sample 86.36% Fail >=10 db@ 60% of the sample 64.23% Summary: 7 areas are identified as bad SINR issues marked with blue circle. Bad SINR is mainly caused by no dominance cell or signal blocked. PA Comments 1 Poor SINR due to no dominance cell and signal blocked 2 3 Poor SINR due to no dominance cell 4 5 6 7

SC_CA_ERE_08 DT KPI-4G DT KPI lte SINR PA 1/7 PROJECT BAU MODERNIZATION 2017-06-21 SC_CA_ERE_08 DT KPI-4G DT KPI lte SINR PA 1/7 Area1 SINR Overview DT SINR Simulation PA Area [1] Analysis: Poor SINR in this area is due to no dominance cell, EL20250 and EL20189 are far from target area(>1.0KM). EL20250_8_2 sector view and street view indicate dense trees and buildings in front, which blocks signal transfer. Simulation plot indicate SINR and simulation SINR almost match each other Area1 SINR Area1 Area1 RSRP EL20250_8_2 sector view Area1 1.25km 1.15km DT & Simulation SINR DT & Simulation SINR DL THP Area1 Street view

SC_CA_ERE_08 DT KPI-4G DT KPI lte SINR PA 2/7 PROJECT BAU MODERNIZATION 2017-06-21 SC_CA_ERE_08 DT KPI-4G DT KPI lte SINR PA 2/7 Area2 SINR Overview DT SINR Simulation PA Area [2] Analysis: Poor SINR in this area is due to no dominance cell, EL20189 and EL20104 are far from target area(>2.0KM). Elevation varies a lot from site EL20189 to this area, signal is blocked. EL20128 is serving the target area with site lobe, no dominant cell are dedicated for target area. EL20128_8_1 sector view and street view indicate dense trees in front, which block signal transfer Simulation plot indicate SINR and simulation SINR almost match each other Area2 SINR Area2 Area2 RSRP EL20128_8_1 sector view 2.33km 1.59km 2.35km Area2 DT & Simulation SINR DT & Simulation SINR DL THP Area2 Street view

SC_CA_ERE_08 DT KPI-4G DT KPI lte SINR PA 3/7 PROJECT BAU MODERNIZATION 2017-06-21 SC_CA_ERE_08 DT KPI-4G DT KPI lte SINR PA 3/7 Area3 SINR Overview DT SINR Simulation PA Area [3] Analysis: Poor SINR in this area is due to no dominance cell, EL20431 and EL20049 are far from target area(>2.0KM). EL20128 is serving the target are with site lobe, no dominant cell are dedicated for target area. Simulation plot indicate SINR and simulation SINR almost match each other Area3 SINR Area3 RSRP DT & Simulation SINR DT & Simulation SINR 1.68km DL THP Area3 2.35km Area3 Area3 2.08km EL20128_8_3 sector view

SC_CA_ERE_08 DT KPI-4G DT KPI lte SINR PA 4/7 PROJECT BAU MODERNIZATION 2017-06-21 SC_CA_ERE_08 DT KPI-4G DT KPI lte SINR PA 4/7 Area4 SINR Overview DT SINR Simulation PA Area [4] Analysis: Poor SINR in this area is due to no dominance cell , EL20573 are too far from target area(>2.0KM). EL20573_8_2 sector view and street view indicate dense trees in front, which block signal transfer. Elevation varies a lot from site EL20573 to this area, signal is blocked. Simulation plot indicate SINR and simulation SINR almost match each other Area4 SINR Area4 Area4 RSRP EL20573_8_2 sector view Area4 2.20km DT & Simulation SINR DT & Simulation SINR DL THP Area4 Street view

SC_CA_ERE_08 DT KPI-4G DT KPI lte SINR PA 5/7 PROJECT BAU MODERNIZATION 2017-06-21 SC_CA_ERE_08 DT KPI-4G DT KPI lte SINR PA 5/7 Area5 SINR Overview DT SINR Simulation PA Area [5] Analysis: Poor SINR in this area is due to no dominance cell, EL20208 and EL20106 are too far from target area(>1.5KM). EL20106 and EL20514 are serving the target area with site lobe, no dominant cell are dedicated for target area. Elevation varies a lot from site EL20208 to this area, signal is blocked. Simulation plot indicate SINR and simulation SINR almost match each other Area5 SINR Area5 Area5 RSRP EL20208_8_2 sector view Area5 1.86km 1.62km 1.25km DT & Simulation SINR DT & Simulation SINR DL THP Area5 Street view

SC_CA_ERE_08 DT KPI-4G DT KPI lte SINR PA 6/7 PROJECT BAU MODERNIZATION 2017-06-21 SC_CA_ERE_08 DT KPI-4G DT KPI lte SINR PA 6/7 Area6 SINR Overview DT SINR Simulation PA Area [6] Analysis: Poor SINR in this area is due to no dominance cell, EL20439 and EL20573 are too far from target area(>1.9KM). EL20439_8_3 sector view and street view indicate dense trees in front, which blocks signal transfer. Simulation plot indicate SINR and simulation SINR almost match each other SINR Area6 Area6 Area6 RSRP EL20439_8_3 sector view 1.96km 2.38km Area6 DT & Simulation SINR DT & Simulation SINR DL THP Area6 Street view

SC_CA_ERE_08 DT KPI-4G DT KPI lte SINR PA 7/7 PROJECT BAU MODERNIZATION 2017-06-21 SC_CA_ERE_08 DT KPI-4G DT KPI lte SINR PA 7/7 Area7 SINR Overview DT SINR Simulation PA Area [7] Analysis: Poor SINR in this area is due to no dominance cell, EL20299, EL20053 and EL20252 are too far from target area(>1.2KM). EL20299 and EL20252 are serving the target area with site lobe, no dominant cell are dedicated for target area. EL20299_8_3 sector view and street view indicate dense trees in front, which blocks signal transfer. Simulation plot indicate SINR and simulation SINR almost match each other Area7 SINR Area7 Area7 RSRP EL20299_8_3 sector view 1.29km 1.53km 1.50km Area7 DT & Simulation SINR DT & Simulation SINR DL THP Area7 Street view

CSFB CALL SETUP TIME Analysis PROJECT BAU MODERNIZATION 2017-06-21 CSFB CALL SETUP TIME Analysis

SC_CA_ERE_08 DT KPI-4G DT KPI CSFB call setup time PROJECT BAU MODERNIZATION 2017-06-21 SC_CA_ERE_08 DT KPI-4G DT KPI CSFB call setup time KPI Cluster KPI Target Result PASS/   Celcom FAIL CS Services CSFB call setup success rate >=98% 100% Pass CSFB Call setup time 95% of samples <=6.5 sec for Mobile-to-Mobile calls 60.61% Fail Range Sample   Samples PDF CDF 5.0 13 <5.0 8% 5.5 38 25 15% 23% 6.0 74 36 22% 45% 6.5 100 26 16% 61% 7.0 114 14 69% 7.5 131 17 10% 79% 8.0 138 7 4% 84% 8.5 145 88% 9.0 147 2 1% 89% 9.5 151 4 2% 92% 10.0 154 3 93% 1000.0 165 >=10 11 7% 100% Analysis: There are 165 times CSFB, and 60.61%% of samples CSFB Call Setup time is less than 6.5s, the average CSFB Call Setup Time is 6.67s. 2. As above graph shows, 89.10% CST are less than 9s.

SC_CA_ERE_08 DT KPI-4G DT KPI CSFB call setup time #1 PROJECT BAU MODERNIZATION 2017-06-21 SC_CA_ERE_08 DT KPI-4G DT KPI CSFB call setup time #1 Signal Point Time Sample Latency(s) EXTENDED_SERVICE_REQUEST 1:30:29.280 EXTENDED_SERVICE_REQUEST -> RRCConnectionRelease 0.295 RRCConnectionRelease 1:30:29.575 RRCConnectionRelease -> CM_SERVICE_REQUEST 0.322 CM_SERVICE_REQUEST 1:30:29.897 CM_SERVICE_REQUEST -> SETUP 3.501 SETUP 1:30:33.398 SETUP -> ALERTING 5.599 ALERTING 1:30:38.997 Total 9.717 Event ID Time Transf. dir. Message name L3SM 1:30:29.280 Uplink EXTENDED_SERVICE_REQUEST SECURITY_PROTECTED_NAS_MESSAGE RRCSM RRCConnectionRequest 1:30:29.371 Downlink RRCConnectionSetup RRCConnectionSetupComplete 1:30:29.476 INTER_RAT_HANDOVER_INFO RRCConnectionReconfiguration RRCConnectionReconfigurationComplete 1:30:29.575 RRCConnectionRelease 1:30:29.897 CM_SERVICE_REQUEST 1:30:30.397 RRC_CONNECTION_REQUEST 1:30:32.499 1:30:32.698 RRC_CONNECTION_SETUP 1:30:32.896 RRC_CONNECTION_SETUP_COMPLETE INITIAL_DIRECT_TRANSFER 1:30:33.296 ROUTING_AREA_UPDATE_REQUEST 1:30:33.398 SETUP MEASUREMENT_REPORT UPLINK_DIRECT_TRANSFER DOWNLINK_DIRECT_TRANSFER 1:30:33.492 1:30:33.698 1:30:33.994 CALL_PROCEEDING 1:30:34.390 1:30:34.597 1:30:35.992 1:30:36.397 1:30:38.902 1:30:38.997 ALERTING RRCConnectionRelease Analysis: 1.This CSFB call take 9.717s from EXETENDED_SERVICE_REQUEST to ALERTING. 2. The one reason is that It takes 3.321s from 4G RRCConnectionRelease fall back to 3G RRC_CONNECTION_ SETUP_COMPLETE, during the fallback time. Another reason is that It takes 5.003s to wait responding from CN. 3.Poor RSCP&ECNO caused long CSFB call setup time. 3.321 s RRC_CONNECTION_SETUP_COMPLETE CALL PROCEEDING 5.003 s ALERTING

SC_CA_ERE_08 DT KPI-4G DT KPI CSFB call setup time #2 PROJECT BAU MODERNIZATION 2017-06-21 SC_CA_ERE_08 DT KPI-4G DT KPI CSFB call setup time #2 Time Transf. dir. Message name 4:50:01.110 Uplink EXTENDED_SERVICE_REQUEST SECURITY_PROTECTED_NAS_MESSAGE 4:50:01.304 Downlink RRCConnectionRelease 4:50:01.610 CM_SERVICE_REQUEST 4:50:01.908 RRC_CONNECTION_REQUEST 4:50:02.113 RRC_CONNECTION_SETUP 4:50:02.311 RRC_CONNECTION_SETUP_COMPLETE INITIAL_DIRECT_TRANSFER 4:50:02.713 ROUTING_AREA_UPDATE_REQUEST 4:50:02.812 SETUP MEASUREMENT_REPORT UPLINK_DIRECT_TRANSFER DOWNLINK_DIRECT_TRANSFER 4:50:03.007 4:50:03.113 4:50:03.307 CALL_PROCEEDING 4:50:03.807 4:50:04.007 4:50:08.011 4:50:10.408 RADIO_BEARER_RECONFIGURATION_COMPLETE 4:50:11.007 4:50:11.113 4:50:11.211 4:50:11.315 4:50:11.610 4:50:12.415 ROUTING_AREA_UPDATE_ACCEPT ROUTING_AREA_UPDATE_COMPLETE 4:50:12.609 SIGNALLING_CONNECTION_RELEASE 4:50:12.708 ALERTING Signal Point Time Sample Latency(s) EXTENDED_SERVICE_REQUEST 4:50:01.110 EXTENDED_SERVICE_REQUEST -> RRCConnectionRelease 0.194 RRCConnectionRelease 4:50:01.304 RRCConnectionRelease -> CM_SERVICE_REQUEST 0.306 CM_SERVICE_REQUEST 4:50:01.610 CM_SERVICE_REQUEST -> SETUP 1.202 SETUP 4:50:02.812 SETUP -> ALERTING 9.896 ALERTING 4:50:12.708 Total 11.598 Analysis: 1.This CSFB call take 11.598s from EXETENDED_SERVICE_REQUEST to ALERTING. 2. It takes 9.401s from CALL_PROCEDING to ALERTING to wait responding from CN which mainly caused long CSFB call setup time. CALL PROCEEDING 9.401 s ALERTING

SC_CA_ERE_08 DT KPI-4G DT KPI CSFB call setup time #3 PROJECT BAU MODERNIZATION 2017-06-21 SC_CA_ERE_08 DT KPI-4G DT KPI CSFB call setup time #3 Event ID Time Transf. dir. Message name L3SM 2:10:26.582 Uplink EXTENDED_SERVICE_REQUEST SECURITY_PROTECTED_NAS_MESSAGE RRCSM RRCConnectionRequest 2:10:26.689 Downlink RRCConnectionSetup RRCConnectionSetupComplete SecurityModeCommand SecurityModeComplete 2:10:26.790 INTER_RAT_HANDOVER_INFO RRCConnectionReconfiguration RRCConnectionReconfigurationComplete Paging 2:10:26.882 RRCConnectionRelease 2:10:28.082 SCHEDULING_BLOCK_1 2:10:28.189 CM_SERVICE_REQUEST 2:10:30.485 2:10:31.288 RRC_CONNECTION_REQUEST 2:10:31.483 RRC_CONNECTION_SETUP 2:10:31.689 RRC_CONNECTION_SETUP_COMPLETE INITIAL_DIRECT_TRANSFER 2:10:31.892 ROUTING_AREA_UPDATE_REQUEST 2:10:32.185 SECURITY_MODE_COMMAND SECURITY_MODE_COMPLETE 2:10:32.291 SETUP MEASUREMENT_REPORT UPLINK_DIRECT_TRANSFER DOWNLINK_DIRECT_TRANSFER 2:10:32.388 2:10:32.485 2:10:32.585 CALL_PROCEEDING 2:10:33.290 2:10:33.986 2:10:36.684 ALERTING Signal Point Time Sample Latency(s) EXTENDED_SERVICE_REQUEST 2:10:26.582 EXTENDED_SERVICE_REQUEST -> RRCConnectionRelease 0.300 RRCConnectionRelease 2:10:26.882 RRCConnectionRelease -> CM_SERVICE_REQUEST 1.307 CM_SERVICE_REQUEST 2:10:28.189 CM_SERVICE_REQUEST -> SETUP 4.102 SETUP 2:10:32.291 SETUP -> ALERTING 4.393 ALERTING 2:10:36.684 Total 10.102 RRCConnectionRelease Analysis: 1.This CSFB call take 10.102s from EXETENDED_SERVICE_REQUEST to ALERTING. 2. The one reason is that It takes 4.807s from 4G RRCConnectionRelease fall back to 3G RRC_CONNECTION_SETUP_COMPLETE, during the fallback time. Another reason is that It takes 4.099s to wait responding from CN. 3.Poor RSCP&ECNO caused long CSFB call setup time. 4.807 s RRC_CONNECTION_ SETUP_COMPLETE CALL PROCEEDING 4.099 s ALERTING

SC_CA_ERE_08 DT KPI-4G DT KPI CSFB call setup time #4 PROJECT BAU MODERNIZATION 2017-06-21 SC_CA_ERE_08 DT KPI-4G DT KPI CSFB call setup time #4 Time Transf. dir. Message name 7:13:50.463 Uplink EXTENDED_SERVICE_REQUEST SECURITY_PROTECTED_NAS_MESSAGE 7:13:50.562 INTER_RAT_HANDOVER_INFO 7:13:50.657 Downlink RRCConnectionRelease 7:13:51.263 CM_SERVICE_REQUEST 7:13:51.463 RRC_CONNECTION_REQUEST 7:13:51.657 RRC_CONNECTION_SETUP 7:13:51.856 RRC_CONNECTION_SETUP_COMPLETE INITIAL_DIRECT_TRANSFER 7:13:52.165 ROUTING_AREA_UPDATE_REQUEST 7:13:52.365 SETUP MEASUREMENT_REPORT UPLINK_DIRECT_TRANSFER DOWNLINK_DIRECT_TRANSFER 7:13:52.459 7:13:52.657 7:13:52.760 CALL_PROCEEDING 7:13:53.359 7:13:53.556 7:13:58.563 RADIO_BEARER_SETUP 7:13:58.860 RADIO_BEARER_SETUP_COMPLETE 7:13:59.359 RADIO_BEARER_RECONFIGURATION RADIO_BEARER_RECONFIGURATION_COMPLETE 7:14:00.160 7:14:00.258 7:14:00.360 7:14:00.461 7:14:00.558 7:14:01.666 ROUTING_AREA_UPDATE_ACCEPT ROUTING_AREA_UPDATE_COMPLETE 7:14:01.862 SIGNALLING_CONNECTION_RELEASE 7:14:02.561 ALERTING Signal Point Time Sample Latency(s) EXTENDED_SERVICE_REQUEST 7:13:50.463 EXTENDED_SERVICE_REQUEST -> RRCConnectionRelease 0.194 RRCConnectionRelease 7:13:50.657 RRCConnectionRelease -> CM_SERVICE_REQUEST 0.606 CM_SERVICE_REQUEST 7:13:51.263 CM_SERVICE_REQUEST -> SETUP 1.102 SETUP 7:13:52.365 SETUP -> ALERTING 10.196 ALERTING 7:14:02.561 Total 12.098 Analysis: 1.This CSFB call take 12.098s from EXETENDED_SERVICE_REQUEST to ALERTING. 2. It takes 9.801s from CALL_PROCEDING to ALERTING to wait responding from CN which mainly caused long CSFB call setup time. . CALL PROCEEDING 9.801s ALERTING

SC_CA_ERE_08 DT KPI-4G DT KPI CSFB call setup time #5 PROJECT BAU MODERNIZATION 2017-06-21 SC_CA_ERE_08 DT KPI-4G DT KPI CSFB call setup time #5 Event ID Time Transf. dir. Message name L3SM 7:55:37.811 Uplink EXTENDED_SERVICE_REQUEST SECURITY_PROTECTED_NAS_MESSAGE RRCSM RRCConnectionRequest Downlink RRCConnectionSetup RRCConnectionSetupComplete 7:55:37.908 INTER_RAT_HANDOVER_INFO RRCConnectionReconfiguration RRCConnectionReconfigurationComplete 7:55:38.011 RRCConnectionRelease 7:55:38.327 CM_SERVICE_REQUEST 7:55:38.721 RRC_CONNECTION_REQUEST 7:55:38.922 RRC_CONNECTION_SETUP 7:55:39.028 RRC_CONNECTION_SETUP_COMPLETE INITIAL_DIRECT_TRANSFER 7:55:39.428 ROUTING_AREA_UPDATE_REQUEST MEASUREMENT_REPORT 7:55:39.528 SETUP UPLINK_DIRECT_TRANSFER 7:55:39.623 DOWNLINK_DIRECT_TRANSFER 7:55:39.824 7:55:40.029 CALL_PROCEEDING 7:55:40.522 7:55:40.726 7:55:47.321 7:55:47.523 7:55:47.622 7:55:48.124 7:55:49.029 ROUTING_AREA_UPDATE_ACCEPT ROUTING_AREA_UPDATE_COMPLETE 7:55:49.322 SIGNALLING_CONNECTION_RELEASE 7:55:50.822 ALERTING Signal Point Time Sample Latency(s) EXTENDED_SERVICE_REQUEST 7:55:37.811 EXTENDED_SERVICE_REQUEST -> RRCConnectionRelease 0.200 RRCConnectionRelease 7:55:38.011 RRCConnectionRelease -> CM_SERVICE_REQUEST 0.316 CM_SERVICE_REQUEST 7:55:38.327 CM_SERVICE_REQUEST -> SETUP 1.201 SETUP 7:55:39.528 SETUP -> ALERTING 11.294 ALERTING 7:55:50.822 Total 13.011 Analysis: 1.This CSFB call take 13.011s from EXETENDED_SERVICE_REQUEST to ALERTING. 2. It takes 10.793s from CALL_PROCEDING to ALERTING to wait responding from CN which mainly caused long CSFB call setup time. . CALL PROCEEDING 10.793s ALERTING

PROJECT BAU MODERNIZATION 2017-06-21 PROJECT BAU MODERNIZATION