1. CJK test-bed study based on MPM
December 11-12, 2008
Test-bed Ad-hoc Group
Hideaki YAMADA
KDDI (KDDI R&D Labs.)

2. Standardization (MPM, RACF) Q&A
Topics
Background
Preparations
- System installation
- Study phases (Study scenarios)
- Target services
- Performance measurement
- Schedule
Standardization (MPM, RACF)
Q&A

3. Background
In order to investigate the technology integral to the worldwide services under the interconnected environment of the multiple NGNs owned by each country, we have been conducting both a test-bed study and a standardization study in ITU-T involving CJK.
After the fundamental technical study of the test-bed, for example, we are planning to undertake an experimental demonstration.

4. System installation

5. Study phases (Study scenarios) 1
Phase I: rd/4th Quarter (Completed)
Network Connectivity
Scenario 2 and 4 only (2 CS and 2 domains)
Phase II: st/2nd Quarter (Completed)
Scenario 1, 3 (simpler version of 2 and 4, single domain) and 5
CJK NGN Test-bed
Phase IV: rd ~ nd Quarter
Performance Evaluation of RTP/RTCP-based MoIP and IPTV services
Performance Monitoring Scenarios 6-3 and 6-4
Initial RACF Interoperability testing : Scenario 7
Testing of RACF and RTP/RTCP-based MPM Interactions
IPTV Interoperability testing

6. Study phases (Study scenarios) 2
Note: Development of the ATCA (SBC of OKI Electric Industry) based MPM is planned.
Scenario 6-2: Performance evaluation of MoIP service among CPEs
Local testing of MPM (Provided by KDDI R&D Labs.)
CPE-to-CPE performance evaluation
Scenario 6-3: Performance evaluation of MoIP service with two MPMs
CPE – MPM1 – MPM2 – CPE performance evaluation
Scenario 6-4: Performance evaluation of MoIP service with three MPMs
CPE – MPM1 – MPM2 – MPM3 – CPE performance evaluation
Scenario 7: Testing of RACF and RTP/RTCP-based MPM Interactions
e.g. Admission control
Scenario 6-1: Performance evaluation of Network Segments
Considering the target Services

7. Study phases (Study scenarios) 3

8. Concurrent (Multimodal) services
Target services
Quality and performance testing of the Multimedia over IP (MoIP) services
Voice
Video
Audio (TBD)
Concurrent (Multimodal) services
Evaluation of the quality of service (QoS) and the application layer quality (QoE; Quality of Experience) in order to control streams of the FMBC (Fixed Mobile & Broadcast Convergence) services based on MoIP.

9. Performance measurement 1
Performance measurement can help:
Find errors in end-to-end system
Check the resource utilization and the work load of system
Compare metrics regarding performance of different system deployments
Provide a base for modeling the system
Find system bottlenecks
Optimize service network deployments

10. Performance measurement 2
Real-time QoS/QoE measurement and estimation benefit networking performance.
Examples:
QoS/QoE aware applications such as adaptive Video/Voice streams session control
Handover triggering schemes for seamless services over IP-based FMC networks
Pre-congestion management and congestion controls
It is not only beneficial for Network operators & administrators, but also beneficial for Network equipment manufactures for testing and Networking application developers.
Figure 2/G.1081 – IPTV Performance Monitoring Points

11. Performance measurement schemes
We focus on non-intrusive (passive) schemes for QoE

12. Measurement points Single point measurements Two point
Multipoint measurements
(MPM case)
Metrics
Round trip (RT) performance
•RT delay, RT jitter, RT packet loss, etc.
•Service response time
One-way
performance
Segment based
Traffic statistics
traffic load, throughput,
number of packets, packet sizes
Traffic statistics from both points
In each segment
For HTTP and TCP performance
Requires synchronization for delay between
measurement points
Enables bottleneck identification
Figure 2/G.1081 – IPTV Performance Monitoring Points

13. Measurement outputs by MPM 1

14. Measurement outputs by MPM 2
Example of the measurement logs

15. Schedule

16. Standardization (MPM, RACF)
Figure 1 ITU-T Y.2111(RACF IF(Rm, Ri, Rh))

17. Communications between MPM and RACF
Approach to realize the communications between RACF and MPM
Generic resource and admission control functional architecture is shown in figure 4. There are two options, Option A and Option B. as follows. We propose the option A or the option B and both options should be considered to achieve communications between RACF and MPM.
Option A: Extension of the Rc in RACF
Extending Rc to allow symmetric communication so that performance measurement information for target media flow (s) can be requested by TRC-FE to MPM. For such extension, the currently defined Rc protocols such as SNMP and COPS may not meet the new requirements and MPM’s Mu reference point is used to interact with Rc reference point in this case.
Option B: Introduction of a new reference point called Rm
Introduce a new reference point to meet the new requirements. We can call it Rm. (m for management) Rm can be utilized for RACF to interact with various NGN management functional entities. One example is MPM. There are two cases on how to use Rm:
- Use Rm to receive information on which performance measurement should be made from RACF and use Rc to provide measurement results to RACF. This method requires some extension of Rc in terms of its information elements.
- Use Rm to both receive and reply to RACF requests.

18. Performance measurement of the service quality of MoIP
Example: IPTV 1
Performance measurement of the service quality of MoIP
Definition of the Quality of Experience (QoE) :
The overall acceptability of an application or service, as perceived subjectively by the end-user.
ITU-T Rec. G.1080
defines QoE requirements for IPTV from an end user perspective, agnostic to network deployment architectures and transport protocols.
ITU-T Rec. G.1081
defines performance monitoring for IPTV. The goal of this is to provide higher QoS/QoE to customers by identifying, localizing and quantifying service and network issues.

19. Example: IPTV 2 MPM points
Figure 2/G.1081 – IPTV Performance Monitoring Points

20. Q&A Thank you for your kind attentions.
This work is partly supported by the National institute of Information and Communications Technology (NICT).