NTT Confidential Test plan for evaluation of video quality models for use with stereoscopic three-dimensional television content Taichi Kawano (NTT)

NTT Confidential Aim/Target of 3D objective metric project Aim: Develop FR media-layer objective metric for stereoscopic three-dimensional (3D) video quality Target service: - 3D video distribution service - 3D Blu-ray / DVD Target user: Service / content providers 2

NTT Confidential Summary of discuss points 3 Discuss following 8 issues: 1. Input of objective quality model 2. Subjective rating test 3: Display Specification and Set-up 4. Source Reference Channel (SRC) 5. Hypothetical Reference Circuit (HRC) 6. ILG and proponents 7. Number of tests 8. Schedule

NTT Confidential Discuss point 1/8: Input of objective quality model Model input (3.2): Option 1: FS and SbS format videos are used, where model requires flag whether input is FS or SbS. Option 2: FS format is used for FS and SbS format video (i.e., Flag is not needed). Proposal for input of model: Frame sequential (FS) format Reason: If format is SbS, viewers see FS on 3D monitor (i.e., SbS is converted to FS). 4

NTT Confidential Discuss point 2/8: Subjective rating test Voting methodology (4.4): ACR-HR # Same as HDTV test Number of viewer (4.7): 24 # Same as HDTV test Viewing distance (4.3.1): 3H (H is picture height) # Same as HDTV test Number of Viewer for single display (4.3.2): 1 or 2 # If monitor size is small, 1 viewer use single display 5

NTT Confidential Discuss point 3/8: Display Specification and Set-up Display (4.3.3): Professional/consumer LCD 3D monitor for TV/PC 3D displaying system (4.3.3): ・ Active shutter 3D system with glasses ・ Passive polarized 3D system with glasses Allowable minimum monitor size (4.3.3): 1 viewer: 23 inches 2 viewers: TBD Display resolution (4.3.3): Full-HD (1920 by 1080) 6

NTT Confidential Discuss point 4/8: SRC Resolution (5.1): 1080p Frame rate (5.1): 24, 25, 30 fps # 24 fps is used in 3D blu-ray # 25 and 30 fps is widely used in 2D video application How to get source sequences (5): TBD # Possible to reuse 3D sequences of other 3D project? Video format (6.2): Proposal for AVI format: Uncompressed AVI files in I420 Reason: Although UYVY was used in HD test plan, I420 is widely used in market and color blurring does not occur in progressive format. 7

NTT Confidential Discuss point 5/8: HRC Coding Schemes (7.2.1): ・ MPEG-2 (Main level) ・ H.264 (AVC high and main profiles) ・ H.264 (MVC Stereo high profile) # MPEG-2 and AVC are applied to each view independently Video bit-rate (7.2.2): MPEG-2/ACV: Mbps for each view MVC: Mbps Video encoding mode (7.2.3): CBR, VBR 8

NTT Confidential Discuss point 6/8: ILG and proponent Possible to set up ILG?: TBD # Potential ILG (declared in Rennes): AGH, Acreo, IRCCyN, NTIA # If impossible, only proponents run test Who propose model and conduct tests?: NTT, … # Potential proponents (declared in Rennes): Yonsei, SwissQual, Opticom, DT, Orange FT, NTIA, IRCCyN 9

NTT Confidential Discuss point 7/8: Number of test Number of datasets (4.1): Minimum of 3 # One for each frame rate (24, 25, 30 fps) => 3 tests # 3 frame rates ✕ 3 codecs ✕ (FS + SbS) => 18 tests How many tests for each proponent and ILG?: NTT: 1 or 2 tests XXX: * test YYY: * test ZZZ: * test … 10

NTT Confidential Discuss point 8/8: Schedule Approve test plan: June 2013? # Next VQEG meeting Declare intent to participate: July 2013 Submit model: Feb. 2014? # VQEG meeting after next Select SRC: Mar Generate PVS: Aug Run subjective test: Dec Statistical analysis: Jun Approve final report: Mar