1. 1 Metadata for Formatting with Multiple Aspect Ratios Graham Jones National Association of Broadcasters Chair – SMPTE S22 Image Formatting AHG HPA Technology Retreat February 24, 2006

2. 2 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 Metadata for Image Formatting Joint initiative by SMPTE, ATSC, and CEA, to produce an end-to-end system solution for image formatting as related to aspect ratio Harmonized standards for format of necessary metadata, metadata carriage, and recommended practices for applications Work in progress – estimated completion mid- 2006

3. 3 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 Issues Optimize display of the image for the television viewer –Multiple production aspect ratios –At least two display aspect ratios Provide guidance for the format conversion process –In the receiver and display –In post and pre-broadcast Minimize changes to images created by the original program producer Maintain critical image content

4. 4 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 Image Aspect Ratios 4:3 16:9 >16:9 1.85 2.39 etc. 14:9

5. 5 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 Displays

6. 6 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 Displayed Images 16:9 4:3 16:9 4:3

7. 7 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 Undesirable Results Produce 4:3 4:3 using letterbox Viewer DisplayBroadcast 16:9 using pillarbox “Postage stamp”

8. 8 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 Undesirable Results Produce 16:916:9 using pillarbox Viewer DisplayBroadcast 4:3 using letterbox “Postage stamp” Other undesirable images – stretched, squashed or vital picture information lost due to cropping

9. 9 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 Undesirable Results Produce 16:916:9 using pillarbox Viewer DisplayBroadcast 4:3 using letterbox “Postage stamp” X

10. 10 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 Image Formatting Metadata AFD – Active Format Description Bar Data Pan-Scan Information Individual specifications already exist in standards –AFD: MPEG, ETSI/DVB, ATSC –Bar Data: ATSC –Pan-scan: SMPTE, MPEG-2 (also AVC and VC-1) Currently no carriage in HD baseband or MXF Limited guidelines on applications and use

11. 11 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 US Network Distribution Local Station ATSC Digital NTSC Analog Remote Production & Post Venues Contribution HD or SD Network Release Center DTV NTSC CEA ATSC MPEG SMPTE

12. 12 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 AFD, Bar Data, and Pan-Scan Carriage in Professional Environment SMPTE standards in preparation for carriage of AFD, Bar Data, and Pan-Scan in VANC of SDI and HD-DSI for the studio environment These standards also define KLV encoding for carriage in MXF, AAF, etc. Active Picture Area Vertical ANCillary data space Horiz. ANCillary data space

13. 13 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 DTV System Block Diagram RF Transmission System Ancillary Data Channel Coding Modulation Control Data Audio Subsystem Audio Source Coding & Compression Transport Service Multiplex &Transport Service Multiplex Video Subsystem Video Source Coding & Compression Studio/Master Control Audio Video Router/MC Switcher SMPTE 259M: 601 video (525/625) (SDI) SMPTE 292M: 1080i/p & 720p (HD-SDI)

14. 14 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 Active Format Description - AFD Four-bit code that defines the active image area and protected image areas for various combinations of aspect ratios –AFD is independent of image resolution Intended to guide receivers and STBs in how to optimize the displayed image –Also applications in the post and pre-broadcast chain Recommended practice for use of AFD and Bar Data now in preparation by CEA

15. 15 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 AFD Codes in a 4:3 Coded Frame

16. 16 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 AFD Codes in a 16:9 Coded Frame

17. 17 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 Format Conversion with AFD AFD code 1010 Letterbox 16:9 image vertically centered in the frame

18. 18 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 Image Aspect Ratio >16:9 AFD code 0100 aspect ratio >16:9 4:3 16:9

19. 19 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 Bar Data Signaled with AFD 0100 (aspect ratio >16:9) to indicate the exact width of the top and bottom bars May also be signaled with AFD 0000 (undefined) to indicate the width of the bars for any other non-standard active image area Bar Data signals one pair of bars only –Top/bottom or left/right –Not intended to signal a postage stamp - such transmitted images should be discouraged

20. 20 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 Bar Data Example AFD code 0100 (aspect ratio >16:9)

21. 21 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 Pan-Scan Information Used to signal how to extract a different aspect ratio viewport from a source image In broadcast world intended for professional use

22. 22 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 Pan-Scan Information

23. 23 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 Pan and Scan © Warner Bros. Screen shot courtesy of Letterbox and Widescreen Advocacy Page www.widescreen.org

24. 24 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 US Network Distribution Pan-Scan Application Local Station ATSC Digital NTSC Analog Remote Production & Post Venues Contribution HD or SD Network Center NTSC DTV

25. 25 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 US Network Distribution Pan-Scan Application Local Station ATSC Digital Remote Production & Post Venues Contribution HD or SD Network Center For MPEG links, Pan-Scan information is carried in display extensions of the video sequence header DTV NTSC Analog

26. 26 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 US Network Distribution Pan-Scan Application Local Station ATSC Digital Remote Production & Post Venues Contribution HD or SD Network Center DTV For MPEG links, Pan-Scan information is carried in display extensions of the video sequence header

27. 27 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 Output Documents CEA – recommended practice for use of AFD and Bar Data by receivers ATSC – minor revisions to A/53 for semantics of AFD and Bar Data for consistency with CEA RP SMPTE standards for carriage of AFD, Bar Data, and Pan-Scan information in VANC of SD and HD video and as KLV data SMPTE – recommended practice for operational use of AFD, Bar Data, and Pan-Scan information –Contributions welcome

28. 28 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 Related papers at NAB Broadcast Engineering Conference Adam Goldberg: The Importance of Video Format Metadata Bill Miller: Canceling the Postage Stamp

29. 29 Metadata for Formatting with Multiple Aspect Ratios – HPA – February 24, 2006 Thank yougjones@nab.org