© 2016 DECE, LLC – DECE CONFIDENTIAL CF Encoding and Validation Tools 1.

Slides:



Advertisements
Similar presentations
Certification Test Tool Jon Wheeler Test Lead Microsoft Corporation.
Advertisements

HTML5 ETDs Edward A. Fox, Sung Hee Park, Nicholas Lynberg, Jesse Racer, Phil McElmurray Digital Library Research Laboratory Virginia Tech ETD 2010, June.
Digital Living Network Alliance: Building out the Digital Network Bob Taylor Member, DLNA Board of Directors March 2006.
US Army Corps of Engineers BUILDING STRONG ® Performing Data Migration USACE SDSFIE Training Prerequisites: Implementing a Local Adaptation.
Mobyle XML Vivek Gopalan Version history: First version for training Nick and Art – Vivek, 02/07/2011.
US Army Corps of Engineers BUILDING STRONG ® Creating a Data Dictionary for Your Local Data USACE SDSFIE Training Prerequisites: Preparing Your Local Data.
SMPTE Timed Text in the UltraViolet™ Common File Format Mike Dolan (TBT)
© 2011 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Kiran Kaja | Accessibility Engineer Ensuring Accessibility in Document Conversion.
Quicktime Howell Istance School of Computing De Montfort University.
Metadata Presentation by Rick Pitchford Chief Engineer, School of Communication COM 633, Content Analysis Methods 3:56 PM.
1 Final Year Project 2003/2004 LYU0302 PVCAIS – Personal Video Conference Archives Indexing System Supervisor: Prof Michael Lyu Presented by: Lewis Ng,
EPOCH 1000 File Management Data Logging and Reporting
Microsoft Web and TV Workshop  Standards and industry specifications which should be supported:  MPEG DASH (Dynamic Adaptive Streaming with.
Situation november / december DRAFT Emile Bartolé CEN/WS XBRL: Improving transparency in financial and business reporting CWA2 Situation 1CWA2.
XP New Perspectives on XML Tutorial 3 1 DTD Tutorial – Carey ISBN
Addressing Metadata in the MPEG-21 and PDF-A ISO Standards NISO Workshop: Metadata on the Cutting Edge May 2004 William G. LeFurgy U.S. Library of Congress.
National Institute of Standards and Technology 1 Testing and Validating OAGi NDRs Puja Goyal Salifou Sidi Presented to OAGi April 30 th, 2008.
Lattice 2004Chris Maynard1 QCDml Tutorial How to mark up your configurations.
Report of Ad hoc Group on Reference Software, Conformance and Demonstrations Tiejun Huang Institute for Digital Media Peking University, China 18th,Jul.
Emily Gibson The College of New Jersey An Evaluation of Current Software Tools* Evaluation & Repair Software.
BDA UHD Format Study (SPE internal update)
Avoid using attributes? Some of the problems using attributes: Attributes cannot contain multiple values (child elements can) Attributes are not easily.
HDL Bencher FPGA Design Workshop. For Academic Use Only Presentation Name 2 Objectives After completing this module, you will be able to:  Describe the.
PREMIS Rathachai Chawuthai Information Management CSIM / AIT.
INFO 355Week #71 Systems Analysis II User and system interface design INFO 355 Glenn Booker.
Microsoft Access 2010 Chapter 10 Administering a Database System.
Label Design Tool Management Council F2F Washington, D.C. November 29-30, 2006
© 2002 IBM Corporation Confidential | Date | Other Information, if necessary June, 2011 Made available under the Eclipse Public License v Mobile.
Seybold SF 2002 Mark Stephens (Managing Director).
Copyright © 2012 UNICOM Systems, Inc. Confidential Information z/Ware Product Overview illustro Systems International A Division of UNICOM Global.
Presentation Name / 1 Visual C++ Builds and External Dependencies NAME.
Altman IM Ltd | | process | verify | convert | route | connect Prism Software’s solutions provide advanced workflow.
US Army Corps of Engineers BUILDING STRONG ® Submitting a Local Adaptation USACE SDSFIE Training Prerequisites: Creating the local adaptation.
Looking at various Rich Message options in KRAD Kuali University: Apply Now Lab : Rich Messages Lab Objectives Understand what Rich Messages are and how.
Planar® DirectLight™ LED Video Wall System
Hyperion Artifact Life Cycle Management Agenda  Overview  Demo  Tips & Tricks  Takeaways  Queries.
Developer Exam Preparation Thom Robbins Bryan Soltis
How to Rip and Convert Blu-ray to MOV Videos on Mac to Play Blu-ray Movies on iTunes From:
CMAF COMMON MEDIA APPLICATION FORMAT FOR INTERNET DELIVERY KILROY HUGHES, MICROSOFT ALBERT KOVAL, DECE
Application program interface (API)
AEM Digital Asset Management - DAM Author : Nagavardhan
SOFTWARE TESTING Date: 29-Dec-2016 By: Ram Karthick.
In this session, you will learn to:
Project Work Order Generator
Advance Steel: Automatic generation
MXFComponentSuite Version 2.0 Technical Overview
Topics Introduction Hardware and Software How Computers Store Data
z/Ware 2.0 Technical Overview
Supervisor: Prof Michael Lyu Presented by: Lewis Ng, Philip Chan
Oracle Subledger Accounting
What is new In Pangea 6.10 Pangea 6.10.
© 2016 Pearson Education, Inc., Hoboken, NJ. All rights reserved.
Digital System Verification
PPT By:Gaurav Jaiswal Singsys Pte. Ltd.
Chapter 7 Text Input/Output Objectives
Cartography and Labeling
NIMAC for Publishers & Vendors: Delivering Files
MIKADO: Generation of CDI ISO19139 XML files
ELECTRONIC MAIL SECURITY
Topics Introduction Hardware and Software How Computers Store Data
ELECTRONIC MAIL SECURITY
New Perspectives on XML
S-127 – Marine Traffic Management Release Candidate NIPWG 6 30 January 2019 Raphael Malyankar Eivind Mong Sponsored by IHO.
Teaching slides Chapter 6.
Summary of WISE electronic delivery
PPT and video are due no later than March 1, 2019
Mukurtu: Batch Upload, Roundtrip
Use Cases Simple Machine Translation (using Rainbow)
PSS0 Configuration Management,
New transmission methods: Use the most adapted transmission methods.
Presentation transcript:

© 2016 DECE, LLC – DECE CONFIDENTIAL CF Encoding and Validation Tools 1

© 2016 DECE, LLC – DECE CONFIDENTIAL Outline CF Specifications Inheritance – Specifications that are inherited, extended, or constrained by DECE CF Specifications CF Creation – DECE CF Generator: CFFGen – Test files CF Validation Tool – DECE CF Verifier: DECEMate – What it validates – What it does not validate – Usage 2

© 2016 DECE, LLC – DECE CONFIDENTIAL CF Specifications Inheritance 3

© 2016 DECE, LLC – DECE CONFIDENTIAL CFFGen Created for testing Devices and testing the Verifier – Engineering-level tool – Able to create unusual or incorrect files as well as valid files – Not user-friendly – Not set up for commercial workflows Input is – XML file referencing other inputs and setting options (single-track or multi-track file, metadata schema versions, APID, etc.) – Metadata XML – Properly-encoded Video and/or Audio and/or CF-TT (text, or image with pngs) – Encryption keys, seed for random keys, or use randomly-generated keys Output is – Single-track or Multi-track file – Key list in.csv file – If output is single-track files DMP with accompanying XML (TOC, etc.) is built manually and packaged with 7-Zip MPD is built manually 4

© 2016 DECE, LLC – DECE CONFIDENTIAL CF Sample and Test Files Over 100 files created Most are multi-track files Some single-track files have been created to test media packages and streaming A subset of sample files are available at – All files at that URL are multi-track files – Files are unencrypted In addition to files specifically created for testing, a number of commercially-created CF files exist 5

© 2016 DECE, LLC – DECE CONFIDENTIAL CF Verifier CF Verifier executables available to DECE Members and Licensees – Available as Windows, Mac, and Linux executables – Includes a user guide and other documentation Validates single-track files, either by themselves or as part of DMPs or referenced by MPDs Validates DMPs and MPDs Violations of “SHALL” statements in specifications result in errors Violations of “SHOULD” statements result in warnings To be considered compliant with the specifications, files must have zero errors 6

© 2016 DECE, LLC – DECE CONFIDENTIAL Key Verifier Features Parse CF boxes Extract “essence” streams such as audio, video, subtitles, and metadata – Note that extracted (demultiplexed) video and most audio is not playable as CF creation strips out header information; only demuxed AC-3 audio can be played – Subtitles are extracted exactly as they are found (including comments and whitespace) Decrypt encrypted content before demultiplexing, provided the decryption keys are available Evaluate files within Digital Media Packages (DMPs), including the DMP file structure Perform Hypothetical Reference Decoder (HRD) analysis on HEVC tracks Evaluate – Multi-track files – Single-track CF files – Bare CF-TT (subtitle) files 7

© 2016 DECE, LLC – DECE CONFIDENTIAL Conformance Points File structure – Headers and footers – Box order and fields – Fragment ordering and duration – Number of tracks required/allowed Encoding – AVC Video constraints – HEVC Video constraints – Codec-specific audio constraints AAC DTS Dolby Encryption – Number and format of keys – Box types for encrypted track data CF-TT – CF-TT constraints – Rendering rate – Document structure and schema validation – Size and frame rate same as video – Rendering within region Metadata – Schema validation – Validation against track data – Image format and size as applicable – Required and optional metadata Media packages – Required XML files – File structure Details available in the Verifier Verification Matrix document which accompanies each release 8

© 2016 DECE, LLC – DECE CONFIDENTIAL Items Not Evaluated by the Verifier Video quality (macroblocking, tearing) Audio quality (noise) Subtitle rendering when using non-recommended fonts (other than proportional sans serif or monospace serif) – Subtitles that use proportional sans serif or monospace serif fonts are rendered and validated against region size Subtitle readability or placement vs. video content/safe area Presence of content referenced by external URLs – The Verifier was designed to be executable without access to the internet Metadata matching track data when equivalence is not called out in the specifications Inter-track synchronization of video, audio, and subtitles Full validation of video to AVC or HEVC specification Compliance of individual files (other than subtitle files) that could be used to create a CF file. For example, the Verifier cannot be used to validate an AVC video file Portable-Definition (PD), Dolby Vision (DV), HDR10, or HDR12 media profiles 9

© 2016 DECE, LLC – DECE CONFIDENTIAL Verifier Options Verifier is a command-line tool A number of options are available to indicate what should be evaluated, as well as output level (error, warning, info) Input flags include: – -x: Demux video and audio tracks – -u: Validate subtitles – -k : Use given Key ID: Value pair to decrypt track data – -j: Evaluate DMP file – -q: Evaluate a set of single-track files referenced by an MPD A configuration file can be used to pass common flags to the Verifier and to reference schema and font file locations 10

© 2016 DECE, LLC – DECE CONFIDENTIAL Verifier Output Subtitle tracks (if present) as TTML, including images for image subtitles Required Metadata as XML, including images Optional Metadata as XML, including images Demuxed video and audio track data Box maps in both text and XML format For files with HEVC, HRD plots for buffer fullness and access unit size Verifier Report, which includes DMP files return an overview MPReport for the DMP, and sub-reports for each track analyzed Likewise, MPD files return an overview MPDReport for the DMP, and sub-reports for each track analyzed 11 Input Filename Verifier Version Compliant Options Used APID and Content ID Media Profile Number and types of Errors and Warnings Video format Audio codecs and number of channels Number of image and text subtitle tracks

© 2016 DECE, LLC – DECE CONFIDENTIAL Verifier Report: Error Example <error error_code="trun.12" file_offset=" " file_offset_hex="0x1e182a" section="A.4, A.5, B.4, B.5, C.4, C.5" specification="CFF Media Format v1.0.7"> fragment duration exceeds maximum found seconds, expected no more than seconds for 'vide' track 12 Unique Error Code Offset from start of file Specification reference for violation Error text

© 2016 DECE, LLC – DECE CONFIDENTIAL Verifier File Output Example: Multi-Track File 13

© 2016 DECE, LLC – DECE CONFIDENTIAL Verifier Usage Determine whether files meet specifications when created by Content Providers Command-line interface and use of config files lends itself to scripting/chron jobs Use script to set up watched folders Parse XML output to look for errors Extract and evaluate subtitle data – Determine subtitle format – Check subtitle timing and presence Determine which DRM systems have written licenses to the file Check for values not exposed when playing files Extract and evaluate metadata, including images for chapter thumbnails Compare file structure and settings (e.g., flags) to other files 14

© 2016 DECE, LLC – DECE CONFIDENTIAL Summary CF is a well tested format and is considered stable. CF Content and the Verifier have been in testing since 2011, involving multiple different companies and implementations. Many specification corrections and clarifications were made during the implementation of the CF Generator and Verifier. Over 100 Sample Files exist for Verification. – Some of these files have been adapted for use other organizations, such as IMSC (Internet Media Subtitles and Captions) Thousands of files for commercial titles have been created. The CF Verifier has over 1000 different conformance tests, outlined in the Verifier Verification Matrix. 15