Why XLIFF and Why XLIFF 2 ? David Filip OASIS XLIFF OMOS TC Chair

Slides:



Advertisements
Similar presentations
Microsoft Office System UK Developers Conference Radisson Edwardian, Heathrow 29 th & 30 th June 2005.
Advertisements

Dr. Leo Obrst MITRE Information Semantics Information Discovery & Understanding Command & Control Center February 6, 2014February 6, 2014February 6, 2014.
Bringing Procedural Knowledge to XLIFF Prof. Dr. Klemens Waldhör TAUS Labs & FOM University of Applied Science FEISGILTT 16 October 2012 Seattle, USA.
Click View > Slide Master to insert a photo as a background behind the colored boxes. Driving the XLIFF Standard at Microsoft 3 rd International XLIFF.
Open Office.Org What is the Open Office.org Source Project? Open source project through which Sun Microsystems is releasing the technology for the popular.
The MultilingualWeb-LT Working Group receives funding by the European Commission (project name LT-Web) through the Seventh Framework Programme (FP7) in.
ISO DSDL ISO – Document Schema Definition Languages (DSDL) Martin Bryan Convenor, JTC1/SC18 WG1.
L10N Standards Warszawa 2014
Visual Web Information Extraction With Lixto Robert Baumgartner Sergio Flesca Georg Gottlob.
Aletheia Apostolos Antonacopoulos PRImA Lab, The University of Salford, United Kingdom
1 CA201 Word Application Creating Document for the Web Week # 9 By Tariq Ibn Aziz Dammam Community college.
Microsoft Office Open XML Formats Brian Jones Lead Program Manager Microsoft Corporation.
Esri UC 2014 | Technical Workshop | Leveraging Metadata Standards for Supporting Interoperability in ArcGIS Aleta Vienneau, David Danko.
XML Exchange Development CAM Technology Tutorial – Public Sector NIEM Team, June 2011 CAM Test Model Data Deploy Requirements Build Exchange Generate Dictionary.
1 1 Roadmap to an IEPD What do developers need to do?
 ACORD ACORD’s Experiences using W3C Schemas Dan Vint Senior Architect
(C) 2013 Logrus International Practical Visualization of ITS 2.0 Categories for Real World Localization Process Part of the Multilingual Web-LT Program.
IPUMS to IHSN: Leveraging structured metadata for discovering multi-national census and survey data Wendy L. Thomas 4 th Conference of the European Survey.
JXON An Architecture for Schema and Annotation Driven JSON/XML Bidirectional Transformations David A. Lee Senior Principal Software Engineer Slide 1.
San José, CA – September, 2004 Localizing with XLIFF and ICU Markus Scherer Raghuram (Ram) Viswanadha IBM San.
The MultilingualWeb-LT Working Group receives funding by the European Commission (project name LT-Web) through the Seventh Framework Programme (FP7) in.
Creating a Basic Web Page
 Trends: › usual trio: desktop version, server version, cloud version › cloud version + free editor › industry standards adopted (XLIFF, TMX, TBX)
DIGIT Directorate-General for Informatics DIGIT Directorate-General for Informatics EUSURVEY Creating online surveys DIGIT EUSURVEY SUPPORT.
The MultilingualWeb-LT Working Group receives funding by the European Commission (project name LT-Web) through the Seventh Framework Programme (FP7) in.
Tyler Snow Brigham Young University Translation Research Group.
MultilingualWeb – Language Technology A New W3C Working Group Felix Sasaki, David Filip, David Lewis.
Silverlight Technology. Table of Contents 1.What is Silverlight Technology? 2.Silverlight Overview. 2.1 How it works 2.2 Silverlight development tools.
Document Formats How to Build a Digital Library Ian H. Witten and David Bainbridge.
Coping with Babel How to Localize XML. Designing for Localization Document design can seriously impact the costs of translation and localization. Remember.
Internationalization: Implementing the XLIFF Standard Jon Allen, Producer instructional media + magic, inc. JA-SIG Summer Conference 2003 June 10, 2003.
CP3024 Lecture 9 XML: Extensible Markup Language.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
Tuesday, November 12, 2002 LRC 2002 Conference XLIFF An XML standard for localisation Tony Jewtushenko – Oracle Peter Reynolds – Bowne Global Solutions.
XLIFF 2.0 GLOSSARY MODULE / TBX-BASIC Facilitating Interoperability and Compatibility.
The european ITM Task Force data structure F. Imbeaux.
Open Source CAT Tool Patrícia Azeredo Ivone Ferreira IT for Translation 2009/2010.
The MultilingualWeb-LT Working Group receives funding by the European Commission (project name LT-Web) through the Seventh Framework Programme (FP7) in.
XLIFF 2.0 vs XLIFF 1.2 FEISGILTT Dublin June 2014 Yves Savourel ENLASO Corporation This presentation was made possible by.
PASSOLO ® Makes Your Software Ready for the Global Market Localisation Standards The Tools Developer’s Perspective.
Xml:tm XML Based Text Memory Using XML technology to reduce the cost of translating XML documents 27 June 2005.
Using Semantic Mapping to Manage Heterogeneity in XLIFF Interoperability by Dave Lewis, Rob Brennan, Alan Meehan, Declan O’Sullivan CNGL Centre for Global.
Xml:tm XML Text Memory Using XML technology to reduce the cost of translating XML documents.
FEISGILTT Dublin 2014 Yves Savourel ENLASO Corporation QuEst Integration in Okapi This presentation was made possible by This project is sponsored by the.
TMF - Terminological Markup Framework Laurent Romary Laboratoire LORIA (CNRS, INRIA, Universités de Nancy) ISO meeting London, 14 August 2000.
Dictionary based interchanges for iSURF -An Interoperability Service Utility for Collaborative Supply Chain Planning across Multiple Domains David Webber.
Machine Translate Post Edit Quality Check Extract Content I18N Text Analysis Curate Corpora Workflow Analysis Segment Identify Terms Translate Provenance.
ITS 2.0 in XLIFF 2 FEISGILTT Dublin June 2014 Yves Savourel ENLASO Corporation This presentation was made possible by.
Games: XML Presented by: Idham bin Mat Desa Mohd Sharizal bin Hamzah Mohd Radzuan bin Mohd Shaari Shukor bin Nordin.
Standards that might come up in discussion today EN 15038: quality standard developed especially for translation services providers, including regular.
1 Survey of Profiles from Other Domains XMSF Profile SG 13 January 2004 Curt Blais and NPS MV3250 (Introduction to XML, 1st Quarter 2005) Katherine L.
The Case for Connectivity
A report by Olaf-Michael Stefanov to the JIAMCATT community
What are they? The Package Repository Client is a set of Tcl scripts that are capable of locating, downloading, and installing packages for both Tcl and.
Open Source CAT Tool.
Dave Lewis W3C MultilingualWeb - Language Technology Working Group
The Re3gistry software and the INSPIRE Registry
DITA & Non-DITA AUTHORING Platforms
Translation Workspace File Filters
Silverlight Technology
Part of the Multilingual Web-LT Program
DITA Translation Management Challenges in Japan
Touchstone Testing Platform
LOD reference architecture
Part of the Multilingual Web-LT Program
What is TBX? TermBase eXchange
© RWS Moravia & ADAPT Centre
XLIFF 2 Industry Update David Filip, Uwe Stahlschmidt & Daniel Goldschmidt CNGL/ADAPT & Microsoft.
Use Cases Simple Machine Translation (using Rainbow)
Linked Data Reuse in the Language Services Industry
Presentation transcript:

Why XLIFF and Why XLIFF 2 ? David Filip OASIS XLIFF OMOS TC Chair OASIS XLIFF TC Secretary, Editor, Liaison Officer Spokes Research Fellow ADAPT Centre KDEG, Trinity College Dublin The ADAPT Centre is funded under the SFI Research Centres Programme (Grant 13/RC/2106) and is co-funded under the European Regional Development Fund.

XML Localisation/Localization Interchange File Format What is XLIFF? XML Localisation/Localization Interchange File Format  The only open standard bitext format XLIFF 1.2 OASIS Standard since Feb 2008 Superseded by XLIFF 2.0 on 5th August 2014 To be superseded by XLIFF 2.1 by June 2017 XLIFF Version 2.1 now under 1st Public Review! https://multilingual.com/language-in-the-news/xliff-2-1-open-public-review/

XLIFF 2.1 First Public Review The first “dot” release after XLIFF 2.0 delivers on the modularity promise of the XLIFF 2 architecture. XLIFF 2.1 defines two (2) new namespaces and brings a full native ITS 2.0 capability via its ITS Module without breaking the backwards compatibility with XLIFF 2.0. XLIFF 2 Core and 7 out of 8 XLIFF 2.0 Modules are unaffected by the 2.1 release. Apart from a major bugfix for the Change Tracking Module and the brand new ITS module, XLIFF 2.1 brings Advanced Validation capability. XLIFF 2.1 (and XLIFF 2.0 also) can be now 100% validated with standardized validation artifacts without regress to custom validation code. The expressivity of the validation framework was greatly enhanced by the usage of Schematron and NVDL schema languages on top of XML Schemas (xsd) that were available in XLIFF 2.0.

Evolution and Adoption of Bitext formats Back to the basics Bitext Bitext Management --------------------- Open Standards Transparency of development and publishing Availability under Royalty Free (RF) conditions Evolution and Adoption of Bitext formats Overview of XLIFF 2 data structure Takeaways

Bitext A structured (usually mark up language based) artefact that contains aligned source (natural language) and target (natural language) sentences. We consider bitext to be ordered by default (such as in an XLIFF file – defined below, an “unclean” rtf file, or a proprietary database representation). Nevertheless, unordered bitext artefacts like translation memories (TMs) or terminology bases (TBs) can be considered special cases of bitext or bitext aggregates, since the only purpose of TM as an unordered bitext is to enrich ordered bitext, either directly or through training a Machine Translation engine. (Filip, 2012) (Filip and Ó Conchúir, 2011)

Bitext A structured (usually mark up language based) artefact that contains aligned source (natural language) and target (natural language) sentences. We consider bitext to be ordered by default (such as in an XLIFF file – defined below, an “unclean” rtf file, or a proprietary database representation). Nevertheless, unordered bitext artefacts like translation memories (TMs) or terminology bases (TBs) can be considered special cases of bitext or bitext aggregates, since the only purpose of TM as an unordered bitext is to enrich ordered bitext, either directly or through training a Machine Translation engine. (Filip, 2012) (Filip and Ó Conchúir, 2011)

Bitext Tyger Tyger, burning bright, Tygře, tygře, ohnivou In the forests of the night; září svítíš lesní tmou! What immortal hand or eye, Kdo ten nesmrtelný byl, Could frame thy fearful symmetry? že z ní tvůj souměr sestrojil? William Blake / Jaroslav Skalický

Bitext Tyger Tyger, burning bright, Tygře, tygře, ohnivou In the forests of the night; září svítíš lesní tmou! What immortal hand or eye, Kdo ten nesmrtelný byl, Could frame thy fearful symmetry? že z ní tvůj souměr sestrojil? Willian Blake Jaroslav Skalický

Bitext <source>Tyger Tyger, burning bright, </source> <target>Tygře, tygře, ohnivou </target> <source>In the forests of the night; </source> <target>září svítíš lesní tmou! </target> <source>What immortal hand or eye, </source> <target>Kdo ten nesmrtelný byl, </target> <source>Could frame thy fearful symmetry? </source> <target>že z ní tvůj souměr sestrojil? </target>

Bitext msgid "Tyger Tyger, burning bright, " msgstr "Tygře, tygře, ohnivou " msgid "In the forests of the night; " msgstr "září svítíš lesní tmou! " msgid "What immortal hand or eye, " msgstr "Kdo ten nesmrtelný byl, " msgid "Could frame thy fearful symmetry? " msgstr "že z ní tvůj souměr sestrojil? "

Bitext <source xml:lang= "EN">Tyger Tyger, burning bright, </source> <target xml:lang= "CS">Tygře, tygře, ohnivou </target> <source xml:lang="EN">In the forests of the night; </source> <target xml:lang="CS">září svítíš lesní tmou! </target> <source xml:lang="EN">What immortal hand or eye, </source> <target xml:lang="CS">Kdo ten nesmrtelný byl, </target> <source xml:lang="EN">Could frame thy fearful symmetry? </source> <target xml:lang="CS">že z ní tvůj souměr sestrojil? </target>

Bitext <unit id=1> <segment> <source xml:lang="EN">Tyger Tyger, burning bright, </source> <target xml:lang="CS">Tygře, tygře, ohnivou </target> </segment> <source xml:lang="EN">In the forests of the night; </source> <target xml:lang="CS">září svítíš lesní tmou! </target> <source xml:lang="EN">What immortal hand or eye, </source> <target xml:lang="CS">Kdo ten nesmrtelný byl, </target> <source xml:lang="EN">Could frame thy fearful symmetry? </source> <target xml:lang="CS">že z ní tvůj souměr sestrojil? </target> </unit>

Bitext management [Bitext Management is a g]roup of processes that consist of high and low level manipulation of ordered and/or unordered bitext artefacts. Agents can be both human and machine. Usually the end purpose of Bitext Management is to create target (natural language) content from source (natural language) content, typically via other enriching Bitext Transforms, so that Bitext Management Processes are usually enclosed within a bracket of source content extraction and target content re-import. (Filip, 2012) (Filip and Ó Conchúir, 2011)  

Bitext management [Bitext Management is a g]roup of processes that consist of high and low level manipulation of ordered and/or unordered bitext artefacts. Agents can be both human and machine. Usually the end purpose of Bitext Management is to create target (natural language) content from source (natural language) content, typically via other enriching Bitext Transforms, so that Bitext Management Processes are usually enclosed within a bracket of source content extraction and target content re-import. (Filip, 2012) (Filip and Ó Conchúir, 2011)  

XLIFF Roundtrip example Courtesy of Arle Lommel and Alan Melby

Bitext management?

Bitext management – SMBs don’t manage bitext

Bitext management – corporations do manage bitext

Open Standards https://www.dropbox.com/s/m9nhytgetegn0by/Screenshot%202016-11-17%2000.41.42.png?dl=0

Open Standards https://www.dropbox.com/s/m9nhytgetegn0by/Screenshot%202016-11-17%2000.41.42.png?dl=0

Evolution and adoption of bitext formats rtf based scripts po gettext | | V | XML based proprietary | XLIFF 1.x <------------------------------------------ | V XLIFF 2.x LIFF OM ------- JLIFF or JLIMF?, protobufLIFF, YALIFF etc.

XLIFF 2 Data Model

Modular Design Mandatory Core Modules Optional Extensions Custom

Intent of Modular Design Interoperability Adaptability Core Modules Extensions NON-Negotiable Guaranteed roundtrip Optional Guaranteed survival Custom/private Application specific Should survive roundtrip

XLIFF 2 Overview - Agents Writer Extractor, Enricher, e.g. reviewer workbench, TM server, MT broker etc. Modifier, e.g. a translation editor Merger Etc. e.g. validator

An extremely good thing for interoperability Roundtrip oriented XLIFF 2 Overview - Core About 20% of XLIFF 1.2 feature set An extremely good thing for interoperability Roundtrip oriented New segmentation model New inline text model All and only features that are necessary to roundtrip source with target translations

XLIFF 2 Overview – Core data model About 20% of XLIFF 1.2 feature set An extremely good thing for interoperability Roundtrip oriented New segmentation model New inline text model All and only features that are necessary to roundtrip source with target translations

XLIFF 2 data model – top to group recursion

XLIFF 2 data model – unit

XLIFF 2 data model – Inline

XLIFF 2 Overview - Modules All else are OPTIONAL features available through MODULES – Translation Candidates Module – Glossary Module – Format Style Module – Metadata Module – Resource Data Module – Change Tracking Module – Size and Length Restriction Module – Validation Module

XLIFF 2 Overview - Modules All else are OPTIONAL features available through MODULES – Translation Candidates Module 2.0 + ITS – Glossary Module 2.0 – Format Style Module 2.0 – Metadata Module 2.0 – Resource Data Module 2.0 <- ITS – Change Tracking Module 2.0 -> 2.1 – Size and Length Restriction Module 2.0 <- ITS – Validation Module 2.0 – ITS Module 2.1

The big picture ITS 1.0 Translate Localization Note Terminology Directionality Ruby Language Information Elements Within Text ITS 2.0 Domain Text Analysis Locale Filter Provenance External Resource Target Pointer ID value Preserve Space Localization Quality Issue Localization Quality Rating MT Confidence Allowed Characters Storage Size XLIFF Translate Annotation Note Term Annotation srcLang, trgLang, xml:lang, itsm:lang Subflows mechanism Itsm:domains ITSM Text Analytics Extraction / ITSM mechanism ctr: module + ITSM Provenance res: module <source> & <target> siblings XLIFF specific ID and FRAGID xml:space ITSM LQI ITSM LQR mtc: module / itsm:mtConfidence ITSM Allowed Characters slr: module Other standards TBX UAX #9 locale specific layouts for HTML BCP47 Dublin Core IANA media types xml:id MQM TMX regular expressions Unicode code points, fonts etc.

Industry Adoption of XLIFF 2.0 Second Wave (working now) Okapi XLIFF Toolkit https://bitbucket.org/okapiframework/xliff-toolkit http://okapi-lynx.appspot.com/validation Xmarker - http://www.xmarker.com/node/5 Microsoft – Microsoft Open Sourced their OM implementation https://github.com/Microsoft/XLIFF2-Object-Model Lionbridge Multilizer memsource Ocelot SDL – all products! AEM XTM Et al.

Thanks a million for your attention david.filip@adaptcentre.ie Questions and Answers    Thanks a million for your attention david.filip@adaptcentre.ie

XLIFF 2 Resources http://www.localisation.ie/locfocus/issues/14/1 https://www.oasis-open.org/committees/xliff-omos/ https://github.com/oasis-tcs/xliff-omos-om https://github.com/oasis-tcs/xliff-omos-jliff https://tools.oasis-open.org/version-control/browse/wsvn/xliff-omos/trunk/XLIFF-TBX/xliff-tbx-v1.0.pdf https://www.oasis-open.org/committees/xliff/ http://docs.oasis-open.org/xliff/xliff-core/v2.1/xliff-core-v2.1.html https://www.oasis-open.org/committees/comments/index.php?wg_abbrev=xliff https://issues.oasis-open.org/browse/XLIFF/ Presentations from 7th XLIFF Symposium at 5th FEISGILTT at #LocWorld31 Dublin June 7-8, 2016 http://locworld.com/feisgiltt2016-cfp/ Presentations from 6th XLIFF Symposium at 4th FEISGILTT at #LocWorld28 Berlin June 2-3, 2015 http://locworld.com/feisgiltt-program/ FEISGILTT Localisation Focus Volumes http://www.localisation.ie/locfocus/issues/14/1 http://www.localisation.ie/locfocus/issues/12/1