TAUS presents the Quality Dashboard TAUS presents the Quality Dashboard.... This does not just fall from the sky. We have been working on this for five years already, but. What happened? First let’s go back to see how it started. TAUS Presents: The Quality Dashboard Measuring and benchmarking quality, productivity and efficiency of translation on an industry-shared platform www.taus.net

What About Translation Quality Old School: “One size fits all” Since the 1980’s LISA QA Model, SAE J2450 prescribe today’s quality processes: Static: One quality fits all purposes, all content, all audiences Subjective: Evaluations are often subjective and anecdotal Costly: QE causes friction, delays QE can cost up to 25% of total translation costs Non-transparent: Necessity without remedy Most of us (depending on your age) have grown up with a static view of translation or language quality…. We count errors like punctuation mistakes, spelling errors, wrong terms, grammar mistakes, etc. Based on the number of errors, we give it a pass or a fail. Great … doing this we all fee like school masters. But is it really the only way to assess translation quality? In sessions with TAUS members – in 2011 – we learned that this model is problematic. It’s static, subjective, costly and non-transparent. The case was made for a more dynamic approach. Dynamic Quality Framework

Industry Collaborative Program DQF started in 2011 Participating members Adobe Appen Autodesk AVB CA Technologies Cisco Crestec Crosslang Dell DFKI eBay  EMC Google Hewlett Packard Intel LDS Church Lingo24 Lionbridge Medtronic Microsoft Moravia Nikon Oracle Pactera Pangeanic Paypal Philips PTC Siemens Spil Games Systran VMware Welocalize Yahoo! DQF started in 2011. with and for the TAUS members. This foundational report (Nov. 2011) lists all the reasons and theories, recommendations and proposals for a new approach, new methods, best practices. Ingredients: content profiling, seven methods for evaluation This slide may not be used or copied without permission from TAUS

From DQF Tools to Quality Dashboard Since January 2014 Tools on TAUS web site: to measure: Productivity Adequacy Fluency to review and count: Translation errors to get: Stats and reports Used by 100+ members Quality Dashboard Launched June 2015 DQF integrated in: TRADOS Studio MateCat Memsource (planned) WorldServer (planned) Use of DQF plug-in provides: Enhanced statistics Benchmarking Open to everyone TAUS developed a knowledge base, metrics, templates, etc. We organized QE Summits, set up a User Group and ran consultation sessions for best practices. Our members asked us also to develop the tools and make them available through our web site. Tools were designed to run evaluations only….. From time-to-time… but users asked us if they could use it as part of translation production every day. They asked if we could make an API available so that they could use the DQF tools from within their existing translation tool environment.

The Power and Value of the Quality Dashboard DQF collects data and generates reports on the Dashboard real-time Translators, managers, buyers, developers get their own stats, benchmarks and analytics Not only track and benchmark against your own data, but also against industry averages, between translators, customers, projects, technologies Quality Evaluation Business Intelligence

What is the average productivity? Home Services Academy Events Blog Review Membership My TAUS Quality Dashboard Productivity Efficiency Adequacy Fluency Language Time Technology Process Content Industry Project Translator/vendor Customer Statistics   Language Distribution of segments i More information > Benchmark Quality Dashboard Content profiling Quality evaluation Adequacy/Fluency Error review MT Ranking Productivity measurement DQF API August 31, 2015: 566,987,756 words have been measured

What is the average productivity of MT vs. TM? Home Services Academy Events Blog Review Membership My TAUS Quality Dashboard Productivity Efficiency Adequacy Fluency Language Time Technology Process Content Industry Project Translator/vendor Customer Statistics   Language Distribution of segments i More information > Benchmark Quality Dashboard Content profiling Quality evaluation Adequacy/Fluency Error review MT Ranking Productivity measurement DQF API August 31, 2015: 566,987,756 words have been measured

What is my productivity compared to industry? Home Services Academy Events Blog Review Membership My TAUS Quality Dashboard Productivity Efficiency Adequacy Fluency Language Time Technology Process Content Industry Project Translator/vendor Customer Statistics   Language Distribution of segments i More information > Benchmark Quality Dashboard Content profiling Quality evaluation Adequacy/Fluency Error review MT Ranking Productivity measurement DQF API August 31, 2015: 566,987,756 words have been measured

Where do my translations come from? Home Services Academy Events Blog Review Membership My TAUS Quality Dashboard Productivity Efficiency Adequacy Fluency Language Time Technology Process Content Industry Project Translator/vendor Customer Statistics   Language Distribution of segments i More information > Benchmark Quality Dashboard Content profiling Quality evaluation Adequacy/Fluency Error review MT Ranking Productivity measurement DQF API August 31, 2015: 566,987,756 words have been measured

Where do my translations come from vs. industry? Home Services Academy Events Blog Review Membership My TAUS Quality Dashboard Productivity Efficiency Adequacy Fluency Language Time Technology Process Content Industry Project Translator/vendor Customer Statistics   Language Distribution of segments i More information > Benchmark Quality Dashboard Content profiling Quality evaluation Adequacy/Fluency Error review MT Ranking Productivity measurement DQF API August 31, 2015: 566,987,756 words have been measured

What is my productivity by language and by project? Home Services Academy Events Blog Review Membership My TAUS Quality Dashboard Productivity Efficiency Adequacy Fluency Language Time Technology Process Content Industry Project Translator/vendor Customer Statistics   Language Distribution of segments i More information > Benchmark Quality Dashboard Content profiling Quality evaluation Adequacy/Fluency Error review MT Ranking Productivity measurement DQF API August 31, 2015: 566,987,756 words have been measured

TAUS DQF Infrastructure Project manager DQF Analysis engine DQF Reporting engine TMS / GMS / CAT Tool Project settings TAUS DQF SERVER User management Translator can in some cases be the same person as the project manager Translator Segment/timing CAT Tool / editor Translator report Project manager report … Business Intelligence report

Project manager

Project classification Content type Industry Process Quality level CAT Tool / MT engine

Project manager defines project

Translator

The translator won’t see differences, because everything happens in the background

Data points Milliseconds per segment Source segment Target segment Edited target segments Time Language pair Project key Translator key

Experiences with the implementation Desktop applications How to transfer the project? How to register the translator? Cloud based Implementation is easier All data is central

Benefits of the Quality Dashboard DQF elevates the discussion about quality to an industry level. The resulting benefits are: Sharing knowledge and standard references Increased credibility Lower cost Increased satisfaction Increased flexibility

What’s next? Find out more on the TAUS web site: Download the Quality Dashboard description Find the API specifications and integrate your translation tool

This slide may not be used or copied without permission from TAUS