1. TAUS presents the Quality Dashboard
TAUS presents the Quality Dashboard.... This does not just fall from the sky. We have been working on this for five years already, but.
What happened?
First let’s go back to see how it started.
TAUS Presents: The Quality Dashboard Measuring and benchmarking quality, productivity and efficiency of translation on an industry-shared platform

2. What About Translation Quality
Old School: “One size fits all”
Since the 1980’s
LISA QA Model, SAE J2450 prescribe today’s quality processes:
Static:
One quality fits all purposes, all content, all audiences
Subjective:
Evaluations are often subjective and anecdotal
Costly:
QE causes friction, delays
QE can cost up to 25% of total translation costs
Non-transparent:
Necessity without remedy
Most of us (depending on your age) have grown up with a static view of translation or language quality…. We count errors like punctuation mistakes, spelling errors, wrong terms, grammar mistakes, etc. Based on the number of errors, we give it a pass or a fail. Great … doing this we all fee like school masters. But is it really the only way to assess translation quality?
In sessions with TAUS members – in 2011 – we learned that this model is problematic. It’s static, subjective, costly and non-transparent. The case was made for a more dynamic approach.
Dynamic
Quality
Framework

3. Industry Collaborative Program DQF started in 2011
Participating members
Adobe
Appen
Autodesk
AVB
CA Technologies
Cisco
Crestec
Crosslang
Dell
DFKI
eBay 
EMC
Google
Hewlett Packard
Intel
LDS Church
Lingo24
Lionbridge
Medtronic
Microsoft
Moravia
Nikon
Oracle
Pactera
Pangeanic
Paypal
Philips
PTC
Siemens
Spil Games
Systran
VMware
Welocalize
Yahoo!
DQF started in with and for the TAUS members. This foundational report (Nov. 2011) lists all the reasons and theories, recommendations and proposals for a new approach, new methods, best practices.
Ingredients: content profiling, seven methods for evaluation
This slide may not be used or copied without permission from TAUS

4. From DQF Tools to Quality Dashboard
Since January 2014
Tools on TAUS web site:
to measure:
Productivity
Adequacy
Fluency
to review and count:
Translation errors
to get:
Stats and reports
Used by 100+ members
Quality Dashboard
Launched June 2015
DQF integrated in:
TRADOS Studio
MateCat
Memsource (planned)
WorldServer (planned)
Use of DQF plug-in provides:
Enhanced statistics
Benchmarking
Open to everyone
TAUS developed a knowledge base, metrics, templates, etc. We organized QE Summits, set up a User Group and ran consultation sessions for best practices. Our members asked us also to develop the tools and make them available through our web site.
Tools were designed to run evaluations only….. From time-to-time… but users asked us if they could use it as part of translation production every day. They asked if we could make an API available so that they could use the DQF tools from within their existing translation tool environment.

5. The Power and Value of the Quality Dashboard
DQF collects data and generates reports on the Dashboard real-time
Translators, managers, buyers, developers get their own stats, benchmarks and analytics
Not only track and benchmark against your own data, but also against industry averages, between translators, customers, projects, technologies
Quality Evaluation
Business Intelligence

6. What is the average productivity?
Home
Services
Academy
Events
Blog
Review
Membership
My TAUS
Quality Dashboard
Productivity
Efficiency
Adequacy
Fluency
Language
Time
Technology
Process
Content
Industry
Project
Translator/vendor
Customer
Statistics
  Language
Distribution of segments i
More information
>
Benchmark
Quality Dashboard
Content profiling
Quality evaluation
Adequacy/Fluency
Error review
MT Ranking
Productivity measurement
DQF API
August 31, 2015: 566,987,756 words have been measured

7. What is the average productivity of MT vs. TM?
Home
Services
Academy
Events
Blog
Review
Membership
My TAUS
Quality Dashboard
Productivity
Efficiency
Adequacy
Fluency
Language
Time
Technology
Process
Content
Industry
Project
Translator/vendor
Customer
Statistics
  Language
Distribution of segments i
More information
>
Benchmark
Quality Dashboard
Content profiling
Quality evaluation
Adequacy/Fluency
Error review
MT Ranking
Productivity measurement
DQF API
August 31, 2015: 566,987,756 words have been measured

8. What is my productivity compared to industry?
Home
Services
Academy
Events
Blog
Review
Membership
My TAUS
Quality Dashboard
Productivity
Efficiency
Adequacy
Fluency
Language
Time
Technology
Process
Content
Industry
Project
Translator/vendor
Customer
Statistics
  Language
Distribution of segments i
More information
>
Benchmark
Quality Dashboard
Content profiling
Quality evaluation
Adequacy/Fluency
Error review
MT Ranking
Productivity measurement
DQF API
August 31, 2015: 566,987,756 words have been measured

9. Where do my translations come from?
Home
Services
Academy
Events
Blog
Review
Membership
My TAUS
Quality Dashboard
Productivity
Efficiency
Adequacy
Fluency
Language
Time
Technology
Process
Content
Industry
Project
Translator/vendor
Customer
Statistics
  Language
Distribution of segments i
More information
>
Benchmark
Quality Dashboard
Content profiling
Quality evaluation
Adequacy/Fluency
Error review
MT Ranking
Productivity measurement
DQF API
August 31, 2015: 566,987,756 words have been measured

10. Where do my translations come from vs. industry?
Home
Services
Academy
Events
Blog
Review
Membership
My TAUS
Quality Dashboard
Productivity
Efficiency
Adequacy
Fluency
Language
Time
Technology
Process
Content
Industry
Project
Translator/vendor
Customer
Statistics
  Language
Distribution of segments i
More information
>
Benchmark
Quality Dashboard
Content profiling
Quality evaluation
Adequacy/Fluency
Error review
MT Ranking
Productivity measurement
DQF API
August 31, 2015: 566,987,756 words have been measured

11. What is my productivity by language and by project?
Home
Services
Academy
Events
Blog
Review
Membership
My TAUS
Quality Dashboard
Productivity
Efficiency
Adequacy
Fluency
Language
Time
Technology
Process
Content
Industry
Project
Translator/vendor
Customer
Statistics
  Language
Distribution of segments i
More information
>
Benchmark
Quality Dashboard
Content profiling
Quality evaluation
Adequacy/Fluency
Error review
MT Ranking
Productivity measurement
DQF API
August 31, 2015: 566,987,756 words have been measured

12. TAUS DQF Infrastructure
Project manager
DQF Analysis engine
DQF Reporting engine
TMS / GMS / CAT Tool
Project settings
TAUS DQF SERVER
User management
Translator can in some cases be the same person as the project manager
Translator
Segment/timing
CAT Tool / editor
Translator report
Project manager report …
Business Intelligence report

13. Project manager

14. Project classification
Content type
Industry
Process
Quality level
CAT Tool / MT engine

15. Project manager defines project

16. Translator

18. The translator won’t see differences, because everything happens in the background

19. Data points Milliseconds per segment Source segment Target segment
Edited target segments
Time
Language pair
Project key
Translator key

20. Experiences with the implementation
Desktop applications
How to transfer the project?
How to register the translator?
Cloud based
Implementation is easier
All data is central

21. Benefits of the Quality Dashboard
DQF elevates the discussion about quality to an industry level.
The resulting benefits are:
Sharing knowledge and standard references
Increased credibility
Lower cost
Increased satisfaction
Increased flexibility

22. What’s next? Find out more on the TAUS web site:
Download the Quality Dashboard description
Find the API specifications and integrate your translation tool

23. This slide may not be used or copied without permission from TAUS