1. Potential impact of QT21 Eleanor Cornelius
University of Johannesburg; International Federation of Translators

2. Content FIT and QT21 Human engagement in MT Two aspects of QT21
Basic research
Analytic evaluation of MT quality by professional human translators
Potential impact of QT21 on MT and professional translators

3. Introduction International Federation of Translators
Partner in QT21 project:
2015 – 2018
address language barriers in Europe that …
impede free flow of information
harmonization of MQM and DQF

4. Human engagement in MT Provision of input and pre-processing
Sentence tokenization and alignment
Removal of formatting annotations
Character normalization
Tokenization
Lowercasing and truecasing
Pre-editing of source texts
Gisting and triage
Post-editing of MT output
Use of selected segments of raw MT
No use of MT

5. Two aspects of QT21
Basic research
Analytic evaluation of MT quality

6. Evaluation of translation quality
Metrics are either:
holistic or analytic
reference-based or reference-free
automatic/fast or manual/slower
Consider issues of:
validity
reliability

7. QT21: Quality approach Multidimensional Quality Metrics (MQM):
Analytic
Standard error categories
Manual
Highly informative
Judgements of human translators
Pros and cons of automatic vs analytic metrics

8. MQM and professional translators
Judgements of appropriate translations
Fair: criteria available in advance
Direct comparison
Strengths and weaknesses of MT

9. Impact of QT21 on MT and professional translators
Human translators to participate
Gain an insider view of MT and understand its status
Observe strengths / weaknesses of MT
Advice to buyers of translation services
Familiarity with MQM

10. THANK YOU!