Potential impact of QT21 Eleanor Cornelius

Slides:

Advertisements

Similar presentations

Advertisements

Machine Translation The Translator s Choice Heidi Düchting Sylke Krämer Johann Roturier.

Assessment Assessment should be an integral part of a unit of work and should support student learning. Assessment is the process of identifying, gathering.

Copyright © Allyn & Bacon 2011 Assessing Students and Texts Chapter 4 This multimedia product and its content are protected under copyright law. The following.

Help communities share knowledge more effectively across the language barrier Automated Community Content Editing PorTal.

Rating Evaluation Methods through Correlation presented by Lena Marg, Language Tools MTE 2014, Workshop on Automatic and Manual Metrics for Operational.

Montana Mathematics Content Standards, Benchmarks, and Performance Descriptors 2/6/2010.

Holistic vs Analytical Assessment in Legal Translation Carmen Valero-Garcés & Francisco Vigier – University of Alcalá Mary Phelan – Dublin City University.

-Arthur Lewis (alew525). Contents Background and Introduction Overview of Popular Environments Empirical Studies Borland Delphi v/s SimplifIDE Gild v/s.

Joke Daems PhD student Lieve Macken, Sonia Vandepitte, Robert Hartsuiker Comparing HT and PE using advanced research tools.

MT Evaluation: Human Measures and Assessment Methods : Machine Translation Alon Lavie February 23, 2011.

Magia G. Krause Ph.D. Candidate School of Information University of Michigan Society of American Archivists Annual Meeting August 14, 2009 Undergraduates.

(aka: Universal Design) Graded Assignments for All.

Interactive Translation vs. Pre-Translation in the Context of Translation Memory Systems: Investigating the Effects of Translation Method on Productivity,

Speech and Language Technologies in the Next Generation Localisation CSET Prof. Andy Way, School of Computing, DCU.

PERSONALITY. Major Issues n Theoretical vs. Psychometric base n Nature vs. Nurture n Administration n Culture bias? Free? Fair?

Team presentation Yayyy!!!. Who should attend This is your group presentation at the end of three marketing mini-projects and a marketing class. Everybody.

Painless Performance Appraisals. Introduction Introduce yourself to the others at your table and include a story about being on the business end of.

Program Design: Analyzing Program Models

Minnesota Manual of Accommodations for Students with Disabilities Training Guide

JOHN F. SHEEHAN, PH.D. EVIDENCE-BASED OBSERVATIONS.

Community Planning Training 1-1. Community Plan Implementation Training 1- Community Planning Training 1-3.

Help communities share knowledge more effectively across the language barrier Automated Community Content Editing PorTal.

ICT work programme ICT 17 Cracking the language barrier Aleksandra Wesolowska Unit G.3 - Data Value Chain.

6 th semester Course Instructor: Kia Karavas.  What is educational evaluation? Why, what and how can we evaluate? How do we evaluate student learning?

Chapter 4 Evaluating and Creating Interactive and Content- Based Assessment.

Classroom Assessment A Practical Guide for Educators by Craig A

Chapter 6 Training Evaluation. Chapter 6 Training Evaluation Concepts Training Evaluation: The process of collecting data regarding outcomes needed to.

1 Macmillan Academy - ICT Department Unit 2 – ICT In Organisations UNIT 2 – ICT IN ORGANISATIONS.

The CoNLL-2013 Shared Task on Grammatical Error Correction Hwee Tou Ng, Yuanbin Wu, and Christian Hadiwinoto 1 Siew.

Chapter 3: Managing Design Processes

Purchasers’ Showcase 2007 Successful Bidding in the Public Sector March 2007.

How do Humans Evaluate Machine Translation? Francisco Guzmán, Ahmed Abdelali, Irina Temnikova, Hassan Sajjad, Stephan Vogel.

Automatic Post-editing (pilot) Task Rajen Chatterjee, Matteo Negri and Marco Turchi Fondazione Bruno Kessler [ chatterjee | negri | turchi

Math Information Retrieval Zhao Jin. Zhao Jin. Math Information Retrieval Examples: –Looking for formulas –Collect teaching resources –Keeping updated.

Choosing a research method:  Using Figure 1.1 on p.8 of Yin, place your budding dissertation ideas in relationship to the three conditions and the five.

1 The Good, the Bad, and the Ugly: Collecting and Reporting Quality Performance Data.

Faisal Naru Head of Better Regulation DAI Europe Ltd November 2007 Washington London Johannesburg Ramallah RIA – An Art and not a Science.

Assessment Information from multiple sources that describes a student’s level of achievement Used to make educational decisions about students Gives feedback.

Assessment. Workshop Outline Testing and assessment Why assess? Types of tests Types of assessment Some assessment task types Backwash Qualities of a.

ACIS Introduction to Data Analytics & Business Intelligence Ad-hoc Reporting Query Basics.

Writing Rubrics for Formative and Summative Assessment Developed for the NRCAL Professional Development Seminar (July 20-24, 2015) by James Hussar, Associate.

Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov February 16, 2011.

Census quality evaluation: Considerations from an international perspective Bernard Baffour and Paolo Valente UNECE Statistical Division Joint UNECE/Eurostat.

H2020 ICT WP ICT 17 Cracking the language barrier Aleksandra Wesolowska Unit G.3 - Data Value Chain H2020-LEIT-ICT WP pending Commission.

EDU 626 Course Tutorial For more course tutorials visit

Lessons from a CAEP Early-Adopter

Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov March 23, 2011.

Introduction to Compiler Construction

Classroom Assessment A Practical Guide for Educators by Craig A

Writing Rubrics Module 5 Activity 4.

Formal Analytical Reports

The ACCEPT Project Enabling machine translation for the emerging community content paradigm. Allowing citizens across the EU better access to communities.

Master of Translation An introduction to post-editing

Systems & Systems Analysis

Lesson plans Introduction.

HIGHLIGHTING THE KEY CHANGES

Co-Teaching and Collaborative Planning

Immediate activity.

Statistical vs. Neural Machine Translation: a Comparison of MTH and DeepL at Swiss Post’s Language service Lise Volkart – Pierrette Bouillon – Sabrina.

MT and Post-editing from a Translator’s Perspective

Trying to Standardinslation Quality – What Were They Thinking?

Training Evaluation Chapter 6

By Hossein Hematialam and Wlodek Zadrozny Presented by

Free PowerPoint Templates

Implementation Business Case

Microsoft Excel 2007 – Level 2

Writing the E1.

Linking Internal Verification to the QA Criteria

SWOT Analysis Template

Presentation transcript:

Potential impact of QT21 Eleanor Cornelius University of Johannesburg; International Federation of Translators

Content FIT and QT21 Human engagement in MT Two aspects of QT21 Basic research Analytic evaluation of MT quality by professional human translators Potential impact of QT21 on MT and professional translators

Introduction International Federation of Translators Partner in QT21 project: 2015 – 2018 address language barriers in Europe that … impede free flow of information harmonization of MQM and DQF

Human engagement in MT Provision of input and pre-processing Sentence tokenization and alignment Removal of formatting annotations Character normalization Tokenization Lowercasing and truecasing Pre-editing of source texts Gisting and triage Post-editing of MT output Use of selected segments of raw MT No use of MT

Two aspects of QT21 Basic research Analytic evaluation of MT quality

Evaluation of translation quality Metrics are either: holistic or analytic reference-based or reference-free automatic/fast or manual/slower Consider issues of: validity reliability

QT21: Quality approach Multidimensional Quality Metrics (MQM): Analytic Standard error categories Manual Highly informative Judgements of human translators Pros and cons of automatic vs analytic metrics

MQM and professional translators Judgements of appropriate translations Fair: criteria available in advance Direct comparison Strengths and weaknesses of MT

Impact of QT21 on MT and professional translators Human translators to participate Gain an insider view of MT and understand its status Observe strengths / weaknesses of MT Advice to buyers of translation services Familiarity with MQM

THANK YOU! eleanorc@uj.ac.za