Click to edit Master title style Evaluation of Electronic Translation Tools Through Quality Parameters Vlasta Kučiš University of Maribor, Department of Translation Studies Sanja Seljan, Ksenija Klasnić University of Zagreb *Department of Information Sciences **Department of Sociology

Click to edit Master title style Overview Theoretical part –EU & multilingualism –Education for translators –EMT (European Master’s in Translation) Empirical part –Research (goal, sample, tools) –Evaluation Results Conclusion

Click to edit Master title style How to make Multilingual Communication & Translation in the 21.st century… ???

Click to edit Master title style Translation and the EU EU - communication in 23 official languages  Increased translation demands Multilingualism policy  unique in the world  all languages = equal status DGT  the biggest translation service  pages per day / translators Changes in translation profession  development of language technologies Education for translators - EMT

Click to edit Master title style DGT brings the EU closer to the citizens

Click to edit Master title style Multilingualism is about building bridges, between people and across policies. Efficient and pragmatic internal language regimes  Access to institutions, rights and obligations  Interaction between citizens Dimensions:

Click to edit Master title style Official EU languages Croatian  2012 ???

Click to edit Master title style Evolution of the translation service in the European Commission Increase Languages423X 6 Management4118X 30 Staff252500X 100 Pages translated X 100

Click to edit Master title styleEuropean Master’s EMT High-quality training for professional translators  experts in multilingual communication Enhance the status of translation as a profession  criteria of excellence Competences: language, intercultural, thematic, technological, organisational

Click to edit Master title style II RESEARCH Sample N=51 student all 4 years (convenient sample) Department of Translation Studies, University of Maribor 2 EU-texts of similar length –text 1 =159 words / group A; –text 2 = 140 words / group B German - Slovene 45 minutes Evaluation - by professional bilingual translator (German + Slovene as mother tongues)

Click to edit Master title style Tools Group A traditional electronic dictionary Ger-Slo(Debenjak) online dict. Duden search engines (Google + Yahoo ) Group B Slov. Evrokorpus Slov. Evroterm Terminology base integrated into SDL Trados

Click to edit Master title style Mistake categories: 1.Lexical mistakes 2.Spelling & punctuation mistakes 3.Syntactic & stylistic mistakes

Click to edit Master title style Results Total number of mistakes and paired samples statistics p<0.001 – average number of all mistakes has statistically significantly decreased

Click to edit Master title style Lexical mistakes Statistically significant difference al level p<.001, df=50

Click to edit Master title style Spelling & punctuation mistakes - no. of spelling mistakes: A) 243 B) coefficient of variability – bigger in B) -> need for adequate education for use of translation tools Statistically significant difference al level p<.001, df=50

Click to edit Master title style Syntactic & stilistic mistakes - no. of spelling mistakes: A) 236 B) coefficient of variability – bigger in B) -> need for adequate education for use of translation tools Use of translation tools has at statistically significant level decreased number of syntactic and stylistic mistakes with p<.001, df=50 t=4.43

Click to edit Master title styleImprovements in %

Click to edit Master title style CONCLUSION Introduction of CAT tools significantly influence the quality coefficient of variability – bigger in B) -> need for adequate education for use of translation tools T-tests – statistically significant difference at all levels with p<0.001 Acceptance of hypothesis: –Online translation tools contribute to the quality and consistency of technical translations at all 3 levels facing new challenges in education, business, cooperation