Presentation is loading. Please wait.

Presentation is loading. Please wait.

David Farwell, Stephen Helmreich Computing Research Laboratory/New Mexico State University Lori Levin, Teruko Mitamura Language Technologies Institute/Carnegie.

Published by Modified over 9 years ago

Similar presentations

Presentation on theme: "David Farwell, Stephen Helmreich Computing Research Laboratory/New Mexico State University Lori Levin, Teruko Mitamura Language Technologies Institute/Carnegie."— Presentation transcript:

1 David Farwell, Stephen Helmreich Computing Research Laboratory/New Mexico State University Lori Levin, Teruko Mitamura Language Technologies Institute/Carnegie Mellon University Bonnie Dorr, Rebecca Green Institute for Advanced Computer Studies/University of Md. Eduard Hovy Information Sciences Institute/University of S. California Keith Miller, Florence Reeder MITRE Corporation Owen Rambow, Nizar Habash Columbia University Columbia, CRL/NMSU, ISI/USC, LTI/CMU, MITRE, UMIACS/UMD

2 What we annotate multiple comparable bilingual text corpora parallel text corpora multiple translations of texts Genre - newspaper texts / DARPA corpus Goals common representation (interlingua) common methodology and tools observe and catalogue different surface realizations of the same meaning across and within languages Columbia, CRL/NMSU, ISI/USC, LTI/CMU, MITRE, UMIACS/UMD

3

4

5 Annotation Process Text is syntactically parsed (Connexor / IL0) Reviewed and corrected (TrEd) Annotation to IL1 (Tiamat) Content words annotated for sense (Omega) Arguments annotated for thematic role (LCS) 2 English translations of 6 articles Arabic, French, Hindi, Japanese, Korean, Spanish 12 annotators, 2 at each site Total: 144 annotated texts to IL1 level Columbia, CRL/NMSU, ISI/USC, LTI/CMU, MITRE, UMIACS/UMD

6 Results: Agreement & Time Tools (Tiamat) Manuals (IL0 for 7 languages, IL1) Inter-annotator agreement: kappa =.83 (mK),.66 (wn),.59 (theta-roles) Annotation time: 4 hours/annotator/ text, 250 words/text, 2 annotators/text = approx. 2 person years for 100K at IL1 Next step: merge IL1 representations and develop transformation algorithms to produce IL2 Columbia, CRL/NMSU, ISI/USC, LTI/CMU, MITRE, UMIACS/UMD

Download ppt "David Farwell, Stephen Helmreich Computing Research Laboratory/New Mexico State University Lori Levin, Teruko Mitamura Language Technologies Institute/Carnegie."

Similar presentations

Rationale for a multilingual corpus for machine translation evaluation Debbie Elliott Anthony Hartley Eric Atwell Corpus Linguistics 2003, Lancaster, England.

Rationale for a multilingual corpus for machine translation evaluation Debbie Elliott Anthony Hartley Eric Atwell Corpus Linguistics 2003, Lancaster, England.
Machine Translation: Interlingual Methods Thanks to Les Sikos Bonnie J. Dorr, Eduard H. Hovy, Lori S. Levin.

Machine Translation: Interlingual Methods Thanks to Les Sikos Bonnie J. Dorr, Eduard H. Hovy, Lori S. Levin.
The Application of Machine Translation in CADAL Huang Chen, Chen Haiying Zhejiang University Libraries, Hangzhou, China 2006. 11. 20.

The Application of Machine Translation in CADAL Huang Chen, Chen Haiying Zhejiang University Libraries, Hangzhou, China
Sequencing and Communicative Function in Complex Dialogs Rebecca Passonneau and Owen Rambow becky, Center for Computational Learning.

Sequencing and Communicative Function in Complex Dialogs Rebecca Passonneau and Owen Rambow becky, Center for Computational Learning.
Jing-Shin Chang National Chi Nan University, IJCNLP-2013, Nagoya 2013/10/15 ACLCLP – Activities (2011-2013) & Text Corpora.

Jing-Shin Chang National Chi Nan University, IJCNLP-2013, Nagoya 2013/10/15 ACLCLP – Activities ( ) & Text Corpora.
June 6, 20073rd PIRE Meeting1 Tectogrammatical Representation of English in Prague Czech-English Dependency Treebank Lucie Mladová Silvie Cinková, Kristýna.

June 6, 20073rd PIRE Meeting1 Tectogrammatical Representation of English in Prague Czech-English Dependency Treebank Lucie Mladová Silvie Cinková, Kristýna.
Overview of the Hindi-Urdu Treebank Fei Xia University of Washington 7/23/2011.

Overview of the Hindi-Urdu Treebank Fei Xia University of Washington 7/23/2011.
< Translator Team > 25+ Languages, …and growing!.

< Translator Team > 25+ Languages, …and growing!.
Annotating Committed Belief Mona Diab, Lori Levin, Teruko Mitamura, Owen Rambow CMU/Columbia-CCLS

Annotating Committed Belief Mona Diab, Lori Levin, Teruko Mitamura, Owen Rambow CMU/Columbia-CCLS
Center for Computational Learning Systems Independent research center within the Engineering School NLP people at CCLS: Mona Diab, Nizar Habash, Martin.

Center for Computational Learning Systems Independent research center within the Engineering School NLP people at CCLS: Mona Diab, Nizar Habash, Martin.
Are Linguists Dinosaurs? 1.Statistical language processors seem to be doing away with the need for linguists. –Why do we need linguists when a machine.

Are Linguists Dinosaurs? 1.Statistical language processors seem to be doing away with the need for linguists. –Why do we need linguists when a machine.
HTL-ACTS Workshop, June 2006, New York City Improving Email Speech Acts Analysis via N-gram Selection Vitor R. Carvalho & William W. Cohen Carnegie Mellon.

HTL-ACTS Workshop, June 2006, New York City Improving Speech Acts Analysis via N-gram Selection Vitor R. Carvalho & William W. Cohen Carnegie Mellon.
Inducing Information Extraction Systems for New Languages via Cross-Language Projection Ellen Riloff University of Utah Charles Schafer, David Yarowksy.

Inducing Information Extraction Systems for New Languages via Cross-Language Projection Ellen Riloff University of Utah Charles Schafer, David Yarowksy.
Center for Computational Learning Systems Independent research center within the Engineering School NLP people at CCLS: Mona Diab, Nizar Habash, Martin.

Center for Computational Learning Systems Independent research center within the Engineering School NLP people at CCLS: Mona Diab, Nizar Habash, Martin.
Semantic Annotation Evaluation and Utility Bonnie Dorr Saif Mohammad David Yarowsky Keith Hall.

Semantic Annotation Evaluation and Utility Bonnie Dorr Saif Mohammad David Yarowsky Keith Hall.
Machine Translation Prof. Alexandros Potamianos Dept. of Electrical & Computer Engineering Technical University of Crete, Greece May 2003.

Machine Translation Prof. Alexandros Potamianos Dept. of Electrical & Computer Engineering Technical University of Crete, Greece May 2003.
LCS and Approximate Interlingua at UMD Semantic Annotation Planning Meeting April 14, 2004 Bonnie J. Dorr University of Maryland.

LCS and Approximate Interlingua at UMD Semantic Annotation Planning Meeting April 14, 2004 Bonnie J. Dorr University of Maryland.
Resources Primary resources – Lexicons, structured vocabularies – Grammars (in widest sense) – Corpora – Treebanks Secondary resources – Designed for a.

Resources Primary resources – Lexicons, structured vocabularies – Grammars (in widest sense) – Corpora – Treebanks Secondary resources – Designed for a.
Enhance legal retrieval applications with an automatically induced knowledge base Ka Kan Lo.

Enhance legal retrieval applications with an automatically induced knowledge base Ka Kan Lo.
1 The Web as a Parallel Corpus  Parallel corpora are useful  Training data for statistical MT  Lexical correspondences for cross-lingual IR  Early.

1 The Web as a Parallel Corpus  Parallel corpora are useful  Training data for statistical MT  Lexical correspondences for cross-lingual IR  Early.

Similar presentations

Ads by Google